Skip to content

Commit b498591

Browse files
authored
Merge pull request #2945 from bluewave-labs/llm-evals-module
Changed pytorch to cpu version.
2 parents 4304745 + c17ca26 commit b498591

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

EvalServer/Dockerfile

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,10 @@ WORKDIR /app
55

66
# Copy requirements first for better caching
77
COPY ./EvalServer/src/requirements.txt requirements.txt
8-
RUN pip install --no-cache-dir -r requirements.txt
8+
9+
# Install CPU-only PyTorch first (much smaller, no triton/CUDA), then other deps
10+
RUN pip install --no-cache-dir torch --index-url https://download.pytorch.org/whl/cpu && \
11+
pip install --no-cache-dir -r requirements.txt
912

1013
# Copy the application source
1114
COPY ./EvalServer/src .

0 commit comments

Comments
 (0)