Skip to content

Commit 63e71a7

Browse files
committed
UI changes+testing-nvidia and docker on windows
1 parent d7d3297 commit 63e71a7

File tree

55 files changed

+7047
-23708
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

55 files changed

+7047
-23708
lines changed

.gitignore

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,11 @@ dist/
3434
htmlcov/
3535
/results
3636
AI_DOCS
37+
38+
# Node modules
39+
node_modules/
40+
energy-leaderboard-web/node_modules/
41+
3742
# OS files
3843
.DS_Store
3944
Thumbs.db

Dockerfile

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,9 @@ COPY ./src /app/src
2424
# Copy data files
2525
COPY ./src/data /app/src/data
2626

27+
# Copy automation script
28+
COPY run_all_tests.py /app/run_all_tests.py
29+
2730
# Create results directory
2831
RUN mkdir -p /app/results
2932

README.md

Lines changed: 30 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,14 +127,43 @@ python src/main.py run-test \
127127

128128
### Automation Script
129129

130-
To run all 4 standard test sets (easy, medium, hard, math) in sequence:
130+
To run all 4 standard test sets (easy, medium, hard, mixed) in sequence:
131131

132132
```bash
133133
python run_all_tests.py --model llama3:latest
134134
```
135135

136136
This will generate output files with the format `results/output_{model}_{dataset}_{date}.json`.
137137

138+
### Running All Tests with Docker
139+
140+
**Windows with NVIDIA GPU:**
141+
```powershell
142+
docker run --rm `
143+
--gpus all `
144+
--entrypoint python `
145+
-v ${PWD}/results:/app/results `
146+
-e OLLAMA_HOST=http://host.docker.internal:11434 `
147+
energy-leaderboard-runner `
148+
run_all_tests.py --model llama3:latest
149+
```
150+
151+
**Linux with NVIDIA GPU:**
152+
```bash
153+
docker run --rm \
154+
--gpus all \
155+
--entrypoint python \
156+
-v $(pwd)/results:/app/results \
157+
-e OLLAMA_HOST=http://172.17.0.1:11434 \
158+
energy-leaderboard-runner \
159+
run_all_tests.py --model llama3:latest
160+
```
161+
162+
**Using Docker Compose:**
163+
```powershell
164+
docker compose run --rm --entrypoint python energy-leaderboard run_all_tests.py --model llama3:latest
165+
```
166+
138167
```
139168

140169
## Configuration

energy-leaderboard-web/node_modules/.package-lock.json

Lines changed: 45 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

energy-leaderboard-web/node_modules/.vite/deps/_metadata.json

Lines changed: 14 additions & 14 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)