Skip to content

Commit a0fd2e0

Browse files
sjmonsonsjmonson
authored
Merge branch 'main' into add-ut
2 parents 83b9e72 + 5859175 commit a0fd2e0

File tree

184 files changed

+34731
-12843
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

184 files changed

+34731
-12843
lines changed

‎.github/workflows/development.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ jobs:
99
runs-on: ubuntu-latest
1010
strategy:
1111
matrix:
12-
python: ["3.9", "3.13"]
12+
python: ["3.10", "3.13"]
1313
steps:
1414
- uses: actions/checkout@v4
1515
- name: Set up Python
@@ -44,7 +44,7 @@ jobs:
4444
runs-on: ubuntu-latest
4545
strategy:
4646
matrix:
47-
python: ["3.9", "3.13"]
47+
python: ["3.10", "3.13"]
4848
steps:
4949
- uses: actions/checkout@v4
5050
- name: Set up Python
@@ -79,7 +79,7 @@ jobs:
7979
runs-on: ubuntu-latest
8080
strategy:
8181
matrix:
82-
python: ["3.9"]
82+
python: ["3.10"]
8383
steps:
8484
- uses: actions/checkout@v4
8585
- name: Set up Python
@@ -114,7 +114,7 @@ jobs:
114114
runs-on: ubuntu-latest
115115
strategy:
116116
matrix:
117-
python: ["3.9", "3.13"]
117+
python: ["3.10", "3.13"]
118118
steps:
119119
- uses: actions/checkout@v4
120120
- name: Set up Python
@@ -149,7 +149,7 @@ jobs:
149149
runs-on: ubuntu-latest
150150
strategy:
151151
matrix:
152-
python: ["3.9", "3.13"]
152+
python: ["3.10", "3.13"]
153153
steps:
154154
- uses: actions/checkout@v4
155155
- name: Set up Python

‎.github/workflows/main.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ jobs:
1010
runs-on: ubuntu-latest
1111
strategy:
1212
matrix:
13-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
13+
python: ["3.10", "3.11", "3.12", "3.13"]
1414
steps:
1515
- uses: actions/checkout@v4
1616
- name: Set up Python
@@ -45,7 +45,7 @@ jobs:
4545
runs-on: ubuntu-latest
4646
strategy:
4747
matrix:
48-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
48+
python: ["3.10", "3.11", "3.12", "3.13"]
4949
steps:
5050
- uses: actions/checkout@v4
5151
- name: Set up Python
@@ -80,7 +80,7 @@ jobs:
8080
runs-on: ubuntu-latest
8181
strategy:
8282
matrix:
83-
python: ["3.9"]
83+
python: ["3.10"]
8484
steps:
8585
- uses: actions/checkout@v4
8686
- name: Set up Python
@@ -115,7 +115,7 @@ jobs:
115115
runs-on: ubuntu-latest
116116
strategy:
117117
matrix:
118-
python: ["3.9", "3.13"]
118+
python: ["3.10", "3.13"]
119119
steps:
120120
- uses: actions/checkout@v4
121121
- name: Set up Python
@@ -150,7 +150,7 @@ jobs:
150150
runs-on: ubuntu-latest
151151
strategy:
152152
matrix:
153-
python: ["3.9", "3.13"]
153+
python: ["3.10", "3.13"]
154154
steps:
155155
- uses: actions/checkout@v4
156156
- name: Set up Python

‎.github/workflows/nightly.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ jobs:
1010
runs-on: ubuntu-latest
1111
strategy:
1212
matrix:
13-
python: ["3.9"]
13+
python: ["3.10"]
1414
steps:
1515
- uses: actions/checkout@v4
1616
- name: Set up Python
@@ -26,7 +26,7 @@ jobs:
2626
runs-on: ubuntu-latest
2727
strategy:
2828
matrix:
29-
python: ["3.9", "3.13"]
29+
python: ["3.10", "3.13"]
3030
steps:
3131
- uses: actions/checkout@v4
3232
- name: Set up Python
@@ -61,7 +61,7 @@ jobs:
6161
runs-on: ubuntu-latest
6262
strategy:
6363
matrix:
64-
python: ["3.9", "3.13"]
64+
python: ["3.10", "3.13"]
6565
steps:
6666
- uses: actions/checkout@v4
6767
- name: Set up Python
@@ -96,7 +96,7 @@ jobs:
9696
runs-on: ubuntu-latest
9797
strategy:
9898
matrix:
99-
python: ["3.9", "3.13"]
99+
python: ["3.10", "3.13"]
100100
steps:
101101
- uses: actions/checkout@v4
102102
- name: Set up Python
@@ -142,7 +142,7 @@ jobs:
142142
runs-on: ubuntu-latest
143143
strategy:
144144
matrix:
145-
python: ["3.9"]
145+
python: ["3.10"]
146146
steps:
147147
- name: Checkout code
148148
uses: actions/checkout@v4

‎.github/workflows/release-candidate.yml‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ jobs:
1010
runs-on: ubuntu-latest
1111
strategy:
1212
matrix:
13-
python: ["3.9"]
13+
python: ["3.10"]
1414
steps:
1515
- uses: actions/checkout@v4
1616
- name: Set up Python
@@ -26,7 +26,7 @@ jobs:
2626
runs-on: ubuntu-latest
2727
strategy:
2828
matrix:
29-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
29+
python: ["3.10", "3.11", "3.12", "3.13"]
3030
steps:
3131
- uses: actions/checkout@v4
3232
- name: Set up Python
@@ -61,7 +61,7 @@ jobs:
6161
runs-on: ubuntu-latest
6262
strategy:
6363
matrix:
64-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
64+
python: ["3.10", "3.11", "3.12", "3.13"]
6565
steps:
6666
- uses: actions/checkout@v4
6767
- name: Set up Python
@@ -96,7 +96,7 @@ jobs:
9696
runs-on: ubuntu-latest
9797
strategy:
9898
matrix:
99-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
99+
python: ["3.10", "3.11", "3.12", "3.13"]
100100
steps:
101101
- uses: actions/checkout@v4
102102
- name: Set up Python
@@ -142,7 +142,7 @@ jobs:
142142
runs-on: ubuntu-latest
143143
strategy:
144144
matrix:
145-
python: ["3.9"]
145+
python: ["3.10"]
146146
steps:
147147
- name: Checkout code
148148
uses: actions/checkout@v4
@@ -228,7 +228,7 @@ jobs:
228228
uses: peaceiris/actions-gh-pages@v3
229229
with:
230230
github_token: ${{ secrets.GITHUB_TOKEN }}
231-
publish_dir: ./ui/out
231+
publish_dir: .src/ui/out
232232
destination_dir: ui/release/${TAG}
233233
keep_files: false
234234
user_name: ${{ github.actor }}
@@ -298,7 +298,12 @@ jobs:
298298
with:
299299
fetch-depth: 0
300300
- name: Get version from branch
301-
run: echo "PACKAGE_VERSION=${GITHUB_REF#refs/*/}" >> $GITHUB_ENV
301+
run: |
302+
echo "package_version=${GITHUB_REF#refs/heads/release/}" >> $GITHUB_ENV
303+
- name: Fail if version is unset
304+
if: ${{ env.package_version == '' }}
305+
run: |
306+
exit 1
302307
- name: Buildah build
303308
id: build-image
304309
uses: redhat-actions/buildah-build@v2

‎.github/workflows/release.yml‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ jobs:
1010
runs-on: ubuntu-latest
1111
strategy:
1212
matrix:
13-
python: ["3.9"]
13+
python: ["3.10"]
1414
steps:
1515
- name: Checkout code
1616
uses: actions/checkout@v4
@@ -55,7 +55,7 @@ jobs:
5555
runs-on: ubuntu-latest
5656
strategy:
5757
matrix:
58-
python: ["3.9"]
58+
python: ["3.10"]
5959
steps:
6060
- uses: actions/checkout@v4
6161
- name: Set up Python
@@ -71,7 +71,7 @@ jobs:
7171
runs-on: ubuntu-latest
7272
strategy:
7373
matrix:
74-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
74+
python: ["3.10", "3.11", "3.12", "3.13"]
7575
steps:
7676
- uses: actions/checkout@v4
7777
- name: Set up Python
@@ -106,7 +106,7 @@ jobs:
106106
runs-on: ubuntu-latest
107107
strategy:
108108
matrix:
109-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
109+
python: ["3.10", "3.11", "3.12", "3.13"]
110110
steps:
111111
- uses: actions/checkout@v4
112112
- name: Set up Python
@@ -141,7 +141,7 @@ jobs:
141141
runs-on: ubuntu-latest
142142
strategy:
143143
matrix:
144-
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
144+
python: ["3.10", "3.11", "3.12", "3.13"]
145145
steps:
146146
- uses: actions/checkout@v4
147147
- name: Set up Python
@@ -227,7 +227,7 @@ jobs:
227227
uses: peaceiris/actions-gh-pages@v3
228228
with:
229229
github_token: ${{ secrets.GITHUB_TOKEN }}
230-
publish_dir: ./ui/out
230+
publish_dir: ./src/ui/out
231231
destination_dir: ui/${TAG}
232232
keep_files: false
233233
user_name: ${{ github.actor }}
@@ -297,7 +297,12 @@ jobs:
297297
with:
298298
fetch-depth: 0
299299
- name: Get version from branch
300-
run: echo "PACKAGE_VERSION=${GITHUB_REF#refs/*/}" >> $GITHUB_ENV
300+
run: |
301+
echo "package_version=${GITHUB_REF#refs/tags/}" >> $GITHUB_ENV
302+
- name: Fail if version is unset
303+
if: ${{ env.package_version == '' }}
304+
run: |
305+
exit 1
301306
- name: Buildah build
302307
id: build-image
303308
uses: redhat-actions/buildah-build@v2

‎CONTRIBUTING.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ There are many ways to contribute to GuideLLM:
1818

1919
Before contributing, ensure you have the following installed:
2020

21-
- Python 3.9 or higher
21+
- Python 3.10 or higher
2222
- pip (Python package manager)
2323
- Tox
2424
- Git

‎Containerfile‎

Lines changed: 13 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -31,19 +31,28 @@ COPY / /src
3131

3232
# Install guidellm and locked dependencies
3333
RUN pdm use -p /src -f /opt/app-root \
34-
&& pdm install -p /src --check --prod --no-editable
34+
&& pdm install -p /src -G all --check --prod --no-editable
3535

3636
# Prod image
3737
FROM $BASE_IMAGE
3838

39+
# Switch to root for installing packages
40+
USER root
41+
42+
# Install some helpful utilities and deps
43+
RUN dnf install -y --setopt=install_weak_deps=False \
44+
vi tar rsync ffmpeg-free \
45+
&& dnf clean all
46+
47+
# Switch back to unpriv user
48+
# Root group for k8s
49+
USER 1001:0
50+
3951
# Add guidellm bin to PATH
4052
# Argument defaults can be set with GUIDELLM_<ARG>
4153
ENV HOME="/home/guidellm" \
4254
GUIDELLM_OUTPUT_PATH="/results/benchmarks.json"
4355

44-
# Make sure root is the primary group
45-
USER 1001:0
46-
4756
# Create the user home dir
4857
WORKDIR $HOME
4958

‎DEVELOPING.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ Thank you for your interest in contributing to GuideLLM! This document provides
88

99
Before you begin, ensure you have the following installed:
1010

11-
- Python 3.9 or higher
11+
- Python 3.10 or higher
1212
- pip (Python package manager)
1313
- Tox
1414
- Git

‎README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
Scale Efficiently: Evaluate and Optimize Your LLM Deployments for Real-World Inference
1010
</h3>
1111

12-
[![GitHub Release](https://img.shields.io/github/release/vllm-project/guidellm.svg?label=Version)](https://github.com/vllm-project/guidellm/releases) [![Documentation](https://img.shields.io/badge/Documentation-8A2BE2?logo=read-the-docs&logoColor=%23ffffff&color=%231BC070)](https://github.com/vllm-project/guidellm/tree/main/docs) [![License](https://img.shields.io/github/license/vllm-project/guidellm.svg)](https://github.com/vllm-project/guidellm/blob/main/LICENSE) [![PyPI Release](https://img.shields.io/pypi/v/guidellm.svg?label=PyPI%20Release)](https://pypi.python.org/pypi/guidellm) [![Python Versions](https://img.shields.io/badge/Python-3.9--3.13-orange)](https://pypi.python.org/pypi/guidellm) [![Nightly Build](https://img.shields.io/github/actions/workflow/status/vllm-project/guidellm/nightly.yml?branch=main&label=Nightly%20Build)](https://github.com/vllm-project/guidellm/actions/workflows/nightly.yml)
12+
[![GitHub Release](https://img.shields.io/github/release/vllm-project/guidellm.svg?label=Version)](https://github.com/vllm-project/guidellm/releases) [![Documentation](https://img.shields.io/badge/Documentation-8A2BE2?logo=read-the-docs&logoColor=%23ffffff&color=%231BC070)](https://github.com/vllm-project/guidellm/tree/main/docs) [![License](https://img.shields.io/github/license/vllm-project/guidellm.svg)](https://github.com/vllm-project/guidellm/blob/main/LICENSE) [![PyPI Release](https://img.shields.io/pypi/v/guidellm.svg?label=PyPI%20Release)](https://pypi.python.org/pypi/guidellm) [![Python Versions](https://img.shields.io/badge/Python-3.10--3.13-orange)](https://pypi.python.org/pypi/guidellm) [![Nightly Build](https://img.shields.io/github/actions/workflow/status/vllm-project/guidellm/nightly.yml?branch=main&label=Nightly%20Build)](https://github.com/vllm-project/guidellm/actions/workflows/nightly.yml)
1313

1414
## Overview
1515

@@ -36,7 +36,7 @@ Scale Efficiently: Evaluate and Optimize Your LLM Deployments for Real-World Inf
3636
Before installing, ensure you have the following prerequisites:
3737

3838
- OS: Linux or MacOS
39-
- Python: 3.9 – 3.13
39+
- Python: 3.10 – 3.13
4040

4141
The latest GuideLLM release can be installed using pip:
4242

‎docs/install.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ Before installing GuideLLM, ensure you have the following prerequisites:
88

99
- **Operating System:** Linux or MacOS
1010

11-
- **Python Version:** 3.9 – 3.13
11+
- **Python Version:** 3.10 – 3.13
1212

1313
- **Pip Version:** Ensure you have the latest version of pip installed. You can upgrade pip using the following command:
1414

0 commit comments

Comments
 (0)