Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
33f5f77
[WIP] Automating benchmarking with every push on the main branch
Manan17 Jun 3, 2025
e74af82
Avoid concurrency
Manan17 Jun 3, 2025
57c54fb
running a single test
Manan17 Jun 5, 2025
94d4168
Add the benchmark csv file to gh-pages branch
Manan17 Jun 5, 2025
58244ae
Merge branch 'main' into automate-benchmarking
Manan17 Jun 6, 2025
7e0c49f
resolved changes
Manan17 Jun 6, 2025
6726cd4
cleanup
Manan17 Jun 6, 2025
c8876a1
removed gh_token, added write permission, changed the git config info
Manan17 Jun 6, 2025
9bd20ad
cleanup
Manan17 Jun 6, 2025
29dbf4e
fix
Manan17 Jun 6, 2025
6459e1f
final fix
Manan17 Jun 6, 2025
d300b81
final fix
Manan17 Jun 6, 2025
46fe10a
Update benchmark.yml
Manan17 Jun 6, 2025
6889b23
Merge branch 'main' into automate-benchmarking
Manan17 Jun 10, 2025
d4c8dba
Merge branch 'linkedin:main' into automate-benchmarking
Manan17 Jun 10, 2025
06da3a3
disabling docs workflow as it replaces the gh-pages branch and we los…
Manan17 Jun 10, 2025
5b201b5
Merge branch 'automate-benchmarking' of https://github.com/Manan17/Li…
Manan17 Jun 10, 2025
13d8612
Adding commit hashes to JSON file
Manan17 Jun 10, 2025
2721369
updated benchmark
Manan17 Jun 10, 2025
003d621
updated benchmark
Manan17 Jun 10, 2025
02dc626
Resolving issues in yaml scripts
Jun 11, 2025
6953020
Merge branch 'main' into automate-benchmarking
Manan17 Jun 11, 2025
e99cf82
Update docs.yml
Manan17 Jun 11, 2025
5358a7f
fixing syntax
Jun 11, 2025
1016672
Update benchmark.yml
Manan17 Jun 11, 2025
166c119
Merge branch 'automate-benchmarking' of https://github.com/Manan17/Li…
Jun 11, 2025
8683240
trying
Jun 11, 2025
ed95862
fixing
Jun 11, 2025
cca6257
code style fixup
Jun 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 5 additions & 11 deletions .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,30 +33,28 @@ jobs:
- name: Checkout code
uses: actions/checkout@v3

# Get the latest commit hash from main branch
# Get the latest commit hash from main branch
- name: Get commit hash
id: get_hash
run: echo "hash=$(git rev-parse --short HEAD)" >> $GITHUB_OUTPUT


- name: Set up Python
uses: actions/setup-python@v3
with:
python-version: '3.10'

# Install dependencies
# Install dependencies
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install modal
pip install pandas

# Delete previous benchmark results.
- name: Remove previous benchmark data
# Delete previous benchmark results.
- name: Remove previous benchmark data
run: |
rm -f benchmark/data/all_benchmark_data.csv



- name: Run benchmarks on GPU
run: |
modal run dev.modal.benchmarks
Expand All @@ -79,11 +77,9 @@ jobs:
run: |
cd gh-pages
echo "commits.txt file path: ${OUTPUT_DIR}/commits.txt"

# Create file if it doesn't exist
mkdir -p ${OUTPUT_DIR}
touch ${OUTPUT_DIR}/commits.txt

# Append only if not already present
if ! grep -q "${{ steps.get_hash.outputs.hash }}" ${OUTPUT_DIR}/commits.txt; then
echo "${{ steps.get_hash.outputs.hash }}" >> ${OUTPUT_DIR}/commits.txt
Expand All @@ -98,5 +94,3 @@ jobs:
git add .
git commit -m "Add benchmark for commit ${{ steps.get_hash.outputs.hash }}" || echo "No changes to commit"
git push origin gh-pages


7 changes: 2 additions & 5 deletions .github/workflows/docs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,11 @@ on:
branches:
- main

env:
ENABLE_DEPLOY: false

permissions:
contents: write
jobs:
deploy:
if: env.ENABLE_DEPLOY == 'true'
if: False
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
Expand All @@ -30,4 +27,4 @@ jobs:
restore-keys: |
mkdocs-material-
- run: pip install mkdocs-material
- run: mkdocs gh-deploy --force
- run: mkdocs gh-deploy --force