Skip to content

parallelize tests #509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
PastelStorm merged 15 commits into from
Jun 14, 2025
Merged

parallelize tests #509

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
654ec65
parallelize tests
jiajun-unstructured Jun 5, 2025
deafbe3
try out ci change
jiajun-unstructured Jun 10, 2025
e3006b0
add make install test
jiajun-unstructured Jun 11, 2025
fd4e9e0
update test.txt
jiajun-unstructured Jun 11, 2025
d7212f0
change test runner to xlarge
jiajun-unstructured Jun 11, 2025
a711e0f
switch back to ubuntu-latest-m
jiajun-unstructured Jun 11, 2025
42b7cdd
remove absolute path
jiajun-unstructured Jun 12, 2025
e66cbb3
run make install in gha
jiajun-unstructured Jun 12, 2025
2abf77e
add test.txt in the cache key for ci.yml
jiajun-unstructured Jun 12, 2025
c6c2491
remove make install-nltk-models
jiajun-unstructured Jun 12, 2025
996a0ad
add cache hit miss to ci
jiajun-unstructured Jun 12, 2025
d7f339f
remove cache hit miss backup
jiajun-unstructured Jun 12, 2025
a4c87c1
Bump Python to 3.11, rebuild deps, revert CI changes
PastelStorm Jun 12, 2025
7c81aa8
downgrade unstructured to 0.16.17; fix test
jiajun-unstructured Jun 13, 2025
591c24c
skip the test where json became processable given the unstructured ve…
jiajun-unstructured Jun 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,6 +75,7 @@ jobs:
sudo apt-get install -y tesseract-ocr tesseract-ocr-kor
tesseract --version
make install-nltk-models
make install-test
make test
make check-coverage

Expand Down
2 changes: 1 addition & 1 deletion Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ run-web-app:
## test: runs core tests
.PHONY: test
test:
PYTHONPATH=. pytest -v test_${PIPELINE_PACKAGE} --cov=${PACKAGE_NAME} --cov-report term-missing
PYTHONPATH=. pytest -n auto -v test_${PIPELINE_PACKAGE} --cov=${PACKAGE_NAME} --cov-report term-missing

# Setting a low bar here - need more tests!
.PHONY: check-coverage
Expand Down
1 change: 1 addition & 0 deletions requirements/test.in
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ flake8
mypy
pytest-cov
pytest-mock
pytest-xdist
nbdev
jupyter
httpx
Expand Down
Loading