Skip to content

Hotfix embedders #158

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 5 commits into from
Closed

Hotfix embedders #158

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
e958924
fix: missing embedders module
andhreljaKern Jul 22, 2025
b60e426
Merge branch 'dev' into hotfix-embedders
andhreljaKern Jul 23, 2025
b5a398a
perf: use pypi embedders instead of git
andhreljaKern Jul 23, 2025
85a5141
Merge branch 'hotfix-embedders' of https://github.com/code-kern-ai/re…
andhreljaKern Jul 23, 2025
d0154f7
fix: requirements comments
andhreljaKern Jul 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 19 additions & 4 deletions gpu-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,9 @@ click==8.2.1
cloudpathlib==0.21.1
# via weasel
cohere==5.16.1
# via -r requirements/gpu-requirements.in
# via
# -r requirements/gpu-requirements.in
# embedders
confection==0.1.5
# via
# thinc
Expand All @@ -78,6 +80,8 @@ cymem==2.0.11
# preshed
# spacy
# thinc
embedders==0.1.8
# via -r requirements/gpu-requirements.in
fastapi==0.116.1
# via -r requirements/torch-cuda-requirements.txt
fastavro==1.11.1
Expand Down Expand Up @@ -177,6 +181,7 @@ numpy==1.23.4
# via
# -r requirements/torch-cuda-requirements.txt
# blis
# embedders
# pandas
# scikit-learn
# scikit-optimize
Expand All @@ -186,7 +191,9 @@ numpy==1.23.4
# torchvision
# transformers
openai==0.28.1
# via -r requirements/gpu-requirements.in
# via
# -r requirements/gpu-requirements.in
# embedders
packaging==25.0
# via
# -r requirements/torch-cuda-requirements.txt
Expand Down Expand Up @@ -280,6 +287,7 @@ safetensors==0.5.3
scikit-learn==1.5.2
# via
# -r requirements/torch-cuda-requirements.txt
# embedders
# scikit-optimize
# sentence-transformers
scikit-optimize==0.9.0
Expand All @@ -291,7 +299,9 @@ scipy==1.13.1
# scikit-optimize
# sentence-transformers
sentence-transformers==5.0.0
# via -r requirements/gpu-requirements.in
# via
# -r requirements/gpu-requirements.in
# embedders
shellingham==1.5.4
# via typer
six==1.17.0
Expand All @@ -305,7 +315,9 @@ sniffio==1.3.1
# -r requirements/torch-cuda-requirements.txt
# anyio
spacy==3.7.5
# via -r requirements/gpu-requirements.in
# via
# -r requirements/gpu-requirements.in
# embedders
spacy-legacy==3.0.12
# via spacy
spacy-loggers==1.0.5
Expand Down Expand Up @@ -340,13 +352,15 @@ tokenizers==0.21.2
torch==2.7.1
# via
# -r requirements/torch-cuda-requirements.txt
# embedders
# sentence-transformers
# torchvision
torchvision==0.22.1
# via -r requirements/gpu-requirements.in
tqdm==4.67.1
# via
# -r requirements/torch-cuda-requirements.txt
# embedders
# huggingface-hub
# openai
# sentence-transformers
Expand All @@ -355,6 +369,7 @@ tqdm==4.67.1
transformers==4.53.2
# via
# -r requirements/torch-cuda-requirements.txt
# embedders
# sentence-transformers
typer==0.16.0
# via
Expand Down
23 changes: 19 additions & 4 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,9 @@ click==8.2.1
cloudpathlib==0.21.1
# via weasel
cohere==5.16.1
# via -r requirements/requirements.in
# via
# -r requirements/requirements.in
# embedders
confection==0.1.5
# via
# thinc
Expand All @@ -78,6 +80,8 @@ cymem==2.0.11
# preshed
# spacy
# thinc
embedders==0.1.8
# via -r requirements/requirements.in
fastapi==0.116.1
# via -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
fastavro==1.11.1
Expand Down Expand Up @@ -177,6 +181,7 @@ numpy==1.23.4
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# blis
# embedders
# pandas
# scikit-learn
# scikit-optimize
Expand All @@ -186,7 +191,9 @@ numpy==1.23.4
# torchvision
# transformers
openai==0.28.1
# via -r requirements/requirements.in
# via
# -r requirements/requirements.in
# embedders
packaging==25.0
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
Expand Down Expand Up @@ -280,6 +287,7 @@ safetensors==0.5.3
scikit-learn==1.5.2
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# embedders
# scikit-optimize
# sentence-transformers
scikit-optimize==0.9.0
Expand All @@ -291,7 +299,9 @@ scipy==1.13.1
# scikit-optimize
# sentence-transformers
sentence-transformers==5.0.0
# via -r requirements/requirements.in
# via
# -r requirements/requirements.in
# embedders
shellingham==1.5.4
# via typer
six==1.17.0
Expand All @@ -305,7 +315,9 @@ sniffio==1.3.1
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# anyio
spacy==3.7.5
# via -r requirements/requirements.in
# via
# -r requirements/requirements.in
# embedders
spacy-legacy==3.0.12
# via spacy
spacy-loggers==1.0.5
Expand Down Expand Up @@ -340,13 +352,15 @@ tokenizers==0.21.2
torch==2.7.1
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# embedders
# sentence-transformers
# torchvision
torchvision==0.22.1
# via -r requirements/requirements.in
tqdm==4.67.1
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# embedders
# huggingface-hub
# openai
# sentence-transformers
Expand All @@ -355,6 +369,7 @@ tqdm==4.67.1
transformers==4.53.2
# via
# -r /home/runner/work/refinery-submodule-parent-images/refinery-submodule-parent-images/refinery-embedder/requirements/torch-cpu-requirements.txt
# embedders
# sentence-transformers
typer==0.16.0
# via
Expand Down
1 change: 1 addition & 0 deletions requirements/gpu-requirements.in
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
-r torch-cuda-requirements.txt
embedders==0.1.8
spacy==3.7.5
torchvision==0.22.1 # define version for torchvision to avoid dependency conflict
sentence-transformers==5.0.0 # last version with default_prompt_name & pooling_mode_weightedmean_tokens # higher only possible with embedders/gates change
Expand Down
1 change: 1 addition & 0 deletions requirements/requirements.in
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
-r torch-cpu-requirements.txt
embedders==0.1.8
spacy==3.7.5
torchvision==0.22.1 # define version for torchvision to avoid dependency conflict
sentence-transformers==5.0.0 # last version with default_prompt_name & pooling_mode_weightedmean_tokens # higher only possible with embedders/gates change
Expand Down