Commit 09c7a19
Update interruption handling (#198)
* full tuning (#165)
* Added code for full tuning
* work on review
* renaming
* fix ruff
* mypy test
* ignote mypy
* Feat/bert scorer config refactoring (#168)
* refactor configs
* add proper configs to BERTScorer
* fix typing
* fix tokenizer's parameters
* fix transformers and accelerate issue
* Update optimizer_config.schema.json
* bug fix
* update callback test
* fix tests
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* delete validate_task
* report_to
* batches
* Fix/docs building for bert scorer (#171)
* fix
* fix codestyle
---------
Co-authored-by: Алексеев Илья <44509110+voorhs@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* bert-scorer ending (#172)
* batches
* tests check
* fix
* return to torch
* fix for tests
* Fix/bert scorer (#174)
* fix str and float issue and shrinken search space
* update `inference node config` overriding logic
* fix typing
* fix codestyle
* fix multilabel issue
* attempt to fix `inference node config` bugs
* another attempt
---------
Co-authored-by: Алексеев Илья <44509110+voorhs@users.noreply.github.com>
* Feat/code carbon each node (#175)
* feat: update codecarbon
* feat: update codecarbon
* feat: added codecarbon
* Update optimizer_config.schema.json
* fix: fixed import mypy
* fix: codecarbon package
* fix: only float\integer log
* fix: codecarbon package
* fix: mypy
* fix: test
* fix: delete emissions
* fix: test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* standartize pyproject & speedup tests (#176)
* speedup tests
* fix pyproject
* Update optimizer_config.schema.json
* move optional dependencies
* fixes
* add xdist
* fix ci
* download data from hub in doc
* add caching
* add doc cache
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* add proper `omit` definition for tests coverage report (#179)
* add proper `omit` definition
* Update optimizer_config.schema.json
* exclude tmp from coverage report
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* add node validators (#177)
* add node validators
* add comments
* Update optimizer_config.schema.json
* rename bert model
* lint
* fixes
* fix test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* dumper saving (#180)
* added main code for saving models
* Update optimizer_config.schema.json
* checker fixes
* Revert "checker fixes"
This reverts commit 6e32eb9.
* Revert "added main code for saving models"
This reverts commit 5637fb8.
* drat main code for new dumper
* ruf fix
* comments
* added code for test dumper
* Check dumper (#182)
* Feat/code carbon each node (#175)
* feat: update codecarbon
* feat: update codecarbon
* feat: added codecarbon
* Update optimizer_config.schema.json
* fix: fixed import mypy
* fix: codecarbon package
* fix: only float\integer log
* fix: codecarbon package
* fix: mypy
* fix: test
* fix: delete emissions
* fix: test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* standartize pyproject & speedup tests (#176)
* speedup tests
* fix pyproject
* Update optimizer_config.schema.json
* move optional dependencies
* fixes
* add xdist
* fix ci
* download data from hub in doc
* add caching
* add doc cache
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* add proper `omit` definition for tests coverage report (#179)
* add proper `omit` definition
* Update optimizer_config.schema.json
* exclude tmp from coverage report
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* add node validators (#177)
* add node validators
* add comments
* Update optimizer_config.schema.json
* rename bert model
* lint
* fixes
* fix test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* update makefile
* update bert test
* mypy workaround
* attempt to fix windows permission error
* workaround
---------
Co-authored-by: Darinochka <39233990+Darinochka@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Алексеев Илья <44509110+voorhs@users.noreply.github.com>
Co-authored-by: Darinochka <39233990+Darinochka@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
* Update embedder prompt (#183)
* Add trust remote code (#185)
* lint
* fix trust remote code
* Update optimizer_config.schema.json
* update fix trust remote code
* fix test cllback
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Remove autointent org from docs (#186)
* lint
* update paths
* feat: added crossencoder (#181)
* feat: added crossencoder
* refactor
* feat: added arg similarity
* Update optimizer_config.schema.json
* feat: added tests
* feat: added errors
* fix: scoring test
* fix: description vectors error
* fix: description vectors error
* fix: lint
* fix: test
* add node validators (#177)
* add node validators
* add comments
* Update optimizer_config.schema.json
* rename bert model
* lint
* fixes
* fix test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* fix: unit tests
* feat: added test for description
* feat: delete encoder_type from the class args
* feat: update assets
* feat: update assets
* fix: fixed test
* Update optimizer_config.schema.json
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* Add few shot (#187)
* init few shot
* Update optimizer_config.schema.json
* apply few shot to all
* Update optimizer_config.schema.json
* fix test
* lint
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* update numpy typing (#188)
* Lora scorer (#170)
* added lora scorer
* fix ruff
* Update __init__.py
* updated after mr #165
* Update pyproject.toml
* fixed requested changes
* fixed ruff failing
* fixed remarks
* Update optimizer_config.schema.json
* added test
* ruff fix
* convert labels to float
* Update autointent/modules/scoring/_lora/lora.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
* Update autointent/modules/scoring/_lora/lora.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
* change model_config name, added trust_remote_code
* Update lora.py
* inherited lora from bert
* fix ruff
* fix search space
* Update lora.py
* Update lora.py
* added dump check
* Update test_lora.py
* Update test_lora.py
* added docstring
* fix ruff
* Update test_lora.py
* Update test_lora.py
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
* PTuningScorer (#178)
* Initial commit of PTuningScorer module
* Added peft (>=0.10.0, <0.15.0) in dependencies
* Implement fit/predict PTuningScorer
* Added PTuningScorer in __init__ file
* Update optimizer_config.schema.json
* Minor fixs
* PGH00
* Refactor clear_cache in fit method
* Refactor typing ignore + remove unnecessary
* Fix fit method status check
* Added test for PTuningScorer
* Fix mypy typing
* Update and fix peft version dependencies
* Fix mypy typing
* Added test in multiclass.yaml, multilabel.yaml
* Update docs strings
* Fix mypy typing
* Added trust_remote_code
* make proper rst reference
* Added test for dump lod
* feat: added crossencoder (#181)
* feat: added crossencoder
* refactor
* feat: added arg similarity
* Update optimizer_config.schema.json
* feat: added tests
* feat: added errors
* fix: scoring test
* fix: description vectors error
* fix: description vectors error
* fix: lint
* fix: test
* add node validators (#177)
* add node validators
* add comments
* Update optimizer_config.schema.json
* rename bert model
* lint
* fixes
* fix test
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* fix: unit tests
* feat: added test for description
* feat: delete encoder_type from the class args
* feat: update assets
* feat: update assets
* fix: fixed test
* Update optimizer_config.schema.json
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* Added fixed seed to test reproduction
* Pull LoraScorer and Bert Refactor
* Refactor PTuningScorer
* Refactor test for ptuning
* Fix typing
* Fix multilabel multiclass tests
* Fix typing
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
Co-authored-by: Darinochka <39233990+Darinochka@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
* Rerank scorer: опция для выбора источника для расчета вектора вероятностей (#115)
* Enable rerank scorer to use crossencoder scores for the probability vector
* add cross encoder scores range options
* upd test
---------
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
* feat: add DISABLE_EMISSIONS_TRACKING (#191)
* feat: add DISABLE_EMISSIONS_TRACKING
* try to fix docs error
* Update optimizer_config.schema.json
* another attempt
* Update optimizer_config.schema.json
* i give up for now
* Update optimizer_config.schema.json
---------
Co-authored-by: voorhs <ilya_alekseev_2016@list.ru>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* fix issue (#194)
* Refactor/embedding caching (#195)
* implement new hashing strategy
* fix codestyle
* Update optimizer_config.schema.json
* minor bug fix
* fix typing error
* refactor similarity calculation
* Update optimizer_config.schema.json
* upd callback test
* solve 429 error
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* forgot something
---------
Co-authored-by: Сергей Малышев <68858104+SeBorgey@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Darinochka <39233990+Darinochka@users.noreply.github.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: VALERIA RUBANOVA <76725077+riapush@users.noreply.github.com>
Co-authored-by: nikiduki <72929274+nikiduki@users.noreply.github.com>
Co-authored-by: Dmitryv-2024 <dmitry.v.zhelobanov@yandex.ru>1 parent d4249aa commit 09c7a19
File tree
73 files changed
+2411
-552
lines changed- .github/workflows
- autointent
- _callbacks
- _dataset
- configs
- context/data_handler
- modules
- decision
- scoring
- _description
- _dnnc
- _knn
- _lora
- _mlknn
- _ptuning
- _sklearn
- nodes
- schemas
- docs
- source
- tests
- _transformers
- assets/configs
- callback
- configs
- data
- modules/scoring
- nodes
- pipeline
- user_guides
- advanced
- basic_usage
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
73 files changed
+2411
-552
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
40 | | - | |
41 | | - | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
42 | 45 | | |
43 | 46 | | |
44 | 47 | | |
45 | 48 | | |
46 | 49 | | |
47 | 50 | | |
48 | 51 | | |
49 | | - | |
| 52 | + | |
50 | 53 | | |
51 | 54 | | |
52 | 55 | | |
53 | 56 | | |
54 | 57 | | |
55 | | - | |
| 58 | + | |
56 | 59 | | |
57 | 60 | | |
58 | 61 | | |
59 | 62 | | |
60 | | - | |
| 63 | + | |
61 | 64 | | |
62 | 65 | | |
63 | 66 | | |
64 | 67 | | |
65 | | - | |
| 68 | + | |
66 | 69 | | |
67 | 70 | | |
68 | 71 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | 14 | | |
20 | 15 | | |
21 | | - | |
| 16 | + | |
22 | 17 | | |
23 | 18 | | |
24 | | - | |
| 19 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
180 | 180 | | |
181 | 181 | | |
182 | 182 | | |
183 | | - | |
| 183 | + | |
| 184 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
6 | | - | |
| 6 | + | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| |||
0 commit comments