Skip to content

Commit fdf7c6d

Browse files
philm001ko3n1ggithub-actions[bot]ryantwolfVibhuJawa
authored
Updated documentation to include packaging requirements (#526)
* ci: Pin twine in release workflow (#512) * ci: Pin twine in release workflow Signed-off-by: oliver könig <okoenig@nvidia.com> * maybe fix? Signed-off-by: oliver könig <okoenig@nvidia.com> * fix Signed-off-by: oliver könig <okoenig@nvidia.com> --------- Signed-off-by: oliver könig <okoenig@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * ci: Version bump to 0.7.0rc1.dev0 (#513) Signed-off-by: oliver könig <okoenig@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Enforce Dataframe Backend Checks (#514) * Add module and to backend Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add backend tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add switch backend tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Update modules to use module interface Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Directly invoke module init Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix call method Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix shuffle call method Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add docs and more tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix list formatting in docs Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Address Sarah and Praateek's reviews Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix modifier get_backend to backend Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Address Ayush's review Signed-off-by: Ryan Wolf <rywolf@nvidia.com> --------- Signed-off-by: Ryan Wolf <rywolf@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Updated documentation to include packaging requirements Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Fixed formatting issues. Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Enable ADD ID to work with CPU/GPU both (#479) * Enable ADD ID to work with CPU/GPU both Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Make Test runable in a CPU only environment Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Fix pytest skipping behavior in CPU/GPU environment Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Raise error instead of skipping test Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> --------- Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Add Pooling Strategy Option for embedding creation (#491) * Add pooling stratedgy Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Ensure pytest is importable in a CPU only environment Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Fix last token based on Avinash's feedback Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Fix indexing issues Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Merge in main Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Fix Doc-string Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Address Sarah's reviews Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> --------- Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Add Partition On Logic (#519) * add partition_on logic Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Add Docstring based on Sarah's review Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Apply Praateek's suggestion and skip test with using pytest.mark.gpu Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> * Apply Praateek's suggestion and force index=False Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> --------- Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Add improved cleaning methods from Nemotron-CC (#517) * Add improved cleaning features Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix cleaning tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Update documentation and CLI scripts Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Address Sarah and Lawrence's reviews Signed-off-by: Ryan Wolf <rywolf@nvidia.com> --------- Signed-off-by: Ryan Wolf <rywolf@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Update model nomenclature (#497) * Update model nomenclature Signed-off-by: Sarah Yurick <sarahyurick@gmail.com> * minor notebook grammar Signed-off-by: Sarah Yurick <sarahyurick@gmail.com> * add lawrence's suggestion Signed-off-by: Sarah Yurick <sarahyurick@gmail.com> --------- Signed-off-by: Sarah Yurick <sarahyurick@gmail.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * small add_id backend fix (#525) Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * benchmark readme updates (#508) * benchmark readme updates Signed-off-by: Lawrence Lane <llane@nvidia.com> * benchmark image update Signed-off-by: Lawrence Lane <llane@nvidia.com> * benchmark text update Signed-off-by: Lawrence Lane <llane@nvidia.com> --------- Signed-off-by: Lawrence Lane <llane@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Removal logic for fuzzy / exact (no class abstraction) (#509) Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * ci: Limit unit-test duration (#534) Signed-off-by: oliver könig <okoenig@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Enforce Dataframe Backend Checks (#514) * Add module and to backend Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add backend tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add switch backend tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Update modules to use module interface Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Directly invoke module init Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix call method Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix shuffle call method Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Add docs and more tests Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix list formatting in docs Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Address Sarah and Praateek's reviews Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Fix modifier get_backend to backend Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * Address Ayush's review Signed-off-by: Ryan Wolf <rywolf@nvidia.com> --------- Signed-off-by: Ryan Wolf <rywolf@nvidia.com> * small add_id backend fix (#525) Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> * Removal logic for fuzzy / exact (no class abstraction) (#509) Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> --------- Signed-off-by: oliver könig <okoenig@nvidia.com> Signed-off-by: Phillip Mobley <phillipmobley2@gmail.com> Signed-off-by: Ryan Wolf <rywolf@nvidia.com> Signed-off-by: Vibhu Jawa <vjawa@nvidia.com> Signed-off-by: Sarah Yurick <sarahyurick@gmail.com> Signed-off-by: Lawrence Lane <llane@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Ryan Wolf <rywolf@nvidia.com> Co-authored-by: Vibhu Jawa <vibhujawa@gmail.com> Co-authored-by: Sarah Yurick <53962159+sarahyurick@users.noreply.github.com> Co-authored-by: L.B. <llane@nvidia.com> Co-authored-by: Praateek Mahajan <praateekmahajan@users.noreply.github.com>
1 parent 334a331 commit fdf7c6d

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

‎README.md‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,7 @@ This section explains how to install NeMo Curator and use the Python library, Py
7070
Before installing NeMo Curator, ensure that the following requirements are met:
7171

7272
- Python 3.10 or higher
73+
- packaging >= 22.0
7374
- Ubuntu 22.04/20.04
7475
- NVIDIA GPU (optional)
7576
- Volta™ or higher ([compute capability 7.0+](https://developer.nvidia.com/cuda-gpus))

‎docs/user-guide/image/gettingstarted.rst‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ Install NeMo Curator
1313
To install the image curation modules of NeMo Curator, ensure you meet the following requirements:
1414

1515
* Python 3.10 or higher
16+
* packaging >= 22.0
1617
* Ubuntu 22.04/20.04
1718
* NVIDIA GPU
1819
* Volta™ or higher (compute capability 7.0+)

0 commit comments

Comments
 (0)