Skip to content

Commit 6bd7b6e

Browse files
chtruong814suiyoubilbliiiayushdg
authored
Fix InternVideo2 doc and replace NVIDIA/NeMo-Curator with NVIDIA-NeMo/Curator (#1150) (#1151)
* typo; value numbers, * remove macos * remove xennaexecutor import since it's the default * ffmpeg details on the admin install guide * container step * remove ffmpeg apt get * specific version of container * remove duplicate, update image * fix * remove version * feedback * tutorial updates * fixes to directives * InternVideo2 Support (Optional for Video) * Replace NVIDIA/NeMo-Curator with NVIDIA-NeMo/Curator * Update docs/admin/installation.md --------- Signed-off-by: Lawrence Lane <llane@nvidia.com> Signed-off-by: Ao Tang <aot@nvidia.com> Signed-off-by: Ao Tang <mike.tang96@gmail.com> Signed-off-by: NeMo Bot <nemo-bot@nvidia.com> Co-authored-by: Ao Tang <aot@nvidia.com> Co-authored-by: Lawrence Lane <llane@nvidia.com> Co-authored-by: Ayush Dattagupta <ayushdg95@gmail.com>
1 parent 30dc3b2 commit 6bd7b6e

File tree

19 files changed

+49
-35
lines changed

19 files changed

+49
-35
lines changed

‎.github/PULL_REQUEST_TEMPLATE.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,6 @@
1212
Note: All commits need to be signed and signed off. This can be done via `-sS` flags while commiting
1313
`git commit -sS -m "...."
1414
-->
15-
- [ ] I am familiar with the [Contributing Guide](https://github.com/NVIDIA/NeMo-Curator/blob/main/CONTRIBUTING.md).
15+
- [ ] I am familiar with the [Contributing Guide](https://github.com/NVIDIA-NeMo/Curator/blob/main/CONTRIBUTING.md).
1616
- [ ] New or Existing tests cover these changes.
1717
- [ ] The documentation is up to date with these changes.

‎CITATION.cff‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
cff-version: 1.0.0
22
message: "If you use this software, please cite it as below."
33
title: "NeMo-Curator: a toolkit for data curation"
4-
repository-code: https://github.com/NVIDIA/NeMo-Curator
4+
repository-code: https://github.com/NVIDIA-NeMo/Curator
55
authors:
66
- family-names: Jennings
77
given-names: Joseph

‎docs/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -215,7 +215,7 @@ myst_substitutions = {
215215
"company": "NVIDIA",
216216
"version": release, # Uses the release variable from conf.py
217217
"current_year": "2025",
218-
"github_repo": "https://github.com/NVIDIA/NeMo-Curator",
218+
"github_repo": "https://github.com/NVIDIA-NeMo/Curator",
219219
"docs_url": "https://docs.nvidia.com/nemo-curator",
220220
"support_email": "nemo-curator-support@nvidia.com",
221221
"min_python_version": "3.8",
@@ -282,7 +282,7 @@ image:
282282

283283
# Documentation URLs using MyST substitutions
284284
downloads:
285-
releaseUrl: "https://github.com/NVIDIA/NeMo-Curator/releases/download/v{{ version }}/nemo-curator.tar.gz" # ← MyST substitution
285+
releaseUrl: "https://github.com/NVIDIA-NeMo/Curator/releases/download/v{{ version }}/nemo-curator.tar.gz" # ← MyST substitution
286286
docsUrl: "{{ docs_url }}" # ← MyST substitution
287287
supportEmail: "{{ support_email }}" # ← MyST substitution
288288

‎docs/admin/installation.md‎

Lines changed: 20 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -77,8 +77,8 @@ Install the latest development version directly from GitHub:
7777

7878
```bash
7979
# Clone the repository
80-
git clone https://github.com/NVIDIA/NeMo-Curator.git
81-
cd NeMo-Curator
80+
git clone https://github.com/NVIDIA-NeMo/Curator.git
81+
cd Curator
8282

8383
# Install uv if not already available
8484
curl -LsSf https://astral.sh/uv/install.sh | sh
@@ -106,8 +106,8 @@ NeMo Curator is available as a standalone container:
106106

107107
```bash
108108
# Build the container locally
109-
git clone https://github.com/NVIDIA/NeMo-Curator.git
110-
cd NeMo-Curator
109+
git clone https://github.com/NVIDIA-NeMo/Curator.git
110+
cd Curator
111111
docker build -t nemo-curator:latest -f docker/Dockerfile .
112112

113113
# Run the container with GPU support
@@ -161,10 +161,13 @@ If encoders are missing, reinstall `FFmpeg` with the required options or use the
161161
:::
162162
::::
163163

164-
### InternVideo2 Support (Optional)
164+
### InternVideo2 Support (Optional for Video)
165165

166-
Video processing includes optional support for InternVideo2. To install InternVideo2, run these commands before installing NeMo Curator:
166+
Video processing includes optional support for InternVideo2. To install InternVideo2, run these commands before installing NeMo Curator based on whether you install via PyPI or from source:
167167

168+
::::{tab-set}
169+
170+
:::{tab-item} PyPI Installation
168171
```bash
169172
# Clone and set up InternVideo2
170173
git clone https://github.com/OpenGVLab/InternVideo.git
@@ -180,6 +183,17 @@ cd ..
180183
uv add InternVideo/InternVideo2/multi_modality
181184
```
182185

186+
:::
187+
188+
:::{tab-item} Source Installation
189+
```bash
190+
# Inside the NeMo Curator folder
191+
bash external/intern_video2_installation.sh
192+
uv add InternVideo/InternVideo2/multi_modality
193+
```
194+
195+
:::
196+
::::
183197

184198
---
185199

‎docs/conf.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@
115115
"company": "NVIDIA",
116116
"version": release,
117117
"current_year": "2025",
118-
"github_repo": "https://github.com/NVIDIA/NeMo-Curator",
118+
"github_repo": "https://github.com/NVIDIA-NeMo/Curator",
119119
"docs_url": "https://docs.nvidia.com/nemo-curator",
120120
"support_email": "nemo-curator-support@nvidia.com",
121121
"min_python_version": "3.8",

‎docs/curate-images/process-data/embeddings/clip-embedder.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -124,5 +124,5 @@ ImageObject(
124124

125125
## Additional Resources
126126

127-
- [Complete Pipeline Example](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
127+
- [Complete Pipeline Example](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
128128
- [OpenAI CLIP Paper](https://arxiv.org/abs/2103.00020)

‎docs/curate-images/process-data/filters/aesthetic.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -126,5 +126,5 @@ results = pipeline.run()
126126

127127
## Resources
128128

129-
- [Image Curation Tutorial](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
130-
- [Complete Pipeline Example](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
129+
- [Image Curation Tutorial](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
130+
- [Complete Pipeline Example](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)

‎docs/curate-images/process-data/filters/nsfw.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -125,5 +125,5 @@ results = pipeline.run()
125125

126126
## Resources
127127

128-
- [Image Curation Tutorial](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
129-
- [Image Deduplication Example](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_dedup_example.py)
128+
- [Image Curation Tutorial](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_curation_example.py)
129+
- [Image Deduplication Example](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_dedup_example.py)

‎docs/curate-images/save-export.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -153,6 +153,6 @@ Each tar file contains JPEG images with sequential or ID-based filenames, while
153153

154154
---
155155

156-
For more details on stage parameters and customization options, see the [ImageWriterStage documentation](process-data/index.md) and the [Complete Tutorial](https://github.com/NVIDIA/NeMo-Curator/blob/main/tutorials/image/getting-started/image_curation_example.py).
156+
For more details on stage parameters and customization options, see the [ImageWriterStage documentation](process-data/index.md) and the [Complete Tutorial](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/image/getting-started/image_curation_example.py).
157157

158158
<!-- More details and examples will be added here. -->

‎docs/curate-images/tutorials/index.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -50,4 +50,4 @@ Image Duplicate Removal Workflow <dedup-workflow>
5050

5151
## Resources
5252

53-
For working Python examples and command-line scripts, refer to the [Tutorials directory](https://github.com/NVIDIA/NeMo-Curator/tree/main/tutorials/image) in the [NeMo Curator GitHub repository](https://github.com/NVIDIA/NeMo-Curator).
53+
For working Python examples and command-line scripts, refer to the [Tutorials directory](https://github.com/NVIDIA-NeMo/Curator/tree/main/tutorials/image) in the [NeMo Curator GitHub repository](https://github.com/NVIDIA-NeMo/Curator).

0 commit comments

Comments
 (0)