There was an error while loading. Please reload this page.
1 parent 2c4eb4a commit 7be05f7Copy full SHA for 7be05f7
1 file changed
src/nemotron/recipes/data_curation/nemotron-cc/README.md
@@ -4,7 +4,7 @@ This directory contains the recipe for curating datasets similar to the [Nemotro
4
5
### Requirements
6
7
-- [NeMo Curator](https://github.com/NVIDIA/NeMo-Curator) > 1.1.0 (install from main)
+- [NeMo Curator](https://github.com/NVIDIA/NeMo-Curator) > 1.1.0 ([install from main](https://docs.nvidia.com/nemo/curator/latest/admin/installation.html))
8
- GPU(s) for steps 2a, 2b, and 3 (deduplication and classification)
9
- [Cargo/Rust](https://doc.rust-lang.org/cargo/getting-started/installation.html) for step 2c (building `deduplicate-text-datasets`)
10
- Access to an OpenAI-compatible LLM endpoint for step 4 (NVIDIA NIM, vLLM, or cloud API)
0 commit comments