NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation Pipeline
NVIDIA and AI4Bharat at IIT Madras introduce Nemotron-pretraining-Indic-v1, approximately 2.8 trillion tokens across 22 Indian languages, releasing soon alongside its open, GPU-accelerated generation pipeline. The corpus includes native-script text for all 22 languages and romanized text for twelve, translated from curated English sources with quality checks and source tracing. An Indic continued-pretraining stage improved five reported benchmarks, but combined synthetic and natural data, so the comparison does not isolate this corpus’s contribution.
Why it matters: The workflow offers a reusable approach to multilingual data generation by separating translation, quality assessment, repair, and script conversion while preserving links to source documents.

