NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation Pipeline
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
What happened
NVIDIA and AI4Bharat at IIT Madras introduce Nemotron-pretraining-Indic-v1, approximately 2.8 trillion tokens across 22 Indian languages, releasing soon alongside its open, GPU-accelerated generation pipeline. The corpus includes native-script text for all 22 languages and romanized text for twelve, translated from curated English sources with quality checks and source tracing. An Indic continued-pretraining stage improved five reported benchmarks, but combined synthetic and natural data, so the comparison does not isolate this corpus’s contribution.
Why it matters
The workflow offers a reusable approach to multilingual data generation by separating translation, quality assessment, repair, and script conversion while preserving links to source documents.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights