NVIDIA and AI4Bharat Release 2.8 Trillion-Token Indian-Language Pretraining Corpus
Understand the story
On October 16, 2026, the Hugging Face Blog reported that NVIDIA and AI4Bharat at IIT Madras jointly launched Nemotron-pretraining-Indic-v1, a pretraining corpus for Indian languages totaling about 2.8 trillion tokens and covering the 22 languages listed in the Indian Constitution. According to Gemma-4 tokenizer counts, it contains 2,601.0B natural-text tokens and 224.6B romanized tokens. The corpus will be released together with an open-source, GPU-accelerated data generation pipeline; at the time of the report it was "coming soon". This is a single report on the event, with no follow-up developments or contradictions with earlier reports so far.
AI overview of reporting · Updated 2 days ago
Reporting timeline
Explore different aspects of the story through its reporting.
- Hugging Face BlogScaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
NVIDIA and IIT Madras's AI4Bharat released the Nemotron-pretraining-Indic-v1 pretraining corpus, roughly 2.8 trillion tokens covering all 22 scheduled languages of India, with 2,601.0B natural-script tokens and 224.6B romanized tokens (Gemma-4 tokenizer statistics); it will soon ship alongside an open-source, GPU-accelerated data generation pipeline.
Story heat trend
Current heat3·Comparable peak10（10/16 10:00）·Comparable change over 24 hours -49%
The trend compares the same continuously observed sources, which may cover fewer sources than the current heat score. Hover or select the chart to inspect each hour; use the left and right arrow keys to navigate.