Description
Recent advancements in text-to-speech (TTS) synthesis show that large-scale models trained with extensive web data produce highly natural-sounding output. However, such data is scarce for Indian languages due to the lack of high-quality, manually subtitled data on platforms like LibriVox or YouTube. To address this gap, we enhance existing large-scale ASR datasets containing natural conversations collected in low-quality environments to generate high-quality TTS training data. Our pipeline leverages the cross-lingual generalization of denoising and speech enhancement models trained on English and applied to Indian languages. This results in IndicVoices-R (IV-R), the largest multilingual Indian TTS dataset derived from an ASR dataset, with 1,704 hours of high-quality speech from 10,496 speakers across 22 Indian languages. IV-R matches the quality of gold-standard TTS datasets like LJSpeech, LibriTTS, and IndicTTS. We also introduce the IV-R Benchmark, the first to assess zero-shot, few-shot, and many-shot speaker generalization capabilities of TTS models on Indian voices, ensuring diversity in age, gender, and style. We demonstrate that fine-tuning an English pre-trained model on a combined dataset of high-quality IndicTTS and our IV-R dataset results in better zero-shot speaker generalization compared to fine-tuning on the IndicTTS dataset alone. Further, our evaluation reveals limited zero-shot generalization for Indian voices in TTS models trained on prior datasets, which we improve by fine-tuning the model on our data containing diverse set of speakers across language families. We open-source all data and code, building the first TTS model for all 22 official Indian languages.
Audio Samples
Language
Assamese
Gujarati
.
Kannada
Konkani
.
Malayalam
Manipuri
Marathi
.
Odia
Punjabi
Sanskrit
Sindhi
IndicVoices
IndicVoices-R
Downloads
| LANGUAGE | DOWNLOAD LINK | SIZE |
|---|---|---|
| Assamese | Link | 83.53 GB |
| Bengali | Link | 57.33 GB |
| Bodo | Link | 79.62 GB |
| Dogri | Link | 34.71 GB |
| Gujarati | Link | 4.39 GB |
| Hindi | Link | 37.40 GB |
| Kannada | Link | 21.72 GB |
| Kashmiri | Link | 30.36 GB |
| Konkani | Link | 25.88 GB |
| Maithili | Link | 41.64 GB |
| Malayalam | Link | 40.73 GB |
| Marathi | Link | 25.22 GB |
| Manipuri | Link | 11.15 GB |
| Nepali | Link | 50.20 GB |
| Odia | Link | 35.03 GB |
| Punjabi | Link | 36.89 GB |
| Sanskrit | Link | 17.16 GB |
| Santali | Link | 29.11 GB |
| Sindhi | Link | 5.28 GB |
| Tamil | Link | 49.38 GB |
| Telugu | Link | 66.91 GB |
| Urdu | Link | 38.80 GB |
Statistics
| # Hours | # Utterances | # Speakers | |
|---|---|---|---|
| Assamese | 175.34 | 73077 | 928 |
| Bengali | 111.99 | 40943 | 617 |
| Bodo | 172.05 | 83976 | 941 |
| Dogri * | 70.68 | 27967 | 470 |
| Gujarati | 8.94 | 3304 | 45 |
| Hindi | 74.60 | 27557 | 399 |
| Kannada | 44.61 | 18127 | 452 |
| Kashmiri * | 64.99 | 26134 | 450 |
| Konkani | 53.06 | 22357 | 228 |
| Maithili * | 81.77 | 32483 | 627 |
| Malayalam | 82.57 | 32544 | 462 |
| Manipuri | 23.99 | 9312 | 127 |
| Marathi | 50.90 | 20164 | 359 |
| Nepali * | 105.87 | 43545 | 716 |
| Odia | 70.95 | 26450 | 441 |
| Punjabi | 74.94 | 27788 | 335 |
| Sanskrit * | 35.75 | 14604 | 161 |
| Santali * | 76.37 | 35155 | 309 |
| Sindhi * | 10.48 | 4197 | 204 |
| Tamil | 99.47 | 40464 | 1084 |
| Telugu | 136.40 | 48485 | 681 |
| Urdu * | 78.61 | 30935 | 460 |
| Total | 1,704.34 | 689568 | 10496 |
License
CC-By-4.0
Acknowledgements
We thank Digital India Bhashini, the Ministry of Electronics and Information Technology of the Government of India, Centre for Development of Advanced Computing Pune, EkStep Foundation and Nilekani Philanthropies for their generous grants and support. We also thank the entire team at AI4Bharat.