Building Community-Centred NLP Resources for Puno Quechua
Summary
New ASR resources have been developed for Puno Quechua (ISO 639-3: qxp), marking the first dedicated effort for this under-resourced language. This initiative produced the largest speech corpus for any single Quechua variety, comprising 66 hours of recordings, including 36 hours of manually transcribed and validated data. The data collection employed a participatory design campaign, ensuring community involvement. Additionally, the project established the first systematic ASR benchmark for Puno Quechua, evaluating state-of-the-art models such as Whisper-base, wav2vec2-base, and XLS-R-300M. These models were fine-tuned both with and without continued pre-training (CPT). All developed datasets and fine-tuned models are openly released to support further research and preservation efforts.
Key takeaway
For NLP Engineers or AI Scientists developing resources for other under-resourced languages, you should prioritize community-centered participatory design for data collection to ensure relevance and quality. Consider fine-tuning established models like Whisper-base or wav2vec2-base, evaluating the impact of continued pre-training. Crucially, openly releasing your datasets and fine-tuned models will significantly contribute to broader language preservation efforts and accelerate future research.
Key insights
Building NLP resources for under-resourced languages benefits significantly from community-centered participatory design and open data release.
Principles
- Participatory design is key for under-resourced language NLP.
- Openly releasing datasets and models aids preservation.
- Systematic benchmarking validates ASR model performance.
Method
Speech data was collected via a participatory design campaign, manually transcribed, and validated. ASR models like Whisper-base, wav2vec2-base, and XLS-R-300M were fine-tuned with and without continued pre-training, then benchmarked.
In practice
- Implement participatory design for data collection.
- Fine-tune Whisper-base or wav2vec2-base for ASR.
- Evaluate continued pre-training for performance gains.
Topics
- Puno Quechua
- Automatic Speech Recognition
- Low-Resource Languages
- Participatory Design
- Speech Corpora
- Whisper Model
- wav2vec2
Best for: Research Scientist, AI Scientist, NLP Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.