Building Community-Centred NLP Resources for Puno Quechua

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Advanced, quick

Summary

New ASR resources have been developed for Puno Quechua (ISO 639-3: qxp), marking the first dedicated effort for this under-resourced language. This initiative produced the largest speech corpus for any single Quechua variety, comprising 66 hours of recordings, including 36 hours of manually transcribed and validated data. The data collection employed a participatory design campaign, ensuring community involvement. Additionally, the project established the first systematic ASR benchmark for Puno Quechua, evaluating state-of-the-art models such as Whisper-base, wav2vec2-base, and XLS-R-300M. These models were fine-tuned both with and without continued pre-training (CPT). All developed datasets and fine-tuned models are openly released to support further research and preservation efforts.

Key takeaway

For NLP Engineers or AI Scientists developing resources for other under-resourced languages, you should prioritize community-centered participatory design for data collection to ensure relevance and quality. Consider fine-tuning established models like Whisper-base or wav2vec2-base, evaluating the impact of continued pre-training. Crucially, openly releasing your datasets and fine-tuned models will significantly contribute to broader language preservation efforts and accelerate future research.

Key insights

Building NLP resources for under-resourced languages benefits significantly from community-centered participatory design and open data release.

Principles

Method

Speech data was collected via a participatory design campaign, manually transcribed, and validated. ASR models like Whisper-base, wav2vec2-base, and XLS-R-300M were fine-tuned with and without continued pre-training, then benchmarked.

In practice

Topics

Best for: Research Scientist, AI Scientist, NLP Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.