BIPA: Brazilian Portuguese Phonetic Dataset with Dialectal Variations in IPA Standard

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Natural Language Processing · Depth: Intermediate, quick

Summary

BIPA is a new phonetic transcription corpus for Brazilian Portuguese, designed to capture regional dialectal variations. It was automatically extracted from Wiktionary, comprising 53,353 unique words and 350,021 transcriptions in IPA format. The dataset covers six distinct Brazilian dialects: general Brazilian, Rio de Janeiro, São Paulo, South Region, Northeast Region, and Center-West Region, with an average density of 6.56 transcriptions per word. To demonstrate its utility, the ByT5-small model was fine-tuned for grapheme-to-phoneme conversion, achieving a Minimum Phoneme Error Rate of 2.66% on the validation set. BIPA aims to fill a critical gap in computational linguistic resources for Brazilian Portuguese.

Key takeaway

For NLP engineers and research scientists working with Brazilian Portuguese, BIPA offers a vital resource for developing more nuanced speech technologies. Your models can now account for significant regional phonetic variations, improving accuracy in applications like speech synthesis and accent recognition. Consider integrating BIPA to enhance the robustness and regional specificity of your grapheme-to-phoneme conversion systems and sociolinguistic analyses.

Key insights

BIPA is a Brazilian Portuguese phonetic dataset capturing dialectal variations for computational linguistics.

Principles

Method

The corpus was constructed via automated extraction from Wiktionary, then validated by fine-tuning a ByT5-small model for grapheme-to-phoneme conversion.

In practice

Topics

Best for: AI Scientist, NLP Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.