Bridging Cultural Gaps in Automated Translation of Brazilian Expressions: A Study on Cultural Adaptation

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

A study evaluated the cultural adaptation capabilities of automated translation systems, specifically ChatGPT-4o, Gemini 1.5 Pro, and Google Translate, when processing non-literal Brazilian Portuguese expressions. Researchers used a corpus of 100 contemporary Brazilian Portuguese expressions, validated via the *Corpus Carolina* and categorized into classical idioms, regionalisms, metaphors, and intensifiers. Translation quality was assessed using the Multidimensional Quality Metrics (MQM) framework, focusing on adequacy, fluency, and cultural adaptation. The analysis revealed that despite achieving grammatical accuracy, these systems frequently failed to capture the socio-cultural nuances embedded in the source language, leading to significant semantic shifts. This highlights the limitations of current AI systems in cultural competence and emphasizes the continued need for human intervention in high-stakes professional communication.

Key takeaway

For NLP Engineers developing or deploying translation solutions for culturally rich languages, recognize that current LLMs like ChatGPT-4o and Gemini 1.5 Pro still exhibit significant limitations in cultural adaptation. Your systems will require robust human post-editing or specialized cultural adaptation modules to prevent pragmatic errors, especially in professional communication where nuanced meaning is critical. Prioritize human-in-the-loop workflows for non-literal language translation.

Key insights

Automated translation systems struggle with cultural adaptation, even with advanced LLMs, requiring human oversight.

Principles

Method

Evaluated ChatGPT-4o, Gemini 1.5 Pro, and Google Translate using a 100-expression Brazilian Portuguese corpus, categorized into idioms, regionalisms, metaphors, and intensifiers, assessed via MQM framework.

In practice

Topics

Best for: AI Scientist, NLP Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.