From Form to Meaning: Interlingua Sense-Alignment of Offensive Language with LLMs
Summary
A methodology utilizing Large Language Models (LLMs) is presented for aligning multilingual offensive lexicons at the sense level. This approach directly aligns lexicons from Arabic, Bulgarian, Modern Greek, French, and Italian, bypassing the need to pivot through English. The Modern Greek lexicon was LLM-generated, while the other four are WordNet-compatible. An "LLM-as-a-judge" rubric, applied to lemma–definition–example triples, facilitated inter-language sense alignment. The LLM performed 2.87M pairwise comparisons, yielding 31 strict global-sense categories. The work also addresses challenges in sense alignment tasks, providing a valuable resource for downstream applications like Machine Translation and cross-lingual hate-speech detection.
Key takeaway
For NLP Engineers developing cross-lingual applications, this methodology offers a direct path to align offensive language lexicons. You can bypass English-centric pivoting, improving accuracy and cultural nuance in systems like hate-speech detection and machine translation. Consider adopting an LLM-as-a-judge approach for sense alignment to build more robust and culturally sensitive multilingual resources.
Key insights
LLMs can directly align multilingual offensive lexicons at the sense level without English pivoting.
Principles
- Direct inter-language alignment avoids English pivot bias.
- LLMs can serve as judges for sense alignment tasks.
- Sense-level alignment is crucial for offensive language.
Method
An LLM-as-a-judge rubric evaluates lemma–definition–example triples for 2.87M pairwise comparisons, yielding 31 global-sense categories across five languages.
In practice
- Supports cross-lingual hate-speech detection.
- Enhances Machine Translation quality.
- Generates lexicons for low-resource languages.
Topics
- Offensive Language Detection
- Multilingual Lexicons
- Large Language Models
- Sense Alignment
- Cross-lingual NLP
- Hate Speech Detection
Best for: Research Scientist, AI Scientist, NLP Engineer, AI Ethicist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.