From Form to Meaning: Interlingua Sense-Alignment of Offensive Language with LLMs

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Natural Language Processing · Depth: Expert, short

Summary

A methodology utilizing Large Language Models (LLMs) is presented for aligning multilingual offensive lexicons at the sense level. This approach directly aligns lexicons from Arabic, Bulgarian, Modern Greek, French, and Italian, bypassing the need to pivot through English. The Modern Greek lexicon was LLM-generated, while the other four are WordNet-compatible. An "LLM-as-a-judge" rubric, applied to lemma–definition–example triples, facilitated inter-language sense alignment. The LLM performed 2.87M pairwise comparisons, yielding 31 strict global-sense categories. The work also addresses challenges in sense alignment tasks, providing a valuable resource for downstream applications like Machine Translation and cross-lingual hate-speech detection.

Key takeaway

For NLP Engineers developing cross-lingual applications, this methodology offers a direct path to align offensive language lexicons. You can bypass English-centric pivoting, improving accuracy and cultural nuance in systems like hate-speech detection and machine translation. Consider adopting an LLM-as-a-judge approach for sense alignment to build more robust and culturally sensitive multilingual resources.

Key insights

LLMs can directly align multilingual offensive lexicons at the sense level without English pivoting.

Principles

Method

An LLM-as-a-judge rubric evaluates lemma–definition–example triples for 2.87M pairwise comparisons, yielding 31 global-sense categories across five languages.

In practice

Topics

Best for: Research Scientist, AI Scientist, NLP Engineer, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.