Towards Sense-level Bilingual Dictionary Induction

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Natural Language Processing · Depth: Expert, quick

Summary

A novel NLP task, Sense-Level Bilingual Dictionary Induction (SenseBDI), is introduced to automate the discovery of new bilingual sense entries, addressing the current manual, time-consuming, and subjective process of updating bilingual dictionaries. Existing methods like Word-level Bilingual Dictionary Induction and cross-lingual embedding alignment fail to account for polysemy or lexicographic data. The researchers constructed a time-stamped sense-level bilingual dictionary dataset by aligning two bilingual dictionaries, two monolingual dictionaries, and BabelNet, enriching bilingual entries with source-language details. Their proposed baseline, utilizing nearest-neighbor search over cross-lingual embeddings of glosses and usages, revealed that usages contribute more significantly than glosses, with performance varying across language pairs. The work also highlights challenges related to target language polysemy.

Key takeaway

For NLP Engineers developing cross-lingual lexical resources, this work suggests a shift towards sense-level induction to overcome polysemy limitations in traditional methods. You should prioritize integrating usage examples over mere glosses when building cross-lingual embeddings for sense alignment, as they offer stronger contributions. Consider the significant variation across language pairs, necessitating tailored approaches for optimal performance in real-world dictionary updates.

Key insights

Automating sense-level bilingual dictionary induction addresses polysemy gaps in lexicography using cross-lingual embeddings of usages and glosses.

Principles

Method

Construct a dataset by aligning two bilingual, two monolingual dictionaries, and BabelNet. Apply nearest-neighbor search on cross-lingual embeddings of glosses and usages.

In practice

Topics

Best for: Research Scientist, AI Scientist, NLP Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.