Towards Sense-level Bilingual Dictionary Induction
Summary
A novel NLP task, Sense-Level Bilingual Dictionary Induction (SenseBDI), is introduced to automate the discovery of new bilingual sense entries, addressing the current manual, time-consuming, and subjective process of updating bilingual dictionaries. Existing methods like Word-level Bilingual Dictionary Induction and cross-lingual embedding alignment fail to account for polysemy or lexicographic data. The researchers constructed a time-stamped sense-level bilingual dictionary dataset by aligning two bilingual dictionaries, two monolingual dictionaries, and BabelNet, enriching bilingual entries with source-language details. Their proposed baseline, utilizing nearest-neighbor search over cross-lingual embeddings of glosses and usages, revealed that usages contribute more significantly than glosses, with performance varying across language pairs. The work also highlights challenges related to target language polysemy.
Key takeaway
For NLP Engineers developing cross-lingual lexical resources, this work suggests a shift towards sense-level induction to overcome polysemy limitations in traditional methods. You should prioritize integrating usage examples over mere glosses when building cross-lingual embeddings for sense alignment, as they offer stronger contributions. Consider the significant variation across language pairs, necessitating tailored approaches for optimal performance in real-world dictionary updates.
Key insights
Automating sense-level bilingual dictionary induction addresses polysemy gaps in lexicography using cross-lingual embeddings of usages and glosses.
Principles
- Bilingual dictionaries often lack completeness and diachronic information.
- Polysemy is a critical challenge for cross-lingual lexical tasks.
- Usages are more impactful than glosses for sense alignment.
Method
Construct a dataset by aligning two bilingual, two monolingual dictionaries, and BabelNet. Apply nearest-neighbor search on cross-lingual embeddings of glosses and usages.
In practice
- Enrich bilingual entries with monolingual source-language data.
- Prioritize usage examples over glosses for sense alignment.
- Consider language-pair specific variations in embedding performance.
Topics
- Sense-Level Bilingual Dictionary Induction
- Cross-lingual Embeddings
- Lexical Semantics
- Polysemy
- Bilingual Dictionaries
- BabelNet
Best for: Research Scientist, AI Scientist, NLP Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.