Tralaleros at SemEval-2026 Task 9: Multilingual Polarization Detection with Transformer-based Models
Summary
A multilingual polarization detection system was developed for SemEval-2026 Task 9 (Subtask 1), supporting 22 languages using transformer-based models. Researchers evaluated four strategies: data rebalancing, hyperparameter optimization, model scaling, and ensembling. Findings indicate that undersampling data negatively impacts performance, whereas employing larger pretrained models substantially improves results. The top-performing single model, XLM-RoBERTa Large, achieved a Macro-F1 score of 0.7929. Analysis revealed complementary strengths among model families, with RemBERT excelling in Indic languages and mDeBERTa performing well for Semitic and morphologically rich languages. Ensemble methods provided only marginal gains, suggesting language-aware routing is a more effective approach. The system also includes a privacy-preserving Firefox extension for local ONNX inference, enabling practical deployment without sending user text to external servers.
Key takeaway
For NLP Engineers developing multilingual text analysis systems, prioritize larger pretrained transformer models like XLM-RoBERTa Large over data undersampling for improved polarization detection. While ensembling offers limited benefits, consider language-aware routing to leverage models like RemBERT for Indic languages or mDeBERTa for Semitic languages. Additionally, explore local ONNX inference for privacy-preserving deployment, enabling client-side text analysis without external server communication.
Key insights
Larger transformer models significantly improve multilingual polarization detection, with specific models excelling in different language families.
Principles
- Undersampling data harms model performance.
- Larger pretrained models yield substantial improvements.
- Language-aware routing is more effective than uniform ensembling.
Method
The system evaluates data rebalancing, hyperparameter optimization, model scaling, and ensembling strategies for multilingual polarization detection across 22 languages, deploying local ONNX inference.
In practice
- Deploy local ONNX inference for privacy-preserving text analysis.
- Consider XLM-RoBERTa Large for high Macro-F1 scores.
- Route specific languages to specialized models like RemBERT or mDeBERTa.
Topics
- Multilingual NLP
- Polarization Detection
- Transformer Models
- XLM-RoBERTa
- ONNX Inference
- Privacy-Preserving AI
- SemEval
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, NLP Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.