100,000+ Movie Reviews from Kazakhstan: Russian, Kazakh, and Code-Switched Texts
Summary
A new publicly available corpus of 100,502 movie reviews from Kazakhstan, collected from kino.kz and spanning 2001–2025, covers 4,943 unique film titles. This multilingual dataset primarily features Russian reviews, alongside Kazakh and code-switched texts. Reviews are manually annotated for language and sentiment polarity, with 11,309 also including explicit user-provided ratings. Researchers defined two sentiment tasks: three-way polarity classification and five-class score classification. Benchmarking compared classical BoW/TF–IDF baselines against multilingual transformer models like mBERT, XLM-RoBERTa, and RemBERT. Experimental results indicate that transformer models consistently outperform classical baselines on polarity classification. However, score classification remains challenging under leakage-controlled evaluation due primarily to severe class imbalance and subtle distinctions between adjacent rating levels.
Key takeaway
For NLP engineers developing sentiment analysis models for diverse language data, especially those involving code-switching, you should consider the new Kazakhstani movie review corpus. This dataset offers a valuable resource for training and evaluating multilingual models on Russian, Kazakh, and code-switched texts. Use transformer models for robust polarity classification, but be prepared to implement advanced techniques to mitigate class imbalance and subtle distinctions when tackling fine-grained score prediction.
Key insights
This new multilingual Kazakhstani movie review corpus enables sentiment analysis research, highlighting transformer efficacy for polarity but challenges for fine-grained score classification.
Principles
- Multilingual transformers excel in polarity classification.
- Fine-grained score classification is difficult with imbalance.
- Code-switched text presents unique NLP challenges.
Method
The method involves collecting 100,502 reviews, manual annotation for language and sentiment, defining two sentiment tasks (polarity and score), and benchmarking classical BoW/TF–IDF against mBERT, XLM-RoBERTa, and RemBERT models.
In practice
- Utilize mBERT, XLM-RoBERTa, or RemBERT for polarity.
- Address class imbalance in score classification.
- Explore code-switching in multilingual NLP.
Topics
- Movie Reviews
- Sentiment Analysis
- Multilingual NLP
- Code-Switching
- Kazakh Language
- Transformer Models
- Dataset Creation
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, NLP Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.