100,000+ Movie Reviews from Kazakhstan: Russian, Kazakh, and Code-Switched Texts

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, short

Summary

A new publicly available corpus of 100,502 movie reviews from Kazakhstan, collected from kino.kz and spanning 2001–2025, covers 4,943 unique film titles. This multilingual dataset primarily features Russian reviews, alongside Kazakh and code-switched texts. Reviews are manually annotated for language and sentiment polarity, with 11,309 also including explicit user-provided ratings. Researchers defined two sentiment tasks: three-way polarity classification and five-class score classification. Benchmarking compared classical BoW/TF–IDF baselines against multilingual transformer models like mBERT, XLM-RoBERTa, and RemBERT. Experimental results indicate that transformer models consistently outperform classical baselines on polarity classification. However, score classification remains challenging under leakage-controlled evaluation due primarily to severe class imbalance and subtle distinctions between adjacent rating levels.

Key takeaway

For NLP engineers developing sentiment analysis models for diverse language data, especially those involving code-switching, you should consider the new Kazakhstani movie review corpus. This dataset offers a valuable resource for training and evaluating multilingual models on Russian, Kazakh, and code-switched texts. Use transformer models for robust polarity classification, but be prepared to implement advanced techniques to mitigate class imbalance and subtle distinctions when tackling fine-grained score prediction.

Key insights

This new multilingual Kazakhstani movie review corpus enables sentiment analysis research, highlighting transformer efficacy for polarity but challenges for fine-grained score classification.

Principles

Method

The method involves collecting 100,502 reviews, manual annotation for language and sentiment, defining two sentiment tasks (polarity and score), and benchmarking classical BoW/TF–IDF against mBERT, XLM-RoBERTa, and RemBERT models.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, NLP Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.