ArabDiscrim: A Decade-Long Arabic Facebook Corpus on Racism and Discrimination
Summary
ArabDiscrim is a newly released lexical resource and corpus comprising 293,000 public Arabic Facebook posts collected between 2014 and 2024, specifically focusing on discussions of racism and discrimination. Unlike existing datasets primarily derived from Twitter, ArabDiscrim uniquely incorporates platform-native engagement signals such as reactions, shares, comments, and page metadata, enabling a joint analysis of language and audience response. The resource features 200 curated terms—100 related to racism and 100 to discrimination—each with morphological regex families covering over 13 inflections per lemma. It also delineates 20 distinct discrimination axes and provides explicit attribution patterns. Released under a restricted research-use license, ArabDiscrim is designed to support weak supervision, axis-aware sampling, and platform ecology research, establishing a crucial foundation for fairness-oriented, platform-aware Arabic Natural Language Processing.
Key takeaway
For NLP Engineers developing fairness-aware systems for Arabic, ArabDiscrim offers a critical resource to improve model robustness. You should integrate this corpus to train and evaluate models for racism and discrimination detection, leveraging its unique platform engagement signals and 20 discrimination axes. This approach will enhance your system's ecological validity and ethical compliance, moving beyond Twitter-centric biases.
Key insights
ArabDiscrim bridges lexical depth and ecological validity for fairness-oriented, platform-aware Arabic NLP.
Principles
- Platform-native engagement signals enrich language analysis.
- Morphological regex families enhance lexical resource coverage.
- Ethical compliance guides corpus development and release.
Method
A corpus of 293K Arabic Facebook posts (2014-2024) was built, integrating engagement signals, 200 curated terms with morphological regex, and 20 discrimination axes.
In practice
- Employ ArabDiscrim for weak supervision.
- Conduct axis-aware sampling for fairness models.
- Analyze platform ecology via language and audience response.
Topics
- ArabDiscrim
- Arabic NLP
- Racism Detection
- Discrimination Analysis
- Social Media Data
- Corpus Development
Best for: Research Scientist, AI Scientist, NLP Engineer, AI Ethicist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CL updates on arXiv.org.