ArabDiscrim: A Decade-Long Arabic Facebook Corpus on Racism and Discrimination
Summary
ArabDiscrim is a newly released, decade-long lexical resource and corpus comprising 293,000 public Arabic Facebook posts collected between 2014 and 2024, specifically focusing on discussions of racism and discrimination. Unlike existing datasets primarily derived from Twitter, ArabDiscrim uniquely integrates platform-native engagement signals such as reactions, shares, comments, and page metadata, allowing for a joint analysis of language and audience response. The resource features 200 curated terms, split evenly between racism-related and discrimination-related concepts, each with morphological regex families covering over 13 inflections per lemma. It also delineates 20 distinct discrimination axes and provides explicit attribution patterns. Released under a restricted research-use license, ArabDiscrim supports advanced research in weak supervision, axis-aware sampling, and platform ecology, aiming to build a foundation for fairness-oriented, platform-aware Arabic Natural Language Processing.
Key takeaway
For research scientists developing fairness-oriented Arabic NLP models, ArabDiscrim offers a critical resource to move beyond Twitter-centric data. You should integrate this corpus to analyze discrimination with platform-native engagement signals, enabling more ecologically valid and nuanced understanding of online hate speech. Leverage its 20 discrimination axes and morphological depth for robust model training and evaluation, ensuring your systems are sensitive to diverse forms of identity-based unequal treatment.
Key insights
ArabDiscrim offers a unique, decade-long Arabic Facebook corpus for racism and discrimination research, integrating platform engagement signals.
Principles
- Platform-native engagement signals enhance language analysis.
- Morphological regex families improve lexical resource depth.
- Ethical compliance requires restricted data licenses.
Method
The corpus creation involved curating 200 terms with morphological regex families and identifying 20 discrimination axes from 293K public Arabic Facebook posts (2014-2024).
In practice
- Use for weak supervision in Arabic NLP.
- Enable axis-aware sampling for fairness research.
- Analyze platform ecology and audience response.
Topics
- Arabic NLP
- Discrimination Detection
- Facebook Data
- Corpus Linguistics
- Platform Ecology
- Fairness in AI
Best for: AI Scientist, NLP Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Computation and Language.