ArabDiscrim: A Decade-Long Arabic Facebook Corpus on Racism and Discrimination

· Source: cs.CL updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

ArabDiscrim is a newly released lexical resource and corpus comprising 293,000 public Arabic Facebook posts collected between 2014 and 2024, specifically focusing on discussions of racism and discrimination. Unlike existing datasets primarily derived from Twitter, ArabDiscrim uniquely incorporates platform-native engagement signals such as reactions, shares, comments, and page metadata, enabling a joint analysis of language and audience response. The resource features 200 curated terms—100 related to racism and 100 to discrimination—each with morphological regex families covering over 13 inflections per lemma. It also delineates 20 distinct discrimination axes and provides explicit attribution patterns. Released under a restricted research-use license, ArabDiscrim is designed to support weak supervision, axis-aware sampling, and platform ecology research, establishing a crucial foundation for fairness-oriented, platform-aware Arabic Natural Language Processing.

Key takeaway

For NLP Engineers developing fairness-aware systems for Arabic, ArabDiscrim offers a critical resource to improve model robustness. You should integrate this corpus to train and evaluate models for racism and discrimination detection, leveraging its unique platform engagement signals and 20 discrimination axes. This approach will enhance your system's ecological validity and ethical compliance, moving beyond Twitter-centric biases.

Key insights

ArabDiscrim bridges lexical depth and ecological validity for fairness-oriented, platform-aware Arabic NLP.

Principles

Method

A corpus of 293K Arabic Facebook posts (2014-2024) was built, integrating engagement signals, 200 curated terms with morphological regex, and 20 discrimination axes.

In practice

Topics

Best for: Research Scientist, AI Scientist, NLP Engineer, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CL updates on arXiv.org.