ArabDiscrim: A Decade-Long Arabic Facebook Corpus on Racism and Discrimination

· Source: Computation and Language · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Advanced, quick

Summary

ArabDiscrim is a newly released, decade-long lexical resource and corpus comprising 293,000 public Arabic Facebook posts collected between 2014 and 2024, specifically focusing on discussions of racism and discrimination. Unlike existing datasets primarily derived from Twitter, ArabDiscrim uniquely integrates platform-native engagement signals such as reactions, shares, comments, and page metadata, allowing for a joint analysis of language and audience response. The resource features 200 curated terms, split evenly between racism-related and discrimination-related concepts, each with morphological regex families covering over 13 inflections per lemma. It also delineates 20 distinct discrimination axes and provides explicit attribution patterns. Released under a restricted research-use license, ArabDiscrim supports advanced research in weak supervision, axis-aware sampling, and platform ecology, aiming to build a foundation for fairness-oriented, platform-aware Arabic Natural Language Processing.

Key takeaway

For research scientists developing fairness-oriented Arabic NLP models, ArabDiscrim offers a critical resource to move beyond Twitter-centric data. You should integrate this corpus to analyze discrimination with platform-native engagement signals, enabling more ecologically valid and nuanced understanding of online hate speech. Leverage its 20 discrimination axes and morphological depth for robust model training and evaluation, ensuring your systems are sensitive to diverse forms of identity-based unequal treatment.

Key insights

ArabDiscrim offers a unique, decade-long Arabic Facebook corpus for racism and discrimination research, integrating platform engagement signals.

Principles

Method

The corpus creation involved curating 200 terms with morphological regex families and identifying 20 discrimination axes from 293K public Arabic Facebook posts (2014-2024).

In practice

Topics

Best for: AI Scientist, NLP Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computation and Language.