RACAI at #SMM4H-HeaRD: Named Entity Recognition for Detecting the Impacts of Drug Abuse in Social Media Posts: Zero-Shot and Fine-Tuning Approaches

2026-06-25 · Source: Paper Index on ACL Anthology · Field: Science & Research — Health & Medical Research, Mathematics & Computational Sciences, Research Methodology & Innovation · Depth: Advanced, short

Summary

RACAI addressed the detection of drug abuse repercussions in Reddit posts as part of SMM4H-HeaRD Task 7, which focuses on extracting social and clinical impacts of substance use from social media. The team evaluated multiple deep learning architectures, employing both fine-tuning and zero-shot inference. Their best result was obtained using an adapter-based fine-tuning approach on the DeBERTaV3 model. Furthermore, the research explored text-based evolutionary optimization for Gemma 4 workflows, demonstrating that these methods achieved competitive performance compared to the supervised DeBERTaV3 setup for this specific Named Entity Recognition task. This work was presented at the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop.

Key takeaway

For NLP Engineers working on public health surveillance from social media, consider integrating adapter-based fine-tuning with models like DeBERTaV3 for robust Named Entity Recognition. You should also explore text-based evolutionary optimization with Gemma 4, as it offers a competitive alternative, potentially reducing annotation efforts while maintaining high performance in identifying drug abuse impacts. This approach can enhance early detection systems.

Key insights

Named Entity Recognition effectively detects drug abuse impacts in social media using advanced deep learning.

Principles

• Adapter-based fine-tuning on large language models can yield strong results for specific NER tasks.
• Text-based evolutionary optimization offers competitive performance against supervised fine-tuning.

Method

The proposed method involves adapter-based fine-tuning on the DeBERTaV3 model and text-based evolutionary optimization for Gemma 4 workflows to extract social and clinical impacts of substance use.

In practice

• Apply adapter-based fine-tuning to DeBERTaV3 for social media health NER.
• Investigate text-based evolutionary optimization with Gemma 4 for similar tasks.

Topics

• Named Entity Recognition
• Drug Abuse Detection
• Social Media Mining
• DeBERTaV3
• Gemma 4
• Fine-tuning
• Evolutionary Optimization

Best for: AI Scientist, Research Scientist, NLP Engineer

Related on AIssential

• The application of natural language processing for the extraction of mechanistic information in toxicology — spaCy with scispaCy enables robust NER for extracting mechanistic toxicology data from scientific literature.
• Zero- and Few-Shot Named-Entity Recognition: Case Study and Dataset in the Crime Domain (CrimeNER) — CrimeNER provides a specialized dataset and case study for zero- and few-shot NER in the crime domain.
• Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest — Modern LLMs demonstrate varied capabilities across social media analytics tasks, with GPT-4 excelling in authorship verification and Gemini in attribute inference.
• MentalMARBERT: Domain-Adaptive Pre-training and Two-Stage Fine-Tuning for Arabic Mental Health Disorders Detection — Domain-adaptive pre-training and hierarchical classification significantly improve Arabic mental health disorder detection.
• Introducing Span Categorization in Prodigy and spaCy — Span Categorization (spancat) in spaCy extracts and classifies long, overlapping text spans, providing explicit control and confidence scores.
• Rethinking Negative Sampling for Knowledge Distillation in Retrieval, A Distillation Recipe for Small Language Model Search Agents, and More! — Effective information retrieval advancements often stem from rethinking fundamental assumptions and optimizing data representation or model behavior.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.