mdok-style at SemEval-2026 Task 10: Finetuning LLMs for Conspiracy Detection

2026-06-25 · Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

The "mdok-style" system, submitted to SemEval-2026 Task 10, focuses on detecting conspiracy beliefs expressed in Reddit comments. This system finetunes the Qwen3-32B large language model for a binary text-classification task. To address the challenge of a rather small amount of training data, the approach employs both data augmentation and self-training techniques. The mdok-style system achieved a highly competitive performance in the SemEval competition, ranking 8th out of 52 submissions and placing it in the 85th percentile. These results confirm that the underlying methodology, initially developed for machine-generated text detection, can be successfully adapted and applied to the distinct domain of conspiracy detection.

Key takeaway

For NLP Engineers developing text classification systems with limited labeled data, consider adopting data augmentation and self-training techniques. Your team can effectively finetune large language models like Qwen3-32B for specific tasks, even when initial datasets are small. This approach, proven in conspiracy detection, offers a robust strategy to achieve competitive performance and adapt existing LLM methodologies to new domains.

Key insights

Data augmentation and self-training effectively adapt LLMs for new text classification tasks with limited data.

Principles

• Small datasets benefit from augmentation.
• Self-training enhances model performance.
• LLM finetuning is task-transferable.

Method

The system finetunes Qwen3-32B using data augmentation and self-training for binary text classification, specifically for conspiracy detection in Reddit comments.

In practice

• Apply data augmentation for scarce data.
• Use self-training to boost LLM finetuning.
• Adapt LLM methods across text tasks.

Topics

• Conspiracy Detection
• Large Language Models
• LLM Finetuning
• Data Augmentation
• Self-training
• SemEval-2026 Task 10
• Qwen3-32B

Best for: Research Scientist, AI Scientist, NLP Engineer

Related on AIssential

• mdok-style at SemEval-2026 Task 10: Finetuning LLMs for Conspiracy Detection — Data augmentation and self-training can effectively finetune LLMs for specialized text classification tasks with limited data.
• Build an LLM from Scratch 6: Finetuning for Classification — Fine-tuning pre-trained LLMs for specific classification tasks is efficient and effective, even with smaller models.
• Label-Aware Pseudo-Training Sample Generation for Text Classification — A new data augmentation method uses LLMs to subtly alter sentences, improving NLP performance with limited data.
• Fact4ac at the Financial Misinformation Detection Challenge Task: Reference-Free Financial Misinformation Detection via Fine-Tuning and Few-Shot Prompting of Large Language Models — Detecting financial misinformation without external references is achievable using LLMs combined with specific fine-tuning.
• Addressing Data Scarcity in Bangla Fake News Detection: An LLM-Based Dataset Augmentation Approach — LLM-based data augmentation significantly improves fake news detection in low-resource languages by generating diverse synthetic data.
• Comparing LLM and Fine-Tuned Model Performance on NVDRS Circumstance Extraction with Varying Prompt Complexity — LLMs, guided by a context-aware "Complexity Score" for prompt selection, significantly outperform fine-tuned models on inferentially complex, low-prevalence data extraction.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.