The Internet is 50% Fake. I Built a Detector.

· Source: Siraj Raval · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Emerging Technologies & Innovation · Depth: Intermediate, medium

Summary

Suriraj, in collaboration with Juny AI, developed an open-source Chrome extension called "AI Slop Detector" or "Slop Shield" designed to identify and score "slop"—defined as low information density content characterized by high predictability and a deficit of verifiable claims. The initial version, built in approximately 4 minutes and 30 seconds using Juny AI within the JetBrains IntelliJ IDE, relied on heuristics to detect issues like low lexical variety and repeated phrases. Recognizing its limitations with complex content like research papers, the detector was improved to incorporate a local 7-billion parameter AI model, specifically a quantized Qwen model running on 4GB of VRAM via Olama. This enhanced version uses a "constitutional judge" system prompt to encode values like falsifiability and epistemic modesty, providing a more accurate and private slop score by leveraging local AI judgment.

Key takeaway

For AI Engineers and developers concerned about content quality and information overload, building your own AI-powered content filters, like the Slop Shield, offers a robust defense. You can leverage AI agents for rapid prototyping and integrate local, quantized LLMs to ensure privacy and custom judgment. This approach allows you to tailor content verification to specific needs, moving beyond generic heuristics to a more nuanced, value-driven assessment of information density.

Key insights

Low information density, or "slop," can be programmatically detected using a combination of heuristics and local AI models.

Principles

Method

Build a Chrome extension using an AI agent (Juny AI) to generate code. Start with heuristics, then integrate a local 7B parameter quantized LLM (e.g., Qwen via Olama) with a constitutional system prompt to refine slop detection.

In practice

Topics

Best for: AI Engineer, Machine Learning Engineer, Software Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Siraj Raval.