LiZAD: A Lightweight Zero-Shot Anomaly Detection Framework for Industrial Manufacturing
Summary
LiZAD is a lightweight Zero-Shot Anomaly Detection (ZSAD) framework designed for real-time deployment on resource-constrained edge devices in industrial manufacturing. It addresses the impracticality of data collection and annotation for frequently changing product configurations. LiZAD combines DINOv3's dense visual features for precise pixel-level localization with MobileCLIP2's efficient text embeddings, mapping them into a shared latent space using low-memory projection heads. Compared to six state-of-the-art ZSAD models, LiZAD achieves an average memory reduction of 61.5%, a parameter reduction of 74.6%, and a 3.02x speedup in latency. It maintains competitive anomaly detection performance, with only a 6.4% drop in average P-AUROC relative to the best model across VisA, BTAD, MPDD, and MVTec-AD datasets. The framework has been successfully deployed on NVIDIA Jetson NX and Jetson AGX edge devices and tested on a real production line.
Key takeaway
For Machine Learning Engineers developing real-time quality control systems in dynamic industrial environments, LiZAD offers a practical solution for deploying zero-shot anomaly detection on edge devices. You can achieve significant reductions in memory (61.5%) and parameters (74.6%), alongside a 3.02x latency speedup, while maintaining competitive detection performance. Consider integrating this lightweight framework to enable rapid defect identification without extensive target-specific data collection or annotation.
Key insights
LiZAD enables efficient, real-time zero-shot anomaly detection on edge devices for dynamic industrial settings.
Principles
- Combine dense visual features with efficient text embeddings.
- Low-memory projection heads enable edge deployment.
- Zero-shot methods suit dynamic industrial production.
Method
LiZAD pairs DINOv3 visual features with MobileCLIP2 text embeddings, projecting them into a shared latent space via low-memory trainable projection heads for efficient, real-time anomaly detection.
In practice
- Deploy ZSAD on NVIDIA Jetson NX/AGX devices.
- Detect defects in high-throughput production lines.
- Reduce memory footprint by 61.5% for ZSAD.
Topics
- Zero-Shot Anomaly Detection
- Edge AI
- Industrial Manufacturing
- DINOv3
- MobileCLIP2
- NVIDIA Jetson
Code references
Best for: Computer Vision Engineer, Research Scientist, AI Scientist, Machine Learning Engineer, AI Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.