Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Computer Vision · Depth: Expert, quick

Summary

Open-world video anomaly detection (OWVAD) aims to identify events matching a user-specified definition of abnormality, a stronger requirement than generic anomaly localization. However, current OWVAD evaluation largely fails to isolate this conditional behavior, leading to "definition blindness" where models score high but are insensitive to the queried definition. This failure stems from standard VAD metrics and dynamic-definition protocols overemphasizing target-versus-normal separation, which receives 7.2-26.8x more weight. To address this, new definition-conditioned evaluation metrics, DC-Disc, DC-DetΔ, and DC-SelΔ, are introduced. Experiments on UCF-Crime, XD-Violence, and MSAD show existing baselines localize anomalies but exhibit weak definition following. The paper validates this issue is actionable by introducing DeCoS, a definition-contrastive scoring rule, which improves the strongest baseline by 7.3-16.0 AUROC points on DC-Disc and 15.5-28.3 points on DC-DetΔ.

Key takeaway

For Computer Vision Engineers developing Open-World Video Anomaly Detection (OWVAD) systems, you must move beyond standard VAD metrics. Your evaluation should incorporate definition-conditioned metrics like DC-Disc and DC-DetΔ to accurately assess a model's ability to follow specific anomaly definitions. Consider implementing definition-contrastive scoring rules such as DeCoS to significantly improve definition-following capabilities, achieving up to 28.3 AUROC points higher.

Key insights

Current OWVAD evaluation suffers from "definition blindness," requiring new metrics and a definition-contrastive scoring rule for true conditional anomaly detection.

Principles

Method

DeCoS, a definition-contrastive scoring rule, subtracts anomaly evidence shared across definitions to improve definition following in Open-World Video Anomaly Detection models.

In practice

Topics

Best for: Research Scientist, AI Scientist, Computer Vision Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.