Back to Source: Open-Set Continual Test-Time Adaptation via Domain Compensation
Summary
DOmain COmpensation (DOCO) is a novel framework designed to address Open-set Continual Test-Time Adaptation (OCTTA), a challenging scenario where models encounter both continuously shifting data distributions and the emergence of new, unknown semantic classes during inference. Existing Test-Time Adaptation (TTA) methods struggle in this setting, often leading to feature space collapse and degraded performance in both classification and out-of-distribution (OOD) detection. DOCO tackles this by synergistically performing domain adaptation and OOD detection. It dynamically splits samples into likely in-distribution (ID) and OOD categories, then learns a domain compensation prompt using only ID samples. This prompt aligns feature statistics with the source domain while preserving semantic structure, and is subsequently applied to OOD samples to enhance their semantic novelty isolation for improved detection. Experiments show DOCO surpasses previous CTTA and OSTTA methods, setting a new benchmark for OCTTA.
Key takeaway
For research scientists developing robust computer vision models, DOCO offers a new approach to handle the complex OCTTA scenario. If your current TTA methods struggle with simultaneous domain and semantic shifts, consider implementing DOCO's dynamic sample splitting and domain compensation prompt learning. This could significantly improve both classification accuracy and OOD detection reliability in real-world, evolving environments.
Key insights
DOCO robustly adapts to continuous domain shifts and detects novel classes by synergistically compensating for domain and semantic shifts.
Principles
- Separate ID from OOD samples dynamically.
- Align feature statistics with source domain.
- Preserve semantic structure during adaptation.
Method
DOCO performs dynamic sample splitting, learns a domain compensation prompt from ID samples by aligning feature statistics with the source, and propagates this prompt to OOD samples for enhanced detection.
In practice
- Apply dynamic sample splitting for TTA.
- Use prompt learning for domain compensation.
- Isolate semantic novelty for OOD detection.
Topics
- Test-Time Adaptation
- Open-set Continual Test-Time Adaptation
- Domain Compensation
- Out-of-Distribution Detection
- Domain Shift Mitigation
Best for: Research Scientist, AI Scientist, Computer Vision Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.