Domain-Aware Hierarchical Contrastive Learning for Semi-Supervised Generalization Fault Diagnosis
Summary
Researchers Junyu Ren, Wensheng Gan, and Philip S. Yu propose a unified framework called Domain-Aware Hierarchical Contrastive Learning (DAHCL) for semi-supervised domain generalization fault diagnosis (SSDGFD). This framework addresses challenges in fault diagnosis under unseen operating conditions with scarce labeled data, specifically focusing on cross-domain pseudo-label bias and inefficient utilization of unlabeled samples. DAHCL introduces a Domain-Aware Learning (DAL) module to capture source-domain geometric characteristics and calibrate pseudo-label predictions, mitigating bias. Additionally, a Hierarchical Contrastive Learning (HCL) module combines dynamic confidence stratification with fuzzy contrastive supervision, allowing uncertain samples to contribute to representation learning without relying on unreliable hard labels. The framework was evaluated on three benchmark datasets (CWRU, PU, JUST) under severe noise (0 dB SNR) and substantial domain shifts, consistently outperforming advanced SSDGFD baselines and demonstrating superior robustness and generalization capabilities. The code is publicly available on GitHub.
Key takeaway
For AI Scientists and Machine Learning Engineers developing fault diagnosis systems in industrial settings with limited labeled data, DAHCL offers a robust approach. Its dual focus on mitigating cross-domain pseudo-label bias and effectively utilizing uncertain unlabeled samples can significantly improve diagnostic accuracy and generalization, especially under noisy conditions. Consider integrating domain-aware learning and hierarchical contrastive supervision to enhance model performance and reliability in real-world deployments.
Key insights
DAHCL improves semi-supervised fault diagnosis by correcting pseudo-label bias and leveraging uncertain unlabeled data through domain-aware and hierarchical contrastive learning.
Principles
- Domain-specific geometry informs pseudo-label calibration.
- Uncertain samples offer valuable weak semantic information.
- Dynamic confidence stratification improves unlabeled data utilization.
Method
DAHCL uses a Domain-Aware Learning (DAL) module to embed domain-specific geometry for pseudo-label calibration and a Hierarchical Contrastive Learning (HCL) module for stratified, fuzzy contrastive supervision of unlabeled samples.
In practice
- Incorporate engineering noise into SSDGFD evaluation protocols.
- Use exponential moving average for stable domain descriptor updates.
- Employ fuzzy proxies for uncertain samples in contrastive learning.
Topics
- Semi-Supervised Domain Generalization
- Fault Diagnosis
- Contrastive Learning
- Pseudo-Label Calibration
- Domain-Aware Learning
Code references
Best for: AI Scientist, Machine Learning Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.LG updates on arXiv.org.