CFRNet: Cycle-Consistent Fixed-Point Training for Real-Time Blind Face Restoration on Consumer Embedded NPUs
Summary
CFRNet is a 2.0M-parameter ResNet-style neural network designed for real-time blind face restoration on consumer embedded NPUs, specifically for 256x256 face crops. It tackles the challenge of balancing image quality with the speed and memory constraints of small neural processing units, where larger models like GFPGAN face compilation and quantization issues. CFRNet introduces Cycle-Consistent Fixed-Point Training (CCFP), which trains the network to act as a fixed-point operator, ensuring repeated application does not alter the restored face. CCFP uses progressive multi-cycle supervision, an idempotence loss, and a re-degradation cycle loss, adding no inference cost. On a 300-image test set, CFRNet achieved an LPIPS of 0.250 at three cycles, a 31% improvement over one cycle, and optimal PSNR/SSIM at two cycles. It runs in about 23ms per cycle in INT8 on a HiSilicon Hi3402 NPU, outperforming baselines in deployability. The cycle count k serves as a quality knob, with PSNR best at k=2 and LPIPS improving up to k=3.
Key takeaway
For Computer Vision Engineers deploying face restoration on consumer embedded NPUs, CFRNet offers a robust solution for balancing quality and real-time performance. You should consider its Cycle-Consistent Fixed-Point Training approach to achieve superior perceptual quality (LPIPS 0.250 at three cycles) and deployability on hardware like the HiSilicon Hi3402 NPU. Utilize the cycle count k as a simple, retraining-free quality knob to optimize for PSNR at k=2 or LPIPS up to k=3 based on your application's specific needs.
Key insights
CFRNet uses Cycle-Consistent Fixed-Point Training to enable high-quality, real-time blind face restoration on consumer NPUs with a tunable quality knob.
Principles
- Training for fixed-point operation improves restoration stability.
- Multi-cycle supervision enhances perceptual quality progressively.
- Idempotence loss prevents over-smoothing in iterative restoration.
Method
Cycle-Consistent Fixed-Point Training (CCFP) trains a network to be a fixed-point operator using progressive multi-cycle supervision, an idempotence loss, and a re-degradation cycle loss, adding no inference cost.
In practice
- Deploy 2.0M-parameter ResNet-style restorers on NPUs.
- Use cycle count k as a real-time quality knob.
- Apply CCFP to plain CNNs for easier deployment.
Topics
- Blind Face Restoration
- Neural Processing Units
- Cycle-Consistent Training
- Real-Time Inference
- Embedded AI
- ResNet Architecture
Best for: Research Scientist, AI Scientist, Computer Vision Engineer, AI Hardware Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.