CFRNet: Cycle-Consistent Fixed-Point Training for Real-Time Blind Face Restoration on Consumer Embedded NPUs

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Internet of Things (IoT) & Connected Devices · Depth: Expert, quick

Summary

CFRNet is a 2.0M-parameter ResNet-style neural network designed for real-time blind face restoration on consumer embedded NPUs, specifically for 256x256 face crops. It tackles the challenge of balancing image quality with the speed and memory constraints of small neural processing units, where larger models like GFPGAN face compilation and quantization issues. CFRNet introduces Cycle-Consistent Fixed-Point Training (CCFP), which trains the network to act as a fixed-point operator, ensuring repeated application does not alter the restored face. CCFP uses progressive multi-cycle supervision, an idempotence loss, and a re-degradation cycle loss, adding no inference cost. On a 300-image test set, CFRNet achieved an LPIPS of 0.250 at three cycles, a 31% improvement over one cycle, and optimal PSNR/SSIM at two cycles. It runs in about 23ms per cycle in INT8 on a HiSilicon Hi3402 NPU, outperforming baselines in deployability. The cycle count k serves as a quality knob, with PSNR best at k=2 and LPIPS improving up to k=3.

Key takeaway

For Computer Vision Engineers deploying face restoration on consumer embedded NPUs, CFRNet offers a robust solution for balancing quality and real-time performance. You should consider its Cycle-Consistent Fixed-Point Training approach to achieve superior perceptual quality (LPIPS 0.250 at three cycles) and deployability on hardware like the HiSilicon Hi3402 NPU. Utilize the cycle count k as a simple, retraining-free quality knob to optimize for PSNR at k=2 or LPIPS up to k=3 based on your application's specific needs.

Key insights

CFRNet uses Cycle-Consistent Fixed-Point Training to enable high-quality, real-time blind face restoration on consumer NPUs with a tunable quality knob.

Principles

Method

Cycle-Consistent Fixed-Point Training (CCFP) trains a network to be a fixed-point operator using progressive multi-cycle supervision, an idempotence loss, and a re-degradation cycle loss, adding no inference cost.

In practice

Topics

Best for: Research Scientist, AI Scientist, Computer Vision Engineer, AI Hardware Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.