Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Internet of Things (IoT) & Connected Devices, Computer Vision · Depth: Expert, quick

Summary

The "Smart Scissor" framework introduces a unified compression approach for convolutional neural networks (CNNs) on embedded hardware. It tackles computational overhead by dynamically cropping foreground objects from input images, reducing spatial redundancy without losing important features, even at small resolutions. This is achieved via a lightweight foreground predictor. Concurrently, Smart Scissor employs a compound shrinking strategy to compress CNN architectures across three dimensions: depth, width, and resolution. Experiments on ImageNet-1K show it reduces ResNet50's computational cost by 41.5% while improving top-1 accuracy by 0.3%. It also achieves 4.1% higher top-1 accuracy than HRank at the same computational cost.

Key takeaway

For Machine Learning Engineers deploying CNNs on resource-constrained embedded devices, you should investigate dynamic image cropping and compound network shrinking. This approach, exemplified by Smart Scissor, offers significant computational cost reductions—like 41.5% for ResNet50—while maintaining or improving accuracy. Consider integrating instance-aware foreground prediction to preserve critical features when scaling down input resolutions for edge deployments.

Key insights

Smart Scissor couples dynamic image cropping with CNN compression to optimize performance on embedded devices.

Principles

Method

A lightweight foreground predictor efficiently localizes and crops foreground objects. A compound shrinking strategy coordinately compresses CNNs across depth, width, and resolution dimensions.

In practice

Topics

Code references

Best for: Computer Vision Engineer, AI Engineer, Research Scientist, AI Scientist, Machine Learning Engineer, AI Hardware Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.