SonoRank: Towards Calibration-Free Real-Time Finger Flexion Detection from Forearm Ultrasound Sequences

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Robotics & Autonomous Systems, Artificial Intelligence & Machine Learning, Computer Vision & Pattern Recognition · Depth: Expert, quick

Summary

SonoRank is a novel method addressing the limitations of surface electromyography (sEMG) in powered prosthetic hands by enabling calibration-free, real-time finger flexion detection from forearm ultrasound video. Current ultrasound-based methods require per-user fine-tuning, hindering commercialization. SonoRank first learns to rank pairs of ultrasound sequences based on their relative motion magnitude for each of the five fingers. These learned representations are then fine-tuned to classify active finger flexion using a rest reference captured at operation start. In 12-fold leave-one-subject-out cross-validation on a twelve-subject dataset, SonoRank achieved a 28% improvement in F1 score over direct classification baselines, demonstrating pairwise ranking's effectiveness for subject-independent control.

Key takeaway

For Robotics Engineers or AI Scientists developing advanced prosthetic hands, SonoRank offers a critical advancement by eliminating the need for per-user calibration. You should investigate incorporating pairwise ranking as a pretraining signal for subject-independent control in your sonomyography-based systems. This approach promises to enhance the functionality and user adoption of powered prosthetics, moving beyond the limitations of sEMG and current ultrasound methods.

Key insights

Pairwise ranking pretraining significantly improves subject-independent finger flexion detection from ultrasound for prosthetics.

Principles

Method

SonoRank learns to rank ultrasound sequence pairs by relative motion magnitude for each finger, then fine-tunes representations to classify active flexion using an initial rest reference.

In practice

Topics

Best for: Computer Vision Engineer, Robotics Engineer, AI Scientist, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.