AI Rings on Fingers Can Interpret Sign Language

· Source: IEEE Spectrum · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Internet of Things (IoT) & Connected Devices · Depth: Intermediate, short

Summary

A new study published in *Science Advances* on May 1 details the development of electronic rings wirelessly connected to an AI system capable of translating multiple sign languages into text. Developed by researchers at Yonsei University in Korea, these rings overcome limitations of previous sign language translation systems, such as camera-based methods sensitive to lighting and bulky smart gloves that caused discomfort and restricted movement. The system utilizes seven rings, each equipped with accelerometers and Bluetooth Low Energy SoCs, to wirelessly transmit motion data. A deep-learning system processes this data, recognizing 100 common American Sign Language and 100 common International Sign Language words with 88.3% and 88.5% accuracy, respectively, a significant improvement over prior systems limited to fewer than 50 words. The system also translates continuous signing into full sentences, supporting real-time interpretation, and is designed for general use without extensive per-user calibration.

Key takeaway

For NLP engineers developing wearable interfaces for communication or gesture recognition, consider adopting a modular, ring-based sensor design. This approach, leveraging wireless transmission and deep learning, offers superior comfort, adaptability to diverse users, and improved accuracy over glove-based or camera-dependent systems. Prioritize integrating edge computing for enhanced portability, privacy, and reduced latency in real-time applications, while planning for future incorporation of facial grammar and body posture for full linguistic capture.

Key insights

Wireless electronic rings with AI translate sign language by capturing hand movements, offering a practical, adaptable solution.

Principles

Method

The system uses seven accelerometer-equipped rings with serpentine interconnects for mechanical reliability. These wirelessly transmit motion data to a deep-learning AI, which recognizes signs from both static postures and dynamic movements.

In practice

Topics

Best for: NLP Engineer, AI Scientist, AI Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by IEEE Spectrum.