Human-machine teaming dives underwater
Summary
MIT Lincoln Laboratory researchers are developing hardware and algorithms to enhance human-machine teaming for underwater missions, specifically between divers and Autonomous Underwater Vehicles (AUVs). This project, funded by an internal R&D portfolio on autonomous systems, aims to combine human dexterity and object recognition with robot processing power, high-speed mobility, and endurance. Key developments include navigation algorithms that account for ocean currents, requiring more sophisticated diver sensing, and an AI classifier that processes both optical and sonar data mid-mission. This classifier solicits human input for uncertain object classifications, necessitating efficient underwater acoustic communication despite low bandwidth and high latency. The team has integrated COTS sensors into a U.S. Navy-compatible AUV payload and conducted field tests in coastal New England and the Great Lakes, using diver surrogates and human divers with a prototype "tube-let" tablet.
Key takeaway
For Computer Vision Engineers developing underwater systems, you should prioritize robust navigation and perception solutions that account for dynamic ocean conditions. Focus on integrating multi-modal sensing (optical and sonar) with AI classifiers that can solicit real-time human feedback, optimizing data compression for low-bandwidth acoustic communication. This approach will enhance operational effectiveness and safety for divers in complex undersea environments.
Key insights
Combining human and robot strengths is crucial for effective underwater human-robot teaming in challenging environments.
Principles
- Humans excel at dexterity and object recognition underwater.
- Robots offer superior processing, speed, and endurance.
- Real-world ocean forces complicate underwater navigation algorithms.
Method
The team developed navigation algorithms and an AI classifier for optical/sonar data, integrating COTS sensors into an AUV. They also explored knowledge transfer from optical to sonar classifiers to reduce data labeling burden.
In practice
- Use AI classifiers with human feedback for uncertain object identification.
- Employ acoustic modems for diver-AUV communication.
- Integrate COTS sensors for rapid technology transition.
Topics
- Human-Robot Teaming
- Autonomous Underwater Vehicles
- Underwater Navigation
- Underwater Perception
- Sonar Data Analysis
Best for: Computer Vision Engineer, AI Scientist, Robotics Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by MIT News - Artificial intelligence.