​Boston Dynamics and Google DeepMind Teach Spot to Reason​

· Source: IEEE Spectrum · Field: Technology & Digital — Robotics & Autonomous Systems, Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Intermediate, short

Summary

Boston Dynamics has integrated Google DeepMind's Gemini Robotics-ER 1.6, a high-level embodied reasoning model, into its quadruped robot, Spot. This enhancement aims to improve Spot's usability and intelligence for complex tasks, particularly in industrial inspection applications. The updated Spot can now autonomously identify dangerous debris or spills, read complex gauges, and utilize vision-language-action models for environmental understanding. While the AI model enhances reasoning, challenges remain in aligning robot understanding with human intuition, especially concerning object manipulation and safety. Gemini Robotics-ER 1.6 currently relies solely on visual data, with future plans to incorporate semantic safety models and leverage customer data for training, aiming for a reliability threshold above 80% to ensure commercial viability and operator trust.

Key takeaway

For Directors of AI/ML evaluating embodied AI solutions for industrial applications, Boston Dynamics' integration of Gemini Robotics-ER 1.6 into Spot signals a significant step towards commercially viable autonomous inspection. Your teams should consider piloting Spot for tasks requiring reliable environmental understanding and automated hazard detection, but be mindful of current limitations in physical interaction and data requirements for advanced manipulation. Focus on applications where the robot's >80% reliability threshold provides clear operational value.

Key insights

Integrating advanced AI reasoning models into robots enhances autonomy for complex real-world tasks.

Principles

Method

Gemini Robotics-ER 1.6 uses vision-only data for high-level reasoning and includes success detection via multiple camera angles to confirm object grasps.

In practice

Topics

Best for: AI Scientist, Research Scientist, AI Product Manager, Robotics Engineer, AI Engineer, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by IEEE Spectrum.