Game, Set, Bot: Sony AI’s ‘Ace’ Serves Up a Defeat to Table Tennis Pros
Summary
Sony AI, established in April 2020, has developed "Ace," an autonomous robot designed to compete with human table tennis players, claiming it is the first robot to achieve expert-level performance in a competitive physical sport. Building on its Gran Turismo Sophy AI agent, Sony AI utilized gaming environments as benchmarks for training. The robot employs a reinforcement learning approach, trained through thousands of hours of simulated table tennis, to learn optimal ball return strategies. Ace integrates a perception system with nine active pixel sensor cameras and three gaze control systems for 3D ball triangulation and spin measurement, alongside an asymmetric actor-critic deep reinforcement learning policy for control. Its custom hardware features eight degrees of freedom for agility. In April 2025, Ace won three out of five matches against elite players, achieving a return rate above 75%, but lost to professional players.
Key takeaway
For robotics engineers developing physical AI agents for real-time interactive tasks, consider leveraging virtual gaming environments for large-scale reinforcement learning. Your team should prioritize robust perception systems capable of high-speed, precise tracking and integrate them with custom hardware to bridge the simulation-to-reality gap, especially for applications requiring rapid human interaction or high-stakes physical control.
Key insights
Gaming environments serve as safe, scalable testbeds for developing and benchmarking advanced physical AI agents.
Principles
- Reinforcement learning excels in complex, dynamic physical tasks.
- Simulation-to-reality transfer requires robust perception and control.
- High-speed physical interaction demands precise real-time sensing.
Method
Sony AI trains robots using large-scale reinforcement learning in virtual gaming environments, then integrates this with advanced perception systems (APS cameras, GCSs) and custom robotic hardware for real-world deployment.
In practice
- Use virtual environments for initial AI agent training.
- Implement event-based vision for high-speed object tracking.
- Combine learning policies with model predictive control.
Topics
- Sony AI
- Ace Robot
- Table Tennis AI
- Reinforcement Learning
- Physical AI
Best for: AI Scientist, Robotics Engineer, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Big Data & AI News - EE Times.