TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulation
Summary
The Torque Adaptation Module (TAM) is a learned system designed to improve robust motion transfer in dynamic, contact-rich robot manipulation. It addresses challenges like the sim-to-real gap, unknown payloads, and differing robot dynamics that cause policies to fail when transferred between robots. TAM functions by adapting torque commands between the low-level controller and the robot's interface, utilizing a history encoder for proprioceptive data and a torque adaptor for residual corrections. A key advantage is its independence from policy observations or action spaces, allowing the same TAM weights to be reused across policies with joint, end-effector, or direct torque targets. Policies themselves do not need domain randomization; TAM is trained entirely in randomized simulation through multi-robot pretraining and robot-specific fine-tuning, requiring no real-robot data. Experiments on a real Franka Panda robot showed TAM improved zero-shot execution for tasks including vision-based box pushing, a flip policy, and MPC ball-on-plate balancing, surpassing online system identification and RMA baselines.
Key takeaway
For Robotics Engineers developing manipulation policies, if you face challenges with sim-to-real gaps or transferring policies across different robot instances or payloads, you should consider integrating a Torque Adaptation Module (TAM). This approach allows your policies to achieve robust zero-shot real-robot execution in dynamic, contact-rich tasks. By training TAM entirely in randomized simulation, you can significantly reduce the need for real-robot data collection and avoid policy-specific domain randomization, streamlining your development workflow.
Key insights
TAM enables robust robot policy transfer by adapting torques using proprioceptive history, trained purely in simulation.
Principles
- Proprioceptive history enables policy-agnostic adaptation.
- Simulated domain randomization can replace real-world data collection.
- Residual torque corrections enhance motion tracking robustness.
Method
TAM operates between the low-level controller and robot torque interface. It uses a history encoder for proprioceptive data and a torque adaptor for residual torque corrections. Training involves multi-robot pretraining and robot-specific fine-tuning in randomized simulation.
In practice
- Reuse TAM weights across diverse robot action spaces.
- Train adaptation modules entirely in randomized simulation.
- Apply TAM for dynamic, contact-rich manipulation tasks.
Topics
- Robotics
- Manipulation
- Torque Control
- Sim-to-Real Transfer
- Reinforcement Learning
- Franka Panda
Best for: Research Scientist, Robotics Engineer, AI Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.