Into the Omniverse: Physical AI Open Models and Frameworks Advance Robots and Autonomous Systems

2026-01-29 · Source: NVIDIA Blog · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Software Development & Engineering · Depth: Intermediate, short

Summary

NVIDIA introduced a new suite of open physical AI models and frameworks at CES, designed to accelerate the development of humanoids, autonomous vehicles, and other physical AI systems. These tools, which span the entire robotics development lifecycle from high-fidelity simulation and synthetic data generation to cloud-native orchestration and edge deployment, leverage OpenUSD as a common framework for standardizing 3D data sharing. Key components include NVIDIA Cosmos world models, Isaac technologies like Isaac Lab-Arena, the Alpamayo portfolio for autonomous vehicles, and the OSMO framework for training orchestration. Companies like Caterpillar, LEM Surgical, NEURA Robotics, AgiBot, and Intbot are already deploying these technologies to create advanced systems, such as AI assistants for heavy equipment, robotic surgical systems, cognitive service robots, and social robots with enhanced reasoning capabilities.

Key takeaway

For AI Architects designing autonomous systems, NVIDIA's new open physical AI stack offers a comprehensive, modular toolkit built on OpenUSD. You should explore integrating components like Isaac Lab-Arena and GR00T N models to streamline your development workflow, from high-fidelity simulation and synthetic data generation to robust real-world deployment, ensuring more reliable and efficient system transfer.

Key insights

Open-source physical AI models and simulation frameworks accelerate autonomous system development from design to deployment.

Principles

• OpenUSD standardizes 3D data sharing.
• Digital twins enable seamless simulation-to-deployment.
• Synthetic data generation enhances training.

Method

The NVIDIA physical AI stack integrates world models, simulation frameworks, and orchestration tools to facilitate a sim-to-real workflow for training and deploying autonomous systems.

In practice

• Use Isaac Lab-Arena for policy evaluation.
• Deploy Nemotron models for agentic AI.
• Integrate Isaac GR00T N models into LeRobot.

Topics

• Physical AI
• NVIDIA Omniverse
• Robotics Development
• Sim-to-Real Transfer
• OpenUSD

Best for: AI Architect, Robotics Engineer, AI Engineer, Machine Learning Engineer

Related on AIssential

• Into the Omniverse: NVIDIA GTC Showcases Virtual Worlds Powering the Physical AI Era — NVIDIA's new blueprints and models are scaling physical AI from isolated uses to enterprise-wide autonomous systems.
• Integrate Physical AI Capabilities into Existing Apps with NVIDIA Omniverse Libraries — NVIDIA Omniverse now offers modular libraries for integrating physical AI capabilities into existing applications.
• Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems — OpenUSD and NVIDIA's simulation tools are crucial for safely scaling Physical AI in robotics and autonomous vehicles.
• Welcome NVIDIA Cosmos 3: The First Open Omni-model for Physical AI Reasoning and Action — NVIDIA Cosmos 3 unifies physical AI capabilities into a single omni-model for comprehensive world understanding and action generation.
• Nvidia Launches Physical AI Models for Robots — Nvidia's new physical AI models and frameworks aim to democratize intelligent robot development and deployment.
• Nvidia wants to be the Android of generalist robotics — Nvidia is building a full-stack ecosystem to become the default platform for generalist robotics.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by NVIDIA Blog.