Inside NVIDIA Halos for Robotics: A Full-Stack Functional Safety System for Physical AI

2026-06-22 · Source: NVIDIA Technical Blog · Field: Technology & Digital — Robotics & Autonomous Systems, Artificial Intelligence & Machine Learning · Depth: Advanced, long

Summary

NVIDIA has launched Halos for Robotics, a comprehensive, full-stack functional safety system designed for physical AI applications like industrial robots, humanoids, and autonomous mobile robots (AMRs). This system extends NVIDIA's extensive 18,000 engineering years of autonomous vehicle (AV) safety development, leveraging foundational hardware like NVIDIA IGX Thor and NVIDIA Holoscan Sensor Bridge (HSB), alongside the Halos OS software stack. Halos OS includes Halos Core, the base safety operating system, and Halos Applications such as the Outside-In Safety Blueprint, which uses external cameras and AI for dynamic robot behavior control. Agility, maker of the Digit humanoid robot, is already incorporating IGX Thor and Halos OS. The system aims to provide a standards-aligned foundation for AI-driven safety, moving beyond ad hoc implementations, and is supported by the NVIDIA Halos AI Systems Inspection Lab for streamlined certification.

Key takeaway

For Robotics Engineers developing autonomous systems for unstructured environments, NVIDIA Halos for Robotics offers a pre-assessed, full-stack functional safety solution. You can accelerate your certification by building on the IGX Thor platform and Halos OS, leveraging its proven AV safety heritage. Implement the Outside-In Safety Blueprint to enhance robot perception and dynamically adapt behavior. This ensures both safety and operational efficiency in complex settings like automated trailer loading.

Key insights

NVIDIA Halos extends proven AV functional safety to robotics, enabling AI-driven safety for physical AI in unstructured environments.

Principles

• Functional safety stacks are extensible across domains.
• AI-driven safety is crucial for unstructured robot environments.
• Third-party assessment confirms cross-domain compliance.

Method

The Halos Outside-In Safety Blueprint uses a Sensor Input Processing Pipeline (SIPP), Safety AI Monitor (SAIM), Safety Event Integrator (SEI), and Safety Decision Maker (SDM) for external perception and dynamic robot control.

In practice

• Use Halos Core for certified safety OS foundation.
• Implement outside-in safety with external cameras.
• Leverage the AI Systems Inspection Lab for certification.

Topics

• Robotics Safety
• Functional Safety
• Physical AI
• NVIDIA Halos
• IGX Thor
• Autonomous Mobile Robots
• AI Systems Certification

Code references

• NVIDIA/halos-outside-in-safety
• NVIDIA-AI-Blueprints/video-search-and-summarization

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Robotics Engineer, AI Engineer, MLOps Engineer

Related on AIssential

• Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems — OpenUSD and NVIDIA's simulation tools are crucial for safely scaling Physical AI in robotics and autonomous vehicles.
• For Robotaxis, Safety Must Be Built In, Not Bolted On — Robotaxi safety requires a built-in, full-stack approach, integrating certified OS, standardized interfaces, and AI guardrails.
• Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulation — Safe long-horizon robotic manipulation requires a cross-layer framework distinguishing intervention loci and evidence boundaries.
• 🎙️ Be Bold, Stay Safe: How NVIDIA Is Engineering the Hardest Tradeoff in Self-Driving — NVIDIA's AV stack balances AI-driven end-to-end learning with classical safety guardrails for robust autonomy.
• Automotive Special Address: Advancing Level 4 Autonomy, the Path to Scalable, Safe AVs and Robotaxis — NVIDIA's Drive platform integrates advanced AI models and a unified hardware/software stack to accelerate scalable, safe L4 autonomous driving.
• NVIDIA IGX Thor Powers Industrial, Medical, and Robotics Edge AI Applications — NVIDIA IGX Thor unifies high-performance AI with industrial-grade functional safety and real-time determinism for edge applications.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by NVIDIA Technical Blog.