NVIDIA’s Open Models on Microsoft Foundry:
Summary
Microsoft and NVIDIA are expanding the Microsoft Foundry platform through deeper integrations, bringing NVIDIA's open models, accelerated computing, and AI development frameworks into the Foundry ecosystem. This collaboration, announced at GTC 2026, focuses on specialized agentic systems powered by Nemotron models, sovereign and on-prem AI deployments via Foundry Local, and production-grade physical AI workflows built on Azure and NVIDIA AI platforms. Developers can now build and deploy specialized AI agents using NVIDIA Nemotron models directly within Foundry, leveraging Azure infrastructure accelerated by NVIDIA GPUs. The platform will offer Nemotron Nano 9B v2, Llama 3.1 Nemotron Nano VL 8B, Llama 3.3 Nemotron Super 49B v1.5, and NVIDIA Nemotron Super 3, with future expansion to include Nemotron 3 family models, Nemotron Speech, Nemotron Vision, and AI Safety models. Foundry Local extends capabilities for sovereign environments, supporting NVIDIA RTX PRO 6000 Blackwell Server Edition and future NVIDIA Rubin platforms. An open Azure Physical AI toolchain integrates NVIDIA blueprints with Azure services for robotics and physical AI systems.
Key takeaway
For AI Architects and CTOs evaluating enterprise AI platforms, this expanded Microsoft Foundry and NVIDIA integration offers a compelling solution for unified AI development and deployment. You can now build specialized AI systems once and deploy them consistently across cloud, hybrid, and sovereign environments, addressing data sovereignty and operational complexity challenges. Consider leveraging Nemotron models and Foundry Local for your next-generation agentic or physical AI initiatives.
Key insights
Microsoft Foundry integrates NVIDIA's open models and accelerated computing to unify AI development and deployment across diverse environments.
Principles
- Unified platforms reduce AI fragmentation.
- Open-weight models enable customization.
- Sovereignty requires local AI deployment.
Method
Microsoft Foundry provides a managed compute environment for deploying and customizing NVIDIA Nemotron models on Azure, supporting specialized agentic, sovereign, and physical AI systems.
In practice
- Deploy Nemotron models via NVIDIA NIM microservices.
- Utilize Foundry Local for sovereign AI deployments.
- Explore Azure Physical AI toolchain for robotics.
Topics
- Microsoft Foundry
- NVIDIA Nemotron
- Agentic AI
- Sovereign AI
- Physical AI
Best for: CTO, AI Architect, Computer Vision Engineer, AI Engineer, Machine Learning Engineer, MLOps Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Microsoft Foundry Blog articles.