Building Production-Ready, Secure, Observable, AI Agents with Real-Time Voice with Microsoft Foundry

2026-03-16 · Source: Microsoft Foundry Blog articles · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Cybersecurity & Data Privacy · Depth: Intermediate, medium

Summary

Microsoft Foundry has announced the general availability (GA) of its next-generation Agent Service, a modern API and developer platform for building and operating AI agents. This release includes GA for evaluations, tracing, and monitoring within the Foundry Control Plane, offering out-of-the-box and custom evaluators for continuous quality, groundedness, safety, and risk measurement. The Microsoft Foundry portal at ai.azure.com is also generally available, providing a unified interface for AI app and agent development. Additionally, Voice Live integration with Agent Service is now in public preview, enabling real-time speech-to-speech interactions. Foundry Agent Service supports private networking, various authentication methods for Model Context Protocol (MCP), and integrates with partner security solutions like Palo Alto Networks' Prisma AIRS and Zenity for enhanced runtime protection.

Key takeaway

For AI Architects and CTOs evaluating platforms for production-ready AI agents, Microsoft Foundry's GA of its Agent Service, Control Plane observability, and unified portal provides a compelling, secure, and scalable option. You should explore its private networking, robust authentication, and partner security integrations to ensure your agent deployments meet enterprise security and governance requirements, while the Voice Live preview offers immediate opportunities for natural, real-time voice interactions.

Key insights

Microsoft Foundry offers an enterprise-grade platform for building, securing, and observing AI agents with real-time voice capabilities.

Principles

• AI agents require continuous quality and safety measurement.
• Enterprise AI demands robust security and private networking.
• Unified platforms simplify scaling AI across organizations.

Method

Build agents using Foundry Agent Service SDKs (Python, JS, Java, .NET), integrate with Voice Live for real-time speech, and use Foundry Control Plane for continuous evaluation, tracing, and monitoring.

In practice

• Deploy agents via REST endpoints or directly to Microsoft 365/Teams.
• Use private VNets for isolated agent environments.
• Integrate Palo Alto Networks or Zenity for runtime security.

Topics

• AI Agents
• Microsoft Foundry
• Real-Time Voice AI
• AI Observability
• Enterprise AI Security

Code references

• microsoft/foundry

Best for: CTO, AI Architect, VP of Engineering/Data, Machine Learning Engineer, AI Engineer, MLOps Engineer

Related on AIssential

• Introducing the New Browser Automation Tool with Toolboxes in Foundry — The Browser Automation Tool extends AI agents' web interaction capabilities with human-in-the-loop controls and robust infrastructure.
• Agentic AI Observability: The Foundation of Trusted Enterprise AI — Agentic AI observability provides crucial visibility into multi-agent system reasoning, enabling trust and control in enterprise deployments.
• Public preview: Voice-native agents in Microsoft Foundry — Microsoft's new Foundry Agent Service and Voice Live API simplify building real-time, speech-to-speech AI agents on Azure.
• Azure AI Foundry: The Architect’s Blueprint for Building Enterprise AI at Scale — Azure AI Foundry is a platform of ten capabilities requiring deliberate architectural choices and external governance layers for enterprise AI.
• Microsoft's AI Futurist explains how he uses Copilot — and the real-world problems enterprises are solving with agents — Microsoft's agent strategy centers on providing a comprehensive platform for context, governance, identity, and secure data access, alongside diverse model choices.
• Cisco Live 2026: New Security Tools Target AI Threats — Cisco's new platform and security tools aim to unify AI-era IT management and defend against machine-speed threats.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Microsoft Foundry Blog articles.