Why I Joined Kestra: Enterprise Workflow Orchestration for the Agentic AI Era

2026-07-01 · Source: Kai Waehner · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Cloud Computing & IT Infrastructure · Depth: Intermediate, medium

Summary

Kestra is an open-source, declarative, and event-driven orchestration platform designed to unify disparate enterprise workflow tools. It consolidates legacy IT schedulers like Control-M, data pipeline tools such as Airflow, business process platforms including Camunda, and infrastructure automation tools like Terraform into a single control plane. The platform, under Apache 2.0 license, is already in production at major enterprises including Apple, JPMorgan, Toyota, and Xiaomi. Its adoption is driven by ongoing modernization efforts and the emergence of agentic AI, which necessitates a unified governance layer for complex, cross-domain workflows. Kestra supports flexible deployment on standard databases or Kafka, with future plans for Redis and cloud-native messaging, and offers YAML, API, and no-code interfaces with over 1,500 integrations.

Key takeaway

For CTOs and AI Architects grappling with fragmented enterprise orchestration or planning significant AI adoption, a unified platform is crucial. Your current patchwork of schedulers, data pipelines, and BPM tools creates governance risks and operational silos, especially with agentic AI. You should evaluate Kestra to consolidate these diverse workloads under one declarative control plane, ensuring observable, governed workflows for both deterministic processes and autonomous agents. This approach streamlines operations and mitigates risks inherent in cross-domain AI deployments.

Key insights

Agentic AI and enterprise modernization necessitate a unified orchestration platform for fragmented workflows.

Principles

• Fragmented orchestration tools create governance risks.
• Agentic AI multiplies the need for unified workflow governance.
• Open-source platforms can achieve enterprise scale.

Method

Kestra unifies IT scheduling, data pipelines, BPM, and infrastructure automation onto one declarative, event-driven platform, supporting various backends.

In practice

• Consolidate legacy IT schedulers and data pipeline sprawl.
• Orchestrate AI agents and deterministic workflows side-by-side.
• Deploy on existing Kafka infrastructure for high throughput.

Topics

• Workflow Orchestration
• Agentic AI
• Enterprise Modernization
• Kestra Platform
• Data Pipelines
• Open-Source

Best for: VP of Engineering/Data, CTO, Director of AI/ML, AI Architect

Related on AIssential

• Orchestrate Agentic Workflows with North Automations - Cohere — Agent orchestration centralizes diverse AI agents for enterprise-scale governance, cost control, and end-to-end workflow automation, closing the AI ROI gap.
• Bridging the operational AI gap — Integrated data and systems are critical for successful enterprise-wide AI adoption and operationalization.
• AI Systems Are Quietly Becoming Distributed Systems — Enterprise AI systems are becoming distributed execution fabrics, shifting operational complexity from models to inter-component coordination.
• Q&A: OneAdvanced's CTO on Embedded AI and Fragmented Systems — Embedding AI into core architecture, not just adding tools, drives scalable impact and unified workflows.
• How to Orchestrate AI Workflows — Pure AI workflows are fast to prototype but lack reliability; combine AI with deterministic orchestration for robust systems.
• Agentic AI Enters Its Enterprise Execution Era — Agentic AI is moving from chat to enterprise execution, demanding new governance for its inherent risks and value.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Kai Waehner.