AIE Miami Day 2 ft. Cerebras, OpenCode, Cursor, Arize AI, and more!

· Source: AI Engineer · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Cloud Computing & IT Infrastructure · Depth: Advanced, extended

Summary

The AI Engineer Miami Day 2 conference featured several speakers discussing the evolving landscape of AI, particularly in software engineering and agentic systems. David House from G2I presented case studies on agentic coding adoption, highlighting a model of successful internalization of practices for engineers at various experience levels. Sarah Chang from Cerebras addressed "latency debt" in large language models (LLMs), introducing Codex Spark, a new model capable of generating code at 2,200 tokens per second, 20 times faster than previous models, and discussed hardware and model architecture optimizations. Le Kalinowski demonstrated deploying latent diffusion models on mobile NPUs for ambient generative AI, achieving fast, stable image generation without cloud APIs. The conference emphasized the shift towards agents as first-class users, the importance of context engineering with knowledge graphs, and the need for flexible, open-source tools in the multimodal AI future.

Key takeaway

For AI Engineers building and deploying agentic systems, prioritize context engineering and inference optimization. Focus on creating transparent, auditable agents using knowledge graphs to capture decision traces, and consider specialized models or frameworks for specific tasks to manage latency and cost. Your development workflow should embrace iterative learning, codifying agent mistakes into skills, and designing for agent-centric interactions to ensure robust, scalable, and economically viable AI applications.

Key insights

Successful AI agent adoption and performance hinge on effective context management, optimized inference, and flexible tooling.

Principles

Method

Context graphs capture decision traces and causal relationships, enhancing agent reliability, auditability, and explainability by integrating structured relational knowledge into an agent's context, moving beyond simple text similarity.

In practice

Topics

Best for: AI Engineer, Machine Learning Engineer, Software Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI Engineer.