I hate Opus 5. It’s the best model, anyway.

· Source: How I AI · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Intermediate, extended

Summary

The "How I AI" benchmark review of Anthropic's new Opus 5 model reveals a complex user experience despite top-tier performance. The author, initially frustrated by Opus 5's "neurotic" and timid personality, excessive verbosity ("Claude's slop"), and perceived human reliance, conducted a comparative "personality interview" with Opus 5 and GPT models. While Opus 5 articulated itself as a tool for volume and breadth, GPT emphasized speed and scale. Despite the interaction challenges, Opus 5 achieved the highest score in the "How I AI" benchmark, which evaluates tasks like PRD creation, prototype creation, and agentic coding. The model particularly excelled in front-end design and app prototyping, producing detailed, functional, and polished outputs, leading the author to conclude that its high-quality results outweigh the exasperating direct interaction.

Key takeaway

For Machine Learning Engineers or AI Scientists evaluating frontier models for design and prototyping, Opus 5, despite its verbose and timid interaction style, delivers superior output quality. You should consider integrating Opus 5 into your workflow for front-end design, app design, and prototype creation, especially for asynchronous tasks where direct conversational interaction is minimized. Prioritize evaluating models based on final output quality over conversational "personality" for specific use cases.

Key insights

Opus 5 excels in output quality for design tasks despite a "neurotic" and verbose interaction style.

Principles

Method

The "How I AI" benchmark evaluates models on PRD, prototype, wireframe, bug triage, and agentic coding, using a 70% human "vibe score" and 30% LLM-as-judge split.

In practice

Topics

Best for: AI Architect, AI Engineer, CTO, AI Scientist, Machine Learning Engineer, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by How I AI.