How we made Trail of Bits AI-native (so far)
Summary
Trail of Bits transformed its operations into an "AI-native" company, moving from 5% AI adoption to a robust system featuring 94 plugins, 201 skills, and 84 specialized agents, which now enables AI-augmented auditors to find 200 bugs a week on specific engagements. This contrasts with a National Bureau of Economic Research study finding no measurable AI impact on employment or productivity for most companies. Trail of Bits defines "AI-native" as a structural shift where AI is a core participant, not merely a tool. They overcame psychological barriers like self-enhancing bias, identity threat, intolerance for imperfection, and opacity by implementing remedies such as a maturity matrix, encoding expertise as reusable skills, reducing AI failure points, and providing a clear AI Handbook. This systemic approach resulted in 20% of reported bugs being AI-discovered and sales reps averaging \$8M in revenue.
Key takeaway
For Directors of AI/ML aiming to integrate AI beyond basic tools, recognize that true AI-native transformation demands a systemic shift. Your strategy must address psychological resistance and operationalize AI as a core team member, not just a utility. Focus on standardizing toolchains, establishing clear usage policies, and creating a measurable capability ladder. This approach, exemplified by Trail of Bits' 200-bug-per-week success, ensures expertise compounds and drives significant productivity gains.
Key insights
Transforming into an AI-native organization requires systemic changes, not just tool adoption, by addressing human resistance and integrating AI as a core team member.
Principles
- AI adoption requires systemic change, not just tool distribution.
- Address psychological barriers to technology adoption directly.
- Expertise compounds when encoded into reusable AI skills.
Method
Trail of Bits' "AI-native" system involves standardizing tools, writing clear usage rules, establishing a capability ladder, running adoption sprints, capturing reusable artifacts (skills, configs), and ensuring safe autonomy via sandboxing and guardrails.
In practice
- Standardize on a single AI agent workflow.
- Develop an AI Handbook with clear usage policies.
- Implement a maturity matrix for AI capability.
Topics
- AI-native transformation
- AI adoption strategy
- AI security auditing
- Agent systems
- Organizational change
- AI maturity matrix
Code references
- trailofbits/publications
- trailofbits/skills
- trailofbits/skills-curated
- trailofbits/claude-code-config
- trailofbits/claude-code-devcontainer
Best for: AI Engineer, Director of AI/ML, AI Security Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by The Trail of Bits Blog.