‘Pretty Crazy’ Token Usage Is Testing Bosses’ Bet on AI

· Source: WIRED - Ai · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Intermediate, quick

Summary

Software company 8x8 reports that its employees are extensively using Anthropic's Claude for diverse tasks, including drafting emails, analyzing customer feedback, and writing code, without incurring significant financial strain. This positive outcome contrasts sharply with the experiences of other major Silicon Valley firms like Meta, Uber, and Salesforce, which have publicly voiced concerns regarding the escalating costs of generative AI tools and have started implementing usage caps. 8x8's ability to remain "in the black" despite growing reliance on the AI chatbot suggests that high AI token usage can be managed cost-effectively, indicating a varied financial impact of generative AI adoption across different enterprises.

Key takeaway

For Directors of AI/ML evaluating generative AI tool investments, 8x8's experience demonstrates that high employee usage of models like Anthropic's Claude can be financially sustainable. You should scrutinize your internal cost management strategies and consider specific use cases like email drafting, customer feedback analysis, and code generation that might yield positive ROI without excessive expenditure.

Key insights

Some companies are effectively managing generative AI costs despite widespread industry concerns about high token usage.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, Entrepreneur, Director of AI/ML, Executive, Consultant

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by WIRED - Ai.