‘The cost of compute is far beyond the costs of the employees’: Nvidia exec says right now AI is more expensive than paying human workers
Summary
Nvidia's VP of Applied Deep Learning, Bryan Catanzaro, stated that for his team, "the cost of compute is far beyond the costs of the employees," implying AI is currently more expensive than human workers in specific R&D contexts. This statement challenges the common belief that AI is rapidly replacing human jobs, a narrative further complicated by significant tech layoffs and an MIT 2024 study finding AI automation economically viable in only 23% of vision-centric roles. Despite Big Tech's announced $740 billion capital expenditure increase (69% from 2025) in AI, broad productivity gains or job displacement remain unproven. High hardware, energy, and inference costs contribute to AI's current inefficiency compared to humans, though future advancements are expected to improve economic viability.
Key takeaway
For CTOs and VPs of Engineering evaluating AI integration, recognize that the immediate cost-benefit analysis for AI deployment, especially for complex tasks, may still favor human labor due to high compute and energy expenses. Prioritize optimizing inference costs and exploring efficient, smaller models for specific use cases to achieve economic viability, rather than expecting broad, immediate human displacement.
Key insights
Current AI compute costs often exceed human labor costs, challenging immediate job displacement narratives.
Principles
- AI economic viability is context-dependent.
- High compute costs hinder broad AI adoption.
In practice
- Route simple AI tasks to cheaper models.
- Optimize open-source models for older chips.
Topics
- AI Compute Costs
- AI Economic Viability
- Job Displacement
- Deep Learning R&D
- AI Model Inference
Best for: CTO, VP of Engineering/Data, Executive, Director of AI/ML, Consultant
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.