AI and the workforce have the same blind spots
Summary
New research by Cangrade reveals a critical flaw in the common assumption that human review guarantees quality in AI-augmented workflows. Based on 71,747 Gen Z and Millennial skills assessments and an analysis of 200 AI-related job postings, the study found that while the younger workforce scored 14% above average in Communication (8th out of 40 competencies), they significantly underperformed in crucial soft skills. Strategic thinking was 1% below average (24th), Critical thinking 18% below average (37th), Attention to detail 17% below average (36th), and Creative problem-solving 10% below average (29th). This persistent skill gap, observed across two years and an 113% increase in sample size, means the human "error-detection mechanism" is weakest where it is most needed, allowing unverified AI outputs to propagate faster and increasing organizational exposure to errors.
Key takeaway
For CIOs and IT leaders deploying AI-augmented workflows, recognize that relying solely on human review for quality assurance is insufficient. Your teams may lack the critical thinking and attention to detail needed to effectively scrutinize AI outputs, increasing organizational exposure to errors. Prioritize direct skill assessments for high-consequence roles and design teams to strategically cover these competency gaps. Track work quality as a distinct metric from throughput to ensure your AI investments truly deliver accurate results.
Key insights
Human review of AI output is compromised by workforce deficiencies in critical thinking and attention to detail, undermining quality assurance.
Principles
- AI augments speed; humans must provide judgment and error detection.
- Critical thinking and attention to detail are paramount for AI review.
- Workforce skill gaps can negate AI governance plans.
Method
Map AI-augmented roles by error consequence, then directly assess teams in high-consequence positions for critical thinking and attention to detail. Build teams to cover skill gaps.
In practice
- Assess critical thinking before assigning AI oversight.
- Design teams to pair strong critical thinkers with communicators.
- Track speed and work quality as distinct metrics.
Topics
- AI Governance
- Workforce Skills Assessment
- Critical Thinking
- Attention to Detail
- AI-Augmented Workflows
- Quality Assurance
Best for: CTO, VP of Engineering/Data, Executive, Director of AI/ML, HR Professional, Consultant
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by CIO.