Making Workforce Training Affordable with Tiered Storage - with Aaron Demory of Fearlus

2026-04-14 · Source: The AI in Business Podcast · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure, Cybersecurity & Data Privacy · Depth: Intermediate, long

Summary

Aaron Demory, Senior Partner at Fearlus and Chief of Information Technology and Security at the FDIC, discusses how large organizations can manage AI adoption's infrastructure demands, control costs, and mitigate risk. He emphasizes starting AI initiatives small to align technical ambition with realistic budgets, highlighting that underestimating compute, storage, and governance leads to budget overruns and stalled implementations. Demory notes that many organizations, similar to early cloud adoption, find AI infrastructure costs can explode if not right-sized. He advocates for using AI internally first to gain familiarity and efficiencies, drawing parallels to Amazon's AWS development. The conversation also covers strategic data tiering to balance cost and compliance, ensuring mission-critical data receives appropriate security and availability controls without overspending on less critical information. Ultimately, Demory stresses prioritizing cost and risk mitigation over emotional appeals or chasing popular trends when evaluating AI investments.

Key takeaway

For Directors of AI/ML or CTOs evaluating enterprise AI roadmaps, prioritize cost and risk mitigation from the outset. Your initial AI efforts should be scoped as R&D, focusing on internal efficiencies and learning, rather than immediate ROI. Implement strategic data tiering to balance performance, cost, and regulatory risk, ensuring infrastructure decisions are grounded in mission clarity and risk reduction to build stakeholder confidence and avoid budget overruns.

Key insights

Successful AI adoption in large organizations requires incremental starts, cost control, and risk-based infrastructure decisions.

Principles

• Start AI initiatives incrementally to manage costs.
• Right-size IT effort to avoid budget overruns.
• Frame infrastructure investment through risk mitigation.

Method

Implement AI by first applying it to internal processes to build organizational familiarity and capture efficiencies, then scale to external or strategic targets.

In practice

• Use data tiering for cost and risk optimization.
• Prioritize cost analysis over emotional appeal.
• Conduct small pilot projects or incubators.

Topics

• AI Infrastructure Costs
• Enterprise AI Adoption
• Data Tiering Strategy
• AI Risk Mitigation
• Generative AI Governance

Best for: Director of AI/ML, CTO, Executive

Related on AIssential

• Companies Winning with AI Built the Data Layer First — A robust data foundation is critical for unlocking scalable AI and advanced analytics capabilities.
• The Week AI Grew Up — AI is transitioning from a startup phase to critical infrastructure, driven by demand, market shifts, and product evolution.
• Best Practices for AI Infrastructure Planning — Robust AI infrastructure planning is crucial for scalable, cost-effective, and secure AI model training and deployment.
• AI Is Turning Unified Storage Into A Strategic Decision — AI's reliance on live enterprise data elevates storage to a strategic component for capability, performance, and GRC.
• The Harnessing Map of AI — The "harnessing gap" between AI capability and safe enterprise deployment is the defining tension of the current AI market.
• Maciel’s article is right to puncture the “AI is magic intelligence” narrative and re-anchor the debate in infrastructure, energy, and economics. But the chapter after that will be written by those... — AI's future is an infrastructure and economics contest, heavily influenced by governance and security.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The AI in Business Podcast.