SE Radio 729: Garth Mollett on AI Supply Chain Security

· Source: Software Engineering Radio - the podcast for professional software developers · Field: Technology & Digital — Cybersecurity & Data Privacy, Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Advanced, extended

Summary

Garth Mollett, Senior Principal Product Security Engineer at Red Hat, discussed AI supply chain security on SE Radio 729. He outlined the AI supply chain's key components, including pre-training data collection (e.g., Common Crawl, Hugging Face datasets), model training, fine-tuning, alignment, quantization, compression, and deployment via registries like Hugging Face. Mollett highlighted how AI's probabilistic nature merges control and data planes, differing from deterministic software. Attack motivations range from traditional system access (e.g., crypto miners via compromised datasets like Shadow Ray campaigns) to data poisoning and subtle model influence, including attacks during quantization (e.g., CSIRO Australia research, DeepSeq models). Protections involve pre-training data verification, model signing (OpenSSF OMS, Intoto), provenance, and attestation (data cards, model cards, system cards, MLBOM/AIBOM). He also touched on workload identity challenges with tool use and indirect prompt injection.

Key takeaway

For MLOps Engineers or AI Security Engineers deploying models, recognize that AI's merged control and data planes introduce unique attack vectors beyond traditional software. You must implement robust verification for pre-training data and model provenance, utilizing standards like data/model cards and signing. Critically, isolate AI agents and tool use with fine-grained workload identity and short-lived tokens to mitigate indirect prompt injection risks, preventing unauthorized access or data exfiltration.

Key insights

AI supply chain security is complex due to merged control/data planes and probabilistic model behavior.

Principles

Method

The AI supply chain involves pre-training data collection, model training, fine-tuning, quantization, and deployment, each requiring specific security considerations.

In practice

Topics

Best for: AI Architect, CTO, VP of Engineering/Data, AI Security Engineer, MLOps Engineer, AI Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Software Engineering Radio - the podcast for professional software developers.