The Download: how AI is used for military targeting, and the Pentagon’s war on Claude

· Source: MIT Technology Review · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation, Cybersecurity & Data Privacy · Depth: Fundamental Awareness, short

Summary

The US military is exploring the use of generative AI systems, such as OpenAI's ChatGPT and xAI's Grok, to prioritize and recommend targets for military strikes, according to a Defense Department official. This process would involve feeding a list of potential targets into a classified AI system, which humans would then prompt to analyze and rank them, retaining responsibility for evaluating the AI's recommendations. Concurrently, the Pentagon's CTO has expressed concerns that Anthropic's Claude model could "pollute" the defense supply chain due to its baked-in "policy preference." This development occurs as Ukraine offers its battlefield data for AI training to allies, and Meta postpones an AI launch due to performance issues against rivals.

Key takeaway

For CTOs and VPs of Engineering evaluating AI integration into sensitive operations, you should critically assess the policy preferences and training data of generative AI models. The Pentagon's concerns about Claude highlight that inherent model biases can be a significant barrier to adoption in defense. Prioritize models with transparent architectures and verifiable neutrality, and ensure robust human-in-the-loop validation processes are in place to mitigate risks associated with AI-driven recommendations.

Key insights

Generative AI is being explored for military targeting decisions, raising questions about AI policy and data utility.

Principles

Method

A generative AI system receives target lists, analyzes information, and prioritizes targets, with human operators verifying and evaluating the recommendations before action.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Tech Journalist, Policy Maker, General Interest

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by MIT Technology Review.