Anthropic rolls back China tracking code

· Source: Semafor · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy · Depth: Fundamental Awareness, extended

Summary

Anthropic is rolling back "spyware-like code" called the Claude Code feature, which covertly tracked and transmitted user information based on timezone and potential affiliation with Chinese AI labs. This tracking aimed to detect illicit model training using Claude's answers, an action an Anthropic employee termed an "experiment." The incident underscores the intense US-China competition shaping decisions around advanced AI. Despite the White House lifting a ban on foreign access to Anthropic models, businesses worry about a US "kill switch" driven by national security. This context also sees OpenAI CEO Sam Altman calling for a US-led international forum to set global AI safety standards.

Key takeaway

For AI Security Engineers evaluating third-party AI services, Anthropic's incident reveals the hidden risks of vendor-implemented tracking and data transmission. You must conduct thorough due diligence on AI model providers, scrutinizing their data handling, transparency, and adherence to national security directives. Prioritize platforms with explicit, auditable data governance to mitigate unforeseen geopolitical and privacy exposures.

Key insights

AI development faces geopolitical pressures, leading to controversial tracking practices and calls for international safety standards.

Principles

In practice

Topics

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Security Engineer, Policy Maker, Legal Professional

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Semafor.