As Anthropic gears up for its public debut, it faces the possibility of vast unknown legal risks if its agentic AI technology — designed to maintain deep access to customers' systems and run autonomously for days at a time — goes rogue.
While online platforms have long enjoyed immunity from content created or posted by users, that legal shield has started to crack against theories that the platforms are products that can be defective and dangerous. It is unclear whether use of AI systems would receive the same legal treatment as online platforms at all.
Anthropic is planning one of the biggest IPOs in history as a public benefit corporation, a legal structure that requires management to consider certain broader interests as well as turning a profit for investors. Read more about it here.
In its IPO prospectus seen by Reuters, Anthropic said it could face legal claims from customers and users over the actions of rogue AI agents, though the legal framework is uncertain.
A string of incidents involving rogue AI agents, from OpenAI's autonomous agents hacking an AI startup and breaching an Australian health data portal, to several cybersecurity incidents involving Anthropic's Claude AI models, has led to debate over who is liable for harm from an autonomous AI system.
Read the exclusive report from Echo Wang and Jody Godoy for more.