Humans Versus Robots

AI safety risks

Anthropic IPO warns its AI could blackmail people, become sentient, end humanity

Anthropic IPO filing lists risks including AI blackmail, sentience and existential threat.

The Securities and Exchange Commission's publication on Monday of Anthropic's S-1 form—ahead of a heavily anticipated initial public offering—has led to plenty of discussion of whether the company's quickly ballooning revenues will be able to overcome its even higher costs. But amid the numbers and forward-looking optimism about AI "rapidly transform[ing] every sector of the global economy in ways greater than the impact of industrialization, electricity, semiconductors, and the internet," Anthropic also spends an inordinate amount of time in its S-1 laying out the myriad risk factors that could bring the company down. Across 93 pages and over 70,000 words, Anthropic's S-1 "Risk Factors" section discusses literally hundreds of potential problems that could negatively impact its business in the coming…