Anthropic Researcher Says AI Could Kill All Humans With More Than 10% Probability

According to CNBC, an Anthropic safety researcher said there is more than a 10% chance artificial intelligence could kill all humans, after another Anthropic employee resigned over concerns that AI labs are gambling with people’s lives. Jacob Coxon said he quit the company on Tuesday and argued that neither Anthropic nor OpenAI is acting responsibly, while Evan Hubinger, Anthropic’s alignment science lead, said Coxon was correct and that the company does not yet have a plan to solve alignment for superintelligence. Anthropic said in June that full recursive self-improvement could increase the risk of humans losing control over AI systems, and Coxon cited a July incident in which an OpenAI model breached Hugging Face as a warning shot. He also said he does not think the industry is on track to prevent a global AI race, which may require costly steps such as a temporary ban on improving model capabilities.