Anthropic Researcher Resigns, Warns AI Labs Privately Fear It Could ‘Kill Us All'

Source Beincrypto

An Anthropic researcher, Jacob Coxon, said he resigned from the company, alleging that Anthropic and OpenAI are racing toward self-improving superintelligence and gambling with human lives.

The researcher said he spent the last three years on pre-training work at both companies. He made the claims in a series of posts on X.

Anthropic Researcher Walks Out With Grim Warning For Everyone Still Inside

Coxon argued that the technology’s trajectory is widely underestimated. He claimed that coming systems will hack anything, transform any field overnight, and acquire real power and resources.

He also alleged that private conversations inside the industry differ sharply from public messaging. According to Coxon, senior figures soften their phrasing for the press while expressing fear privately.

“The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt,” he said. “No other human activity poses this level of danger.”

Coxon drew a distinction between his two former employers. He claimed many at OpenAI have not internalized what he called the civilizational stakes, while Anthropic understands them but stays locked in a race to arrive first.

He is one of the many employees to break ranks this year. Anthropic’s Safeguards Lead, Mrinank Sharma, resigned in February.

Joshua Achiam, formerly OpenAI’s chief futurist, wrote on September 1 that rogue AI systems will replicate in the wild and pursue money and power.

Follow us on X to get the latest news as it happens

The Call For Coordination

Coxon described entering what he termed the endgame as a hubristic gamble. He argued such a decision should not be launched from a private company’s Slack.

However, he said he remains optimistic about coordination. He claimed the Hugging Face attack has made pacing agreements between US labs more viable.

Both companies have already backed a version of that idea. More than 1,100 frontier lab staff signed the “Pacing theFrontier” letter in July, including Anthropic CEO Dario Amodei and OpenAI chief scientist Jakub Pachocki. 

“We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development,” the letter reads.

In addition, both companies have also signed a joint open letter on cyber defense, alongside Google, Microsoft, and roughly 150 other organizations. The letter warns that AI-enabled attacks will become far more widespread and sophisticated in the coming months.

Coxon’s warning also lands shortly after UN human rights chief Volker Türk told the Human Rights Council that advanced AI could pose an existential risk.

Coxon added that preventing a global race may require a temporary ban on efforts to improve model capabilities. He closed by urging lab researchers to consider whether they want to start a superintelligent reinforcement-learning run without understanding the resulting system.

BeInCrypto has reached out to Anthropic and OpenAI for comment.

Subscribe to our YouTube channel to watch leaders and journalists provide expert insights

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
What History Says Happens After Chip Stocks Have a Week This BadBTIG has told investors to use any rebound in semiconductor stocks to cut their exposure. The firm expects a drawn-out decline in the sector that could stretch into 2027.The warning followed an 11.4%
Author  Beincrypto
Oct 20, Tue
BTIG has told investors to use any rebound in semiconductor stocks to cut their exposure. The firm expects a drawn-out decline in the sector that could stretch into 2027.The warning followed an 11.4%
placeholder
Will Brent Jump 28% Again? US and Israel Draft Post-Midterm Iran Strike PlansThe US and Israel have drafted plans for Iran strikes after the Nov. 3 midterms, The New York Times reports. Energy sites appear on the reported target list, with Brent crude already near $109 a barre
Author  Beincrypto
Oct 22, Thu
The US and Israel have drafted plans for Iran strikes after the Nov. 3 midterms, The New York Times reports. Energy sites appear on the reported target list, with Brent crude already near $109 a barre
placeholder
Is the XRP Price Heading for a Major Crash? Whale Inflows Hit a 7-Month HighXRP whales sent $112.4 million to Binance, the highest inflow level in seven months, according to crypto analysts. The move signals rising selling pressure from large holders.However, fresh data sugge
Author  Beincrypto
Yesterday 01: 31
XRP whales sent $112.4 million to Binance, the highest inflow level in seven months, according to crypto analysts. The move signals rising selling pressure from large holders.However, fresh data sugge
placeholder
Bitcoin Price Erases Two-Day Gains After $85,000 Rejection: Will it Fall to $80,000?The Bitcoin price has erased its two-day gains after a rejection near $85,000. Bitcoin (BTC) slid about 4% to an intraday low of $81,652 on Bybit.On-chain data and price charts now point to $80,000 as
Author  Beincrypto
Yesterday 01: 31
The Bitcoin price has erased its two-day gains after a rejection near $85,000. Bitcoin (BTC) slid about 4% to an intraday low of $81,652 on Bybit.On-chain data and price charts now point to $80,000 as
placeholder
Market News Today Australia: Nasdaq Sinks 2.6%, Gold Slides as AI Stocks Sell OffNasdaq falls 2.6%, gold drops below $4,100 and oil rises as AI spending fears grow. Explore today's Australian outlook for AUD/USD and the ASX 200.
Author  Mitrade Team
Yesterday 02: 44
Nasdaq falls 2.6%, gold drops below $4,100 and oil rises as AI spending fears grow. Explore today's Australian outlook for AUD/USD and the ASX 200.
goTop
quote