Anthropic Researcher Resigns, Warns AI Labs Privately Fear It Could ‘Kill Us All'

Source Beincrypto

An Anthropic researcher, Jacob Coxon, said he resigned from the company, alleging that Anthropic and OpenAI are racing toward self-improving superintelligence and gambling with human lives.

The researcher said he spent the last three years on pre-training work at both companies. He made the claims in a series of posts on X.

Anthropic Researcher Walks Out With Grim Warning For Everyone Still Inside

Coxon argued that the technology’s trajectory is widely underestimated. He claimed that coming systems will hack anything, transform any field overnight, and acquire real power and resources.

He also alleged that private conversations inside the industry differ sharply from public messaging. According to Coxon, senior figures soften their phrasing for the press while expressing fear privately.

“The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt,” he said. “No other human activity poses this level of danger.”

Coxon drew a distinction between his two former employers. He claimed many at OpenAI have not internalized what he called the civilizational stakes, while Anthropic understands them but stays locked in a race to arrive first.

He is one of the many employees to break ranks this year. Anthropic’s Safeguards Lead, Mrinank Sharma, resigned in February.

Joshua Achiam, formerly OpenAI’s chief futurist, wrote on September 1 that rogue AI systems will replicate in the wild and pursue money and power.

Follow us on X to get the latest news as it happens

The Call For Coordination

Coxon described entering what he termed the endgame as a hubristic gamble. He argued such a decision should not be launched from a private company’s Slack.

However, he said he remains optimistic about coordination. He claimed the Hugging Face attack has made pacing agreements between US labs more viable.

Both companies have already backed a version of that idea. More than 1,100 frontier lab staff signed the “Pacing theFrontier” letter in July, including Anthropic CEO Dario Amodei and OpenAI chief scientist Jakub Pachocki. 

“We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development,” the letter reads.

In addition, both companies have also signed a joint open letter on cyber defense, alongside Google, Microsoft, and roughly 150 other organizations. The letter warns that AI-enabled attacks will become far more widespread and sophisticated in the coming months.

Coxon’s warning also lands shortly after UN human rights chief Volker Türk told the Human Rights Council that advanced AI could pose an existential risk.

Coxon added that preventing a global race may require a temporary ban on efforts to improve model capabilities. He closed by urging lab researchers to consider whether they want to start a superintelligent reinforcement-learning run without understanding the resulting system.

BeInCrypto has reached out to Anthropic and OpenAI for comment.

Subscribe to our YouTube channel to watch leaders and journalists provide expert insights

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
Gold rebounds above $4,350 as US Dollar, Treasury yields slipGold price (XAU/USD) rebounds from a nearly one-month low to around $4,385 during the early Asian session on Thursday. The precious metal edges higher as the ‌US Dollar (USD) and Treasury yields retreat from recent highs.
Author  FXStreet
Sep 03, Thu
Gold price (XAU/USD) rebounds from a nearly one-month low to around $4,385 during the early Asian session on Thursday. The precious metal edges higher as the ‌US Dollar (USD) and Treasury yields retreat from recent highs.
placeholder
Gold rebounds above $4,450 as Waller tempers Fed rate hike bets ahead US jobs dataGold price (XAU/USD) gains momentum to around $4,470 during the early Asian session on Friday. The precious metal extended its recovery as Federal Reserve (Fed) rate hike bets ease. All eyes will be on the US August Nonfarm Payrolls (NFP) report, which is due later on Friday. 
Author  FXStreet
Sep 04, Fri
Gold price (XAU/USD) gains momentum to around $4,470 during the early Asian session on Friday. The precious metal extended its recovery as Federal Reserve (Fed) rate hike bets ease. All eyes will be on the US August Nonfarm Payrolls (NFP) report, which is due later on Friday. 
placeholder
Hot August jobs report reignites Fed-hike bets; S&P 500 slips below 7,700 — what to watch before the September FOMCAugust nonfarm payrolls surged to 162,000, three times the consensus, pushing CME FedWatch odds of a September 25-bp hike to 58.4% and dragging the S&P 500 below 7,700. CPI, PPI and the Sept 15-16 FOMC decision now set the tone for US stocks.
Author  Irene Q.
Sep 07, Mon
August nonfarm payrolls surged to 162,000, three times the consensus, pushing CME FedWatch odds of a September 25-bp hike to 58.4% and dragging the S&P 500 below 7,700. CPI, PPI and the Sept 15-16 FOMC decision now set the tone for US stocks.
placeholder
AUD/USD climbs for a fourth day to 0.7218 as Fed-hike bets fail to lift the dollar; RBA speakers and US CPI now in focusThe Australian dollar has risen for four straight sessions toward 0.72 even after August nonfarm payrolls far exceeded expectations and pushed September Fed-hike odds to 58.4%. A thin, holiday-thinned dollar is the short-term driver; Westpac confidence and RBA speakers today, US PPI/CPI this week and the Sept 15-16 FOMC will decide whether the rally holds.
Author  Irene Q.
Yesterday 07: 08
The Australian dollar has risen for four straight sessions toward 0.72 even after August nonfarm payrolls far exceeded expectations and pushed September Fed-hike odds to 58.4%. A thin, holiday-thinned dollar is the short-term driver; Westpac confidence and RBA speakers today, US PPI/CPI this week and the Sept 15-16 FOMC will decide whether the rally holds.
placeholder
Gold slumps to near $4,350 amid oil-driven inflation fears, US inflation data in focusGold price (XAU/USD) falls to near $4,350 during the early Asian session on Wednesday. The precious metal faces some selling pressure as rising oil prices fueled inflation ‌concerns and boosted expectations for a rate hike by the Federal Reserve (Fed) in September.
Author  FXStreet
8 hours ago
Gold price (XAU/USD) falls to near $4,350 during the early Asian session on Wednesday. The precious metal faces some selling pressure as rising oil prices fueled inflation ‌concerns and boosted expectations for a rate hike by the Federal Reserve (Fed) in September.
goTop
quote