Artificial intelligence (AI) company Anthropic proposed an industry-wide pause in AI development, arguing that increasingly capable systems may soon begin accelerating their own development beyond the pace of human oversight.

The Claude maker in a report warned Thursday that AI could eventually become capable of helping build better versions of itself, potentially accelerating progress beyond the pace at which safety measures and governance frameworks can adapt.

AI Is Already Helping Build AI

Anthropic said employees are increasingly relying on Claude to write code, conduct research and complete technical tasks that would otherwise take significantly longer to finish.

"I started leaning hard into Claudifying about a year ago. That's been a crazy adventure and it's now been ~5 months since I last wrote any code myself," an Anthropic employee said.

While fully autonomous self-improving AI systems have yet to emerge, the company said advances in coding, research and automation capabilities could significantly accelerate the pace of future model development.

“Claude-written code was somewhat worse than human-written code at Anthropic in late 2025, is roughly at parity today, and we expect it to be strictly better within the year,” the company added.

As evidence of AI’s growing contribution to software development, Anthropic said Claude recently shipped more than 800 fixes that cut a category of API errors by a factor of one thousand, work an engineer estimated would have taken a human four years to complete.

Calls For A Pause

Anthropic warned that recursive self-improvement could dramatically accelerate the pace of AI development, potentially compressing years of progress into much shorter timeframes.

The company said such advances could leave governments, regulators and even AI developers struggling to understand and assess increasingly capable systems as the technology evolves.

To address that risk, Anthropic argued that frontier AI labs should establish a coordinated pause framework in advance, allowing researchers time to evaluate emerging risks if development begins outpacing safety safeguards.

The AI Race Could Make Slowing Down Difficult

Anthropic’s warning comes as the U.S. and China compete for leadership in artificial intelligence, pouring billions of dollars into chips, data centers and AI models.

The company argued that any future slowdown would require broad participation from leading developers, as unilateral action by a single company could prove ineffective.

“But if a slowdown simply lets the least cautious actors catch up technologically, it could leave everyone less safe,” Anthropic wrote.

Anthropic Sees More Than Just Risks

Anthropic said recursive self-improvement is not inherently negative and could unlock significant scientific and economic gains, accelerating advances in fields ranging from medicine and energy to software engineering and scientific research.

However, it cautioned that realizing those benefits will require effective safeguards, governance frameworks and international cooperation to ensure increasingly capable AI systems remain aligned with human interests.

Disclaimer: This content was partially produced with the help of AI tools and was reviewed and published by Benzinga editors.

Photo courtesy: Shutterstock