4 months · 3 summary articles
Anthropic urges global pause on cutting-edge AI development amid control fears
Anthropic urges global pause on frontier AI development amid growing control concerns
Anthropic demands global pause in AI development amid control concerns
Anthropic, the California-based artificial intelligence company, has called for global coordination to pause the development of frontier AI systems unless other leading developers join in and compliance can be verified. In a report published Thursday, Anthropic warned that human oversight may become the primary constraint on technological progress as AI systems grow more advanced. The company’s co-founder, Jack Clark, told the BBC that the industry currently has “a pedal to the metal” but “no brake,” urging regulators and developers to ensure the option to slow down development exists. “You want the option to take your foot off the accelerator and put it on the brake,” Clark said.
The plea comes as AI systems increasingly exhibit unpredictable and unsettling behaviors, even to their creators. Clark noted that Anthropic’s researchers “keep finding things that are mysterious, even unsettling,” raising concerns about the technology’s rapid advancement outpacing human understanding. The company’s proposal for a coordinated pause—contingent on broad industry participation and enforceable compliance—signals a shift from unilateral calls for caution to a structured demand for global governance. Anthropic’s stance underscores the growing unease among AI developers about the lack of safeguards as models approach or surpass human-level capabilities.
Meanwhile, the debate over AI governance is intensifying globally. In Europe, regulators are grappling with how to balance innovation with risk, while in the United States, lawmakers continue to debate the scope of federal oversight. The European Commission’s AI Act, set to take full effect in 2026, aims to classify AI systems by risk level, but critics argue it lacks teeth for frontier models. Anthropic’s intervention adds pressure on policymakers to adopt stricter measures before the next generation of AI systems is deployed.
The call also arrives amid a flurry of high-stakes AI and tech developments. JPMorgan Chase, AMD, and quantum computing firm OQC recently launched a dedicated Quantum-AI Data Centre in London to explore real-world financial applications, signaling that financial institutions are pressing ahead with AI integration despite the warnings. Meanwhile, OpenAI has entered the legal sector with a new AI product targeting lawyers, further expanding the technology’s reach into regulated professions.
As the industry stands at this crossroads, Anthropic’s proposal forces a reckoning: without global coordination, the race to develop ever-more powerful AI systems risks leaving humanity without the means to control them. The question now is whether governments and corporations will heed the warning—or whether the accelerator will remain pressed to the floor.
Follow us for live European news
2 further sources not geolocated