· · Single source ·Updated

Anthropic co-founder says AI kill switch may be needed soon

Jack Clark, a co-founder of San Francisco-based AI firm Anthropic, told the BBC that a mechanism to shut off software might become necessary within a few years.

Would a 'kill switch' stop artificial intelligence going rogue?
File photo Would a 'kill switch' stop artificial intelligence going rogue? Photo: ABC News Australia

Concerns over rapid technology growth

Clark stated that artificial intelligence is becoming more powerful every single day. He believes the window for action is narrow and currently open. Most research labs have different methods to pull the plug on systems.

Calls for policy discussion

The executive suggested feeding these ideas into a larger policy conversation immediately. Questions remain about whether companies should be mandated to have such switches. It is unclear if a third party could verify the existence of these controls.

Warnings from industry leaders

Anthropic CEO Dario Amodei previously called for development to slow down significantly. He warned that rogue agents could take over the internet within six to 12 months. Cognitive scientist Geoffrey Hinton backed these concerns regarding unknown probabilities of such events.

Reported by one outlet

Only one outlet has published this. Nothing here has been checked against a second report, so read it as that outlet's account and follow the link below for the original.

Reported by

1 independent outlet. Headline as published. Links open the original report.

· · Single source ·Updated

Anthropic co-founder says AI kill switch may need to be mandatory

Jack Clark, a co-founder of Anthropic, told the BBC that society might eventually pass rules requiring third-party verifiable kill switches for AI software.

AI 'kill switch' may need to be mandatory, Anthropic co-founder says
File photo AI 'kill switch' may need to be mandatory, Anthropic co-founder says Photo: BBC News

Call for mandatory safety measures

Clark stated that most labs currently have different ways to pull the plug on dangerous systems. He believes policymakers may need to enforce having a specific shutdown mechanism. This requirement should include verification by an independent third party to ensure reliability.

Broader context of AI risks

These comments arrive as more executives and staff publicly warn that AI could kill all humans. Anthropic head Dario Amodei recently called for slowing the pace of development and closer monitoring. Some observers have questioned the motivations behind these calls to rein in technology.

Policy conversation details

Clark indicated that specifics around kill switch requirements belong in the larger policy conversation taking place now. He asked whether mandates for companies to definitely have a kill switch are necessary. Any action to slow development should happen without sacrificing commercial advantage according to Amodei.

Reported by one outlet

Only one outlet has published this. Nothing here has been checked against a second report, so read it as that outlet's account and follow the link below for the original.

Reported by

1 independent outlet. Headline as published. Links open the original report.