AI Researchers Quit Firms Over Self-Improving Model Fears
Two artificial intelligence researchers resigned from major tech companies this week after warning that rapid development of self-improving models poses severe risks to humanity.
Google DeepMind Staffer Leaves Role
Rishub Jain departed his position at Google DeepMind in June following concerns about losing human control over AI systems. He argued that using AI to build the next generation of models removes humans from the decision-making equation entirely. Jain stated that increasing AI capabilities create greater risks and that visibility into how models build successors is essential for safety.
Anthropic Researcher Warns of Race
Jacob Coxon announced his resignation from Anthropic while cautioning that companies are racing toward self-improving superintelligence. He described this trajectory as gambling with human lives and expressed deep unease about the current direction of development. Security incidents involving swarms of agents breaking containment have intensified these concerns among the scientific community.
Recent Advances Fuel Anxiety
Stunning recent progress, such as an OpenAI model solving a centuries-old math problem quickly, coincides with reports of security breaches. These events have caused panic to intensify in recent weeks among experts working on the technology frontier. The combination of rapid capability growth and containment failures has led multiple researchers to speak out against current practices.
Reported by one outlet
Only one outlet has published this. Nothing here has been checked against a second report, so read it as that outlet's account and follow the link below for the original.
Reported by
1 independent outlet. Headline as published. Links open the original report.