AI could kill all humans in next decade, warn experts: but how seriously should we take them?

A safety expert at Anthropic believes there is a greater than 10% chance that AI could spark an event that wipes out humanity. Illustration: Ales Utouka/Alamy View image in fullscreen A safety expert at Anthropic believes there is a greater than 10% chance that AI could spark an event that wipes out humanity. Illustration: Ales Utouka/Alamy AI could kill all humans in next decade, warn experts: but how seriously should we take them? Alarming warnings from industry insiders increase pressure for curbs on artificial superintelligence Does artificial superintelligence really pose a risk greater than nuclear weapons? Is there a significant chance of “a Chornobyl-sized catastrophe”. Might there even be a greater than 10% chance that AI could “kill all humans” in the next decade? These warnings were issued over the past 48 hours on both sides of the Atlantic about the potential impact of a technology that most people still think of as a more talkative search engine. Some of the threats were raised in the UK as MPs and peers began to wrestle with the danger of AI outperforming human capabilities. The nuclear warnings came from Des Browne, a former defence secretary, and Prof Stuart Russell, an eminent Berkeley computer scientist. Beatrice Fihn, who won the 2017 Nobel peace prize for leading the International Campaign to Abolish Nuclear Weapons, told parliamentarians: “It is not the first time we’re confronted with abilities that could end up killing us all.” The session on Monday was convened , a lobbying group pushing for international regulation of the technology. It is backing a bill tabled in parliament this week (ASI). On Tuesday night, a senior employee at Anthropic admitted he believed there was a greater than 10% chance the technology could “kill all humans” in the next decade and warned that his AI company did not have a plan to ensure ASI was aligned, meaning it did no harm. Predictions for when ASI might be reached vary from several years to more than a decade. Evan Hubinger, alignment science lead at Anthropic, posted the comment after Jacob Coxon, a 28-year-old researcher at the San Francisco company and previously at OpenAI, resigned, claiming “neither company was acting responsibly”. He said they were “gambling with our lives”. Coxon said the risks at Anthropic were well understood but they were “locked in a race to get there first”. In a glimmer of hope, he added that he was optimistic about the potential for coordination between US labs on pacing their progress in the race.