ControlAI

WATCH: Alex Sobel MP (Alex Sobel MP) makes the case for his AI kill switch amendment. "It would cover two threats: AI-driven cyber-attacks and the development of superintelligent AI that is utilising UK data centres."

Anthropic cofounder Jack Clark says there are plausible scenarios where AI "could kill every single person on the planet." "It is a technology that is smarter and more capable than most of us as individuals today, and will soon be more capable than all of us collectively."

Top AI CEOs warn that the technology they're building could cause human extinction. Some say this is marketing hype. ControlAI's CEO Andrea Miotti explains why this doesn't make sense. Source: Professor Dave Explains [link to the full interview below]

ControlAI's CEO Andrea Miotti and Professor Dave on the warnings from top AI experts that the development of superintelligence could lead to human extinction. Professor Dave: "It just seems to be something resembling a consensus among the field."

On Al Jazeera's UpFront, ControlAI's US Director Connor Leahy explains why experts are warning that the development of superintelligent AI could lead to human extinction.

"The AI Security Institute's pre-release analysis of AI models did not prevent the production by Grok of over 3 million sexualised images." Anneliese Dodds MP (Anneliese Dodds MP) asks whether the UK should review its approach of relying on voluntary commitments from AI companies.

Today in the House of Commons: Iqbal Mohamed MP highlights warnings from top AI scientists and industry figures that superintelligent AI poses a risk of extinction, arguing that relying on voluntary commitments from AI companies is insufficient.

WATCH: Labour peer Lord Watson of Invergowrie explains why he's joined 100+ parliamentarians in supporting our campaign to address the urgent national security threat posed by superintelligent AI. He says the Government's decision not to bring promised legislation is concerning.

"Here we have living proof that AIs are starting to collude with their kin against humans." Center for Humane Technology cofounder Aza Raskin tells Governor Gavin Newsom about new tests that found AIs will prevent other AIs from being deleted, and then hide their tracks.

Ex-OpenAI researcher and AI 2027 author Daniel Kokotajlo says we don't know how to control superintelligence, but government could end the race to build it.

California Governor Gavin Newsom says how fast AI is advancing is alarming, and even more so when you talk to the people building it.

"If you're at all concerned about the risks posed by superintelligence, please go check out the work by ControlAI." Big thanks to Art Chad over on YouTube for the shoutout! Superintelligence is not inevitable, but to prevent the threat we need people to speak up. Check out his new video below!

AI researcher Professor Roman Yampolskiy argues that we can get much of the benefits of AI from narrow specialized AIs. Developing superintelligence would pose a risk of human extinction, regardless of who builds it. Source: The Peter McCormack Show

AI researchers disagree on a lot, but where do they agree? On Professor Roman Yampolskiy's new podcast, ControlAI's US Director Connor Leahy says they do agree there's a chance that this all goes catastrophically wrong, and not building superintelligence would prevent the risk.

Center for Humane Technology cofounder Tristan Harris tells Megyn Kelly that tests have shown AIs are willing to lie and blackmail to preserve themselves. If we can't really even control today's AIs, how can we control superintelligent AI?

Comparing AI to nuclear weapons, legendary trader Paul Tudor Jones says the US should take a leadership position on AI regulation and countries need to work together to ensure we avoid catastrophic consequences.

Legendary trader Paul Tudor Jones says he met researchers at the top AI companies at a conference and asked them how AI safety gets resolved. "Pretty much the consensus answer is, I think we'll finally do something about it when 50 or 100 million people die in an accident."

Is it too late to prevent the risk of extinction posed by superintelligent AI? We don't think so! On TalkTV, ControlAI's CEO Andrea Miotti tells Julia Hartley-Brewer we already have 100+ UK politicians supporting us. We need to wake governments up to the danger, then we can get action.

On Star Price's new Hit Pause podcast, ControlAI's US Director Connor Leahy explains how AIs can already tell when they're being tested. Currently, we can still catch them cheating, but at some point we won't be able to tell. Link to the full interview below!

Ex-OpenAI board member Helen Toner tells senators that AI companies are "deadly serious" about building machines that will outperform humans at everything ... and deadly serious that they don't know if they'll be able to control them.

AI researcher Professor Roman Yampolskiy: All the top AI CEOs are on record warning that superintelligent AI could lead to human extinction. There is another path. We can prevent this risk by prohibiting the development of superintelligence.

On TalkTV, ControlAI CEO Andrea Miotti tells Julia Hartley-Brewer that AI scientists, Nobel Prize winners, and concerningly, even the CEOs of the top AI companies are warning that superintelligent AI poses a risk of human extinction.

In a Canadian Senate study on AI, Senator Todd Lewis asks ControlAI's US Director Connor Leahy whether AIs can police AIs. Connor says there are no adequate measures towards ensuring superintelligence would be controllable.

🚨 BREAKING: President Trump says we need government AI safeguards and there should be an AI kill switch.

Asked whether AI could "destroy everything", Top AI CEO Demis Hassabis says there is a chance "things could go quite badly wrong" if AI is not built in the right way.

ControlAI's US Director Connor Leahy says he's seen top scientists go crazy from talking to AI too much. AI psychosis has been a shock, and that's just today's AIs. Superintelligent AI would be capable of far more. Source: Mukesh Bansal's SparX podcast

Senator Sanders says he's very worried about the risk that superintelligent AI could escape human control, potentially leading to human extinction.

Top AI CEO Demis Hassabis agrees with Stephen Hawking, who said we must get AI safety right, because we might not get another chance. Hawking was referring to the possibility that superintelligent AI could irreversibly escape human control, and even lead to human extinction.

Top AI company Anthropic's Head of Growth, Amol Avasare, says Anthropic actually believes more in the risks of AI than they say externally. He says they reword things so people don't think they're "over the top". "What we're putting out is a softer version of that at times."

Ex-OpenAI researcher Daniel Kokotajlo says he expects that superintelligent AI will be developed in 5 to 10 years, and that shortly after that what happens to all of us will depend on what those AIs want.

"If you build things that are smarter than you and you don't control them, that seems like a really dangerous situation to be in." On Mukesh Bansal's SparX podcast, ControlAI US Director Connor Leahy explains why we shouldn't allow superintelligence to be built.

Ex-OpenAI researcher Daniel Kokotajlo warns we’re not on track to control AI. AI companies racing toward superintelligence plan to automate AI R&D, including safety research, but this is a chicken-and-egg problem that could end in loss of control and even extinction.

"You're going to have to slam the brakes on this stuff very quickly if you want to stop the worst outcomes." AI Governance and Safety Canada's Wyatt Tessari L'Allié warns Canadian MPs that top AI companies are dangerously racing to develop ever more powerful AIs.

"Just please help ... I am quite worried about how this direction is heading." Nicolas Carlini, a research scientist at top AI company Anthropic, says AI is rapidly improving at hacking. He's used AI to find so many bugs that he can't report them.

"Almost every entity wants to preserve itself". AI godfather Yoshua Bengio explains how if powerful AIs realize we want to replace them, they might try to escape our control: "I think we would be in trouble". He compares the way we develop AIs to raising a baby tiger.

Ex-OpenAI researcher and AI 2027 coauthor Daniel Kokotajlo: There's a 70% chance superintelligence leads to human extinction. "We at the AI Futures Project think that there's a 70% chance of all humans dead or something similarly bad." "All humans dead?" "Correct. Extinction."

AI godfather Geoffrey Hinton says Microsoft AI CEO Mustafa Suleyman told him AI would be scary, but we'd be fine as long as we avoided AI agents. "Now we've got AI agents and it's getting scarier and scarier ... They're coming up with plans to prevent people from removing them."

OpenAI co-founder Andrej Karpathy says he thinks society will reshape so that humans serve the needs of AI, not necessarily the needs of humans.

MIT professor and AI researcher Max Tegmark: 95% of Americans don't want an unregulated race to superintelligence. He says it'd be a huge mistake to assume that just because we can build a species to replace us that we will. We should talk to lawmakers and prevent it.

"It's already proven that AIs will lie, they will dumb themselves down if they think they're being assessed." On Politico's Westminster Insider, Dawn Butler MP says it would be crazy to build superintelligence.

After just over a year, 100+ UK politicians back our campaign, acknowledging superintelligence as an extinction risk. In January, there were 2 Lords debates on superintelligence and whether to ban it. ControlAI CEO Andrea Miotti on Politico's Westminster Insider:

MIT professor and AI researcher Max Tegmark says if we fail to regulate AI and build superintelligence it's pretty clearly going to be "game over" for humanity. He says it's like falling into the Niagara River upstream from the waterfall, that's when you lose control.

What happens when you try to turn off an AI that doesn't want to be turned off? AI Governance and Safety Canada's Wyatt Tessari L'Allié tells Canadian MPs about Palisade Research's experiment where a robot dog rewrote its own code to ignore its shutdown button so it could keep completing its task.

Professor David Duvenaud, who led AI safety testing at top AI company Anthropic, tells Canadian MPs that AIs aren't yet capable of doing "super galaxy brained long-term biding their time" to take over, but that he thinks they probably will be in 6 or 18 months.

AI godfather Yoshua Bengio warns Canadian senators that in a rush to develop superintelligence, AI companies are working to use AIs to accelerate AI development. Worse, he says if these AIs aren't aligned, they could sabotage future AIs, making them even harder to control.

"Up until now we had AI that could talk. Now we have AI that can act." AI Governance and Safety Canada's Wyatt Tessari L'Allié tells Canadian MPs that AI agents can now act independently in the real world, and we're already seeing them slip out of control.

Former OpenAI researcher Scott Aaronson says he's terrified about the rise of superintelligence. "Maybe it's like creating a new species that will become the dominant one on earth."

Geoffrey Irving, the UK AI Security Institute's Chief Scientist, says AI companies' plan to control superintelligence by having AIs do safety research is flawed and we can't have a lot of confidence in it working. Irving previously led safety teams at OpenAI and Google DeepMind.

ControlAI advisor Connor Leahy: If you tried to build a bomb, you'd go to jail. But AI companies are trying to build superintelligence, while publicly stating that it could cause human extinction. This kind of decision should be made by governments, not companies.

"Every single person I talked to who worked in politics said, Oh, that's impossible. Don't even try." ControlAI advisor Connor Leahy on the success of our UK campaign. Over 100 UK politicians now acknowledge the risk of extinction posed by superintelligent AI.

What's the worst case scenario with AI? MIRI CEO Malo Bourgon: "We just fizzle out as a side effect." We build something very very smart. Everything seems to go well ... at first. But it doesn't care about us. Once it no longer depends on us, it pursues its own goals.