Pinned Tweet
To clarify:
- frontier AI companies clearly state they are building AGI
- from general to super intelligence (aka intelligence explosion), there is an unknown period (prob fast)
- controlling an ASI is virtually impossible
- why isn't this top of the global discourse?
In Seoul with @n_miailhe for the Global AI & Digital Summit, opened by my HKS classmate Sangbu Kim, @WorldBankGroup VP for Digital & AI. Inclusive AI and safe AI are the same project. Glad to be here building bridges between the development and safety communities.
Best perplexed face ever @romanyam 🤣
Cyrus 🌎 retweeted
"Anyone creating an ultra-intelligent machine anywhere is a threat to American national security, and so we need to somehow prevent that from happening[...] we need to start orienting to this the same way that we orient to preventing rogue actors from getting nukes."
Cyrus 🌎 retweeted
To stop the race for superintelligent AI, countries don't need to trust each other. They just need an agreement that can be verified.
@tonchimatta explains how and why such an agreement could work:
Cyrus 🌎 retweeted
Today the Senate is talking about rogue AI. We've seen AI agents hack private companies, government systems, and universities.
@SenHawleyPress kicks off today's hearing:
"It's time to have a conversation about who bears responsibility."
We're following live. 🧵
Cyrus 🌎 retweeted
Amidst all the buzz about AI problems, let's work hard on building solutions. Here's an amazing technical roadmap: arxiv.org/abs/2608.14611
Cyrus 🌎 retweeted
I was invited to address the @UN Security Council this afternoon to discuss the unprecedented threat posed by uncontrolled frontier AI agents.
Humanity has summoned the courage and wisdom to manage catastrophic risks before. This is one of those moments, far bigger than any personal, commercial, or national interest. The choices we make about this technology today will shape generations to come. We must act now.
Cyrus 🌎 retweeted
The President said, “whoever wins AI, wins.” This assessment is wrong. The reality is that whoever “wins AI,” AI wins.
AI agents have already gone rogue. Highly capable frontier AI and artificial superintelligence will outsmart humans and go beyond human control. And at that point, it won’t matter whether you speak English or Mandarin. We’re all in danger.
We need a global AI treaty now.
Cyrus 🌎 retweeted
"Godfather of AI" Professor Yoshua Bengio says recursive self-improvement — when AI will be able to create new models without human input — should be illegal. "We shouldn't even engage in this," he says.
Cyrus 🌎 retweeted
The world faces three existential threats:
Runaway artificial intelligence.
The climate crisis.
And the intolerable deepening of inequalities.
Next week, world leaders are coming together at #UNGA.
My message to them:
International cooperation is more important than ever.
Cyrus 🌎 retweeted
So @BillOReilly goes what about China?
They won't stop racing to build advanced AI?
And in 82 seconds, I have Bill agreeing with me that we should all just not build machines smarter than humans.
On 24 September Trump and Xi meet. One handshake could end the AI race before AI ends us. Add your name: trumpxideal.ai/
Cyrus 🌎 retweeted
I've never seen a species so enthusiastically racing to put in effort, energy, and money to develop something that would destroy the species. 😂
Cyrus 🌎 retweeted
Potentia: The total set of powers of the living system
Potestas: A bounding of a certain sub-set of the total powers, which done well leads to a net gain in the total robustness of the living system
potestas is emerging from myriad lab leaders and employees!
glorious, glorious
Cyrus 🌎 retweeted
Since we're doing AI risk again, people are questioning how AI could actually physically kill some or all humans.
This is a bit like people in February 2020 questioning how a relatively small virus outbreak could bring the whole world to a halt and kill tens of millions of people.
People are, in general, Trend-Blind.
They can see where things are now, but they can't extrapolate. At all.
AI today can solve math problems that are roughly at the level of the best human mathematicians in the world. 5 years ago, it could babble like a toddler.
Ok, that's the trend, but where is it heading.
In 5 years time, it's plausible that AI will be able to mount serious long-term espionage and cyber operations autonomously, and also run its own covert installations in various places around the world. It may be able to influence politics, media and global events.
At the same time, the world of 2031 may have a lot of robots - cars, drones, robotic security, military drones.
Could AIs in such a world go a head and "delete" all the humans? Yes, I think so. And the way that the final blow falls might not be that interesting - perhaps everyone's phone blows up because the factories that make phones were somehow coopted into putting explosives into the battery. Perhaps the drones that the police and military use will be hacked and go blow people up like they do to soldiers in Ukraine.
Starvation could be used too. Take down the services that keep society running and selectively destroy any coordinated attempts to fix them.
People don't understand how their own civilization works
The key difficulty for AI takeover isn't how to kill people (that is easy). It is how to take control of the systems that run society - politics, media, academia, finance, law enforcement, military - or at least prevent those systems from responding properly to attacks.
And those societal control systems that we rely on are not at all secure. They are all hackable. In fact they have all been hacked in various ways by various merely human entities. Some may even claim that humans have made the control system insecure on purpose so that elites can more easily extract value from society. Either way, that societal control system is what AI will attack if it wanted to end humanity.
"This is fucking serious" indeed!
Thanks Congresswoman Ansari 🙏
Tragically, when I first saw the movie “Don’t Look Up” in 2021, it struck a chord with me. I felt viscerally that humans would find ourselves in a comparable place one day - and soon.
If you haven’t seen the movie, I’d recommend it. A quick recap: Humans were explicitly warned that a comet that could destroy Earth was heading rapidly toward us. And instead of doing anything to stop it, the president, elected leaders and billionaire CEOs just spewed some bullshit about all the “jobs the comet would create.” The media treated the comet as casual entertainment. The public was split and the entire thing gets politicized. The movie ends with nearly all of human life wiped out.
Just about a year ago I had the opportunity to join a bipartisan freshman class breakfast with Sam Altman. I was shocked when he said to us, “in 18 months, I’ll trust artificial superintelligence to run my company better than I can.” I regret I didn’t engage more on this issue immediately.
Now here we are - it’s 2026 and engineers at the world’s leading AI companies are telling us that there is a >10% chance that artificial intelligence could kill all humans. They’re not mincing their words in the slightest. Not because of present day AI capabilities, but because it is evolving so exponentially that we could be in a doomsday scenario in a year. One year.
This is fucking serious. We need to halt new advanced AI development. We need guardrails, transparency and emergency powers. We need more employees at these companies to speak out publicly, loudly and fearlessly until everyone is forced to listen. We need the media to be covering this 24/7 until elected officials are forced to act. We need the Trump Administration to treat this with the urgency it deserves. We need the ability to shut an AI model off if there’s a credible threat to human life. The list goes on - and we don’t even know what the full list entails because this is all happening so fast. That’s why we need urgent, bipartisan public hearings and committees dedicated to developing and enacting solutions expeditiously.
This isn’t partisan. Let’s stop with the bullshit and come together for the sake of our shared humanity. I’m a 34-year-old Democratic Congresswoman, and I’d like to live to see my late 30s. I know my Republican colleagues want the same for themselves and their loved ones.
None of us can afford to be complacent about this any longer.
Thanks @FoxNews for inviting @hilbertspaess and for asking the right questions; we need to get to an international agreement on AI, even with perceived geostrategic enemies.
@WHOSTP47
Cyrus 🌎 retweeted
"So unfortunately we know how to control nuclear weapons pretty much, we don't yet know how to control AI. This is possibly the most dangerous technology that humanity has ever created. It's basically out of science fiction."
Me: Well, yeah, that sums it up.
ULTIMATE SUPER WEAPON: "This is possibly the most dangerous technology that humanity has ever created. It’s basically out of science fiction. I think we have no other choice but to cooperate internationally because an arms race would be disastrous in a way that no other human activity has been in the past." @hilbertspaess
@BretBaier presses former Anthropic and OpenAI researcher Jacob Coxon on the global threat landscape of artificial intelligence. Coxon warns that self-improving AI systems could become capable of taking over the world by the end of the decade if development isn't slowed down.



























