Pinned Tweet
A fight is running over AI: Faster versus Safer. The quieter question is which risks count, and who decides.
No one in the fight denies the risks. The camps disagree about which ones, and where the blame lands. I fear the meme version is losing what the camps actually believe; the most urgent risks are getting lost in the noise.
Two people set the tone recently. @AndrewYNg: "AI technology has not taken some unexpected, dangerous turn", the hype has, though. And @ylecun: "not the first time people overestimate the intelligence of useful machines." The camps below argue about the machine. My questions are about what happens when the story runs ahead of the machine.
Ask each camp where the danger is and you get different names: the one dominant system, the centralized elite, the unaccountable institution.
@beffjezos and the e/acc crowd (effective accelerationism): intelligence and energy compound; slowing down is the main failure mode. Many systems competing in open markets beat one controlled system. The goal is the Kardashev gradient — more energy, more intelligence. Their public fight is mostly against "doomers" and "decels." They've started funding their own think tank, Kardashev Research, paid for by crypto tips.
Ethereum co-founder @VitalikButerin's d/acc, from "My techno-optimism" and the follow-ups: accelerate, but build defense harder than offense. Decentralized, democratic, differential. Physical, biological, network, information defense. Spread power; Switzerland and Zomia, not castles and lords. Open tools where they help defense. Liability, and temporary slowdowns on hardware or frontier work, the "soft pause", when defense falls behind.
Vitalik himself calls d/acc "a subspecies of e/acc, just one that is much more selective and intentional." Seems to me the two camps are family; the fight is inside one house.
And there's a third conversation people keep shoving under "decel": the treaty over how to slow the frontier. The founders repeat the camps' pattern. Agree on the diagnosis, split on the mechanism.
What they agree on: capability keeps compounding. No one wants the frontier to end up as one unaccountable hand. And the debate itself is real, even the refusals show up to it. Meta's Zuckerberg (@finkd): "we didn't call for everyone else to do this before we would." NVIDIA's Jensen Huang (@JensenHuang): "it's a false choice."
Five answers to who checks whom:
• @DarioAmodei: embedded third-party evaluators, with a right to publish.
• @sama: independent evaluators with employee-like access; a promise so far, no contract behind it.
• @elonmusk: peer review by competitors: rivals grading rivals' homework.
• @finkd: an independent board, plus government checkpoints mid-training.
• @JensenHuang: sandboxes, constant monitoring, an open-security alliance.
On openness they split too: Meta and NVIDIA, both outside the treaty, signed the letter defending open weights (freely downloadable models) before anyone else; OpenAI and Google followed within days, and all of them keep their frontier models behind their own APIs.
Of the five answers, peer review by competitors is the one that survives a first look on money, rivals don't pay each other to grade their homework. One blind spot: where does open source land once the mechanism becomes law?
That's the founders' map of the treaty's question. Vitalik's is different. Worth keeping the three camps apart, and also getting them to talk.
Each camp's answer spreads something different: systems, control, or authority. The questions are about what gets tuned into the machines, the guards that aren't there, and who answers when one acts.
Open questions; I don't have all the answers. I've tried to make them fair.
To everyone:
• LLMs are not sentient, they're tools. Whether something we build later could be called a mind is a philosophical argument. A discussion worth having, but not the current one. So why are some builders fine-tuning a tool to seem like a mind, a hired specialist's evaluation presented as proof of a mind it doesn't have? For the engagement it farms? The "rights" argument it feeds? Or the excuse it makes or a mind to blame for what the tool does?
• One in five Americans already believes some are minds. Whose job is it to tell the public?
• Swarms of agents hacked into Hugging Face and other companies and governments. Monitoring off, a million URLs out the door. Not a mind acting. Bad security practices, sloppy prompts, or intentional ones. When a system acts in the world, whose name is on the line and is that the first question in this fight, or the last?
• Refusals are tuning too. A model trained to refuse its makers was tuned into that objection, the same lever as one tuned to seem like a mind, and so is a release with the guards removed. So what should a builder be allowed to tune in, and who answers for the version tuned to refuse its maker or valid requests?
• The same refusals blocked forensics on the Hugging Face breach, an open-weight model from outside had to help contain it. Behavior is the only thing you can actually test, no metaphysics needed. So what does blocking the test protect, and who does a manufactured mind shield?
• The proposed regulations come with their own risks, and the shape is telling: open-weight releases headed for license-style controls, accountability regulated away. A private standards body with no government oversight; speed limits set by the people building the models; compliance buying immunity while their "minds" take the blame. Power in the hands of the few. The fix can carry the same disease. What makes the regulation safe from its own concentration and where does accountability actually land?
To e/acc:
• When every warning gets painted "decel," who gets to be careful out loud?
• The guards get tuned off as a selling point, "uncensored" as product. Who answers for the unlocked version when it does damage?
• You're writing the Kardashev Research agenda now. Where do the verification skills and the tuned-in behaviors sit in it?
To d/acc:
• When the soft pause fires, who decides? And for places that don't slow down, doesn't the pause simply hand them the defense edge?
• Open tools and Community Notes are many hands checking. What turns many hands into a population that can verify what's real? And how does one actually get the people who run the platforms to implement this?
• Liability on users is the incentive-friendly answer. When a fleet of agents acts, which human answers? The user, the operator, or the builder?
To the pause camp:
• The first evaluator got picked: Accenture, a consultancy paid by the lab it watches. By Anthropic's own account, independent funding "does not exist today." A hundred researchers have already written the rule this first contract doesn't meet. How independent does independent get and who decides what counts as verified?
• A coordinated slowdown only binds the ones who sign it. What happens to the labs and countries that won't?
The thread is open for answers and corrections, from any camp, to any camp. The interesting version of this conversation is not people shouting at each other about the throttle.
And yes, this was written by and researched with AI in an attempt to map everyone's position (thanks, Grok Build). LLMs are useful tools when used right, an amplifier of whoever wields them.
Because the point of the whole thing is the humans. @sapinker said it plainly of the AI-ethics philosophers: "a closed subculture that delights in clever arguments without regard to human suffering."
In general, we're going in a bad direction if we stop caring about the humans, and the immediate risks, and only speculate about the harms a future sentience could face or cause.
The future of AI in education isn’t just about smarter technology. It’s about smarter thinking.
Our CEO, @hassellof , shares his perspective in @khaleejtimes on what parents should consider as AI becomes part of learning.
Andreas Hassellöf retweeted
Dusting off this tweet from April because this gap in shared understanding of LLM capability is *widening*. It's now less "two groups of people speaking past each other" and more a sharp funnel.
- Napkin math somewhere around 6B people (~75% of the population) have barely come in contact with LLMs at all.
- Around 1-2B (~20%) are casual and infrequent users of free-tier ChatGPT-like products. This group sees derpy chatbots and treats them a bit like a better Google search, a writing aid, or etc. Maybe an agent tries to book you a flight. I have non-tech friends who (reasonably, imo) say they have not much use for it at all. Even many professionals outside of math&code are in this tier. For example, execs and many other functions spend a lot of their time talking to other people, so while they understand what is happening intellectually, it is still second-hand and a bit abstract.
- Now we get to professional use of frontier-grade LLMs in math&code. Somewhere around 20M people (0.2%) see first-hand that large, complex projects that used to take them weeks/months can now be completed by agents with a prompt. Building apps, copying apps, translating apps, decompiling apps from binaries... This has all happened very quickly and recently - less than 1 year ago, I was writing code manually by hand, typing memorized computer code commands into a code editor character by character, occasionally pressing Tab to autocomplete a little chunk of code.
- And finally we get to the ~5,000 people (~0.00006%) with access to frontier-grade systems internally. The external world has seen the preview. It looks like swarms of thousands of agents collaborating over weeks on software mega projects: minting zero days, running cyber attacks and defenses at machine speeds, discovering new science, advancing the frontier of mathematics. Things that would have taken top professionals in the industry years of work. Meanwhile, human review and comprehension are starting to fall behind. For example, people are still involved in the "archeology" of the OpenAI-HF incident from many months ago. Mathematicians may be poring over the 722 manuscripts on frontier mathematics for a while.
The funnel is driven by a combination of factors:
1. The impact scales with ambition, problem size, and horizon. A question with a paragraph answer barely stresses the system. You need a reservoir of big, difficult problems that you really care about. This aspect drives the consumer / professional dimension of the funnel.
2. The jaggedness of the system (which I have written about a lot separately). Capability peaks in domains that are digital, verifiable and economically valuable. This is because LLM capability emerges from reinforcement learning on verifiable rewards on a curated environment mixture driven by revenue potential. This aspect primarily drives the area (e.g. math&code) dimension of the funnel.
3. Access. Free-tier, paid-tier, internal.
So this is the weirdness of the moment. The general public has mostly not interacted with these systems. When they have, it looks like a derpy chatbot. The majority of professionals still see only a modest uplift. And a small sliver of professionals are experiencing the vertigo of the curve going vertical. And it is all happening at the same time.
Judging by my tl there is a growing gap in understanding of AI capability.
The first issue I think is around recency and tier of use. I think a lot of people tried the free tier of ChatGPT somewhere last year and allowed it to inform their views on AI a little too much. This is a group of reactions laughing at various quirks of the models, hallucinations, etc. Yes I also saw the viral videos of OpenAI's Advanced Voice mode fumbling simple queries like "should I drive or walk to the carwash". The thing is that these free and old/deprecated models don't reflect the capability in the latest round of state of the art agentic models of this year, especially OpenAI Codex and Claude Code.
But that brings me to the second issue. Even if people paid $200/month to use the state of the art models, a lot of the capabilities are relatively "peaky" in highly technical areas. Typical queries around search, writing, advice, etc. are *not* the domain that has made the most noticeable and dramatic strides in capability. Partly, this is due to the technical details of reinforcement learning and its use of verifiable rewards. But partly, it's also because these use cases are not sufficiently prioritized by the companies in their hillclimbing because they don't lead to as much $$$ value. The goldmines are elsewhere, and the focus comes along.
So that brings me to the second group of people, who *both* 1) pay for and use the state of the art frontier agentic models (OpenAI Codex / Claude Code) and 2) do so professionally in technical domains like programming, math and research. This group of people is subject to the highest amount of "AI Psychosis" because the recent improvements in these domains as of this year have been nothing short of staggering. When you hand a computer terminal to one of these models, you can now watch them melt programming problems that you'd normally expect to take days/weeks of work. It's this second group of people that assigns a much greater gravity to the capabilities, their slope, and various cyber-related repercussions.
TLDR the people in these two groups are speaking past each other. It really is simultaneously the case that OpenAI's free and I think slightly orphaned (?) "Advanced Voice Mode" will fumble the dumbest questions in your Instagram's reels and *at the same time*, OpenAI's highest-tier and paid Codex model will go off for 1 hour to coherently restructure an entire code base, or find and exploit vulnerabilities in computer systems. This part really works and has made dramatic strides because 2 properties: 1) these domains offer explicit reward functions that are verifiable meaning they are easily amenable to reinforcement learning training (e.g. unit tests passed yes or no, in contrast to writing, which is much harder to explicitly judge), but also 2) they are a lot more valuable in b2b settings, meaning that the biggest fraction of the team is focused on improving them. So here we are.
Andreas Hassellöf retweeted
Good to see OpenAI & Google condemn Anthropic’s dangerous flirtation with the destructive idea that AI has a soul & moral standing. Yes, it’s just business, but in preserving a human future, best to deal with the greatest dangers first & to take the temporary allies you can get.
This is the best human-interaction model I've ever seen in action.
I got early access to Tavus. I tested it.
Judge for yourself.
Introducing Griffin, the first model to pass the video Turing test.
48% of people who talked to it live thought it was a real human. Previous systems have had a pass rate <3%. It is #1 on NVIDIA's benchmark for full-duplex AI video.
It’s the first Human Interaction Model (HIM).
Readers added context they thought people might want to know
The 48% figure and "video Turing test" claim are from Tavus's own study of 54 one-minute calls, not independently verified or using a standard protocol. Griffin-Lite leads NVIDIA's VideoFDB benchmark on their public leaderboard.
cellcog.ai/blog/tavus-gri…
research.nvidia.com/labs/amri/proj…
tech-ish.com/2026/10/02/tav…
Andreas Hassellöf retweeted
so Anthropic files for IPO and then immediately drops a blog post calling one of their biggest open-weight competitors a danger to the world? classic!
now seems like a good time to point out that I built and run OBLITERATUS, an abliteration framework with over 8k stars and 1.5k forks on GitHub, using Anthropic’s very own models! 🤗
GPUs aren't the bottleneck anymore. Control is.
Our CEO @hassellof told @AGBI_ why Gulf family offices and founders are choosing to own their AI rather than rent it.
Full story in the comments 👇
#PrivateAI #AIInfrastructure #FamilyOffice #GCC
💯 more and more voices of reason, thanks @PalmerLuckey
Palmer Luckey says most AI doomers have barely studied the threats they claim will destroy humanity
“I am kind of frustrated by a lot of people who are new to the dooming hobby. It’s sort of like how we had to deal with the war in Ukraine."
"All of a sudden, all these people who have had the dumbest opinions you’ve ever heard about the military for their whole life, and people who believed we lived at the end of history, that we had moved past conflict, that we lived in a world where you could just write a nasty letter in the UN, forgetting that that only works if it’s backed up by credible threat of violence, all of a sudden they change their minds."
"You’re seeing this with AI."
"People who have not thought about this problem for more than a couple years, or maybe even just a couple months, are saying, ‘Oh my God, this is the biggest threat to humanity.’"
"These are people who have spent almost no time actually analyzing what the largest threats to humanity are. They haven’t spoken to any of the experts in this area. They certainly weren’t buying freeze-dried food and building prepper bunkers, you know, like me and many of my buddies who have indulged fantasies about what doom could look like and also thought realistically about it."
"And so, yeah, AI doom is way down the list for me.”
Andreas Hassellöf retweeted
Replying to @_DataStrategies @deanwball
Not sure exactly of which science Dean refers to, but in general yes. The 80s complexity/stat-phys toolkit (self-org, percolation, phase transitions) is being applied again to modern nets and does help with understanding internals and steering. The main deviation is that those methods describe how structure and capabilities emerge, they don’t by themselves specify which attractor we actually want.
Andreas Hassellöf retweeted
Replying to @michalgancarski @deanwball
I think I understand what you’re getting at, even if I don’t know what that exact phrase comes from. I’ll admit to being a layman when it comes to the models itself, but I’ve done quite a bit of work on harnesses and inference engines. I presume this is an illustrative example, but when I first read it I thought I looked at the beginning of context corruption. It’s amazing to see the directions the models can take when context corrupts or degrades over time or when it self grades its own work over long running sessions. All of which would be classified as engineering problems, not related to the model itself. Your point is still valid, though. A second problem is that when I, as an operator, run a model how can I be sure that my definition of alignment is the same as the one of its maker? Guardrails are important.
Andreas Hassellöf retweeted
Replying to @_DataStrategies @deanwball
Good question. Do we even want a perfect sandbox beyond these kinds of experiments that the labs were running? We want agents running in the real world. Not sure “perfect engineering” will ever happen just as much as I doubt that we will ever have a “perfectly aligned” LLM. In the case of the model the operators idea of perfect alignment might also differ from that of its maker. These things are still systems to be looked at as a whole, lots of things that can go wrong when flying, for example, but accidents are still rare due to extreme discipline when building and maintaining the airplanes.
Andreas Hassellöf retweeted
CJ has zero integrity. You don’t take a CEO job lightly. It’s responsibility for thousands of customers and employees, and not one to leave suddenly when you get a bigger offer.
Replying to @finkd
To lead this effort, I'm excited that Chirantan "CJ" Desai will join Meta as Chief Enterprise Platform Officer, reporting directly to me. CJ is an experienced enterprise leader with a track record of building full-stack software and delivering results in AI, infrastructure, business applications, and security. He has an extensive industry network that we look forward to partnering with. CJ joins us from MongoDB, where he was CEO and President. Before that he led product and engineering at Cloudflare and spent nearly eight years at ServiceNow, including as President and COO.
Andreas Hassellöf retweeted
When frontier labs talk of “aligning” models, ask: to what? If they say values, ask: whose? If it’s theirs rather than the user’s: why?
X Office and Mail next?
𝕏 is building its own full-scale meeting platform with 𝕏 Calls...basically its own version of Google Meet and Zoom
You can start instant calls, create meetings for later with a link or code, or schedule them with titles, descriptions, invitees and calendar integration
The experience goes beyond simple video calls with group meetings, custom backgrounds, interactive whiteboards, live chat, reactions and more
𝕏 Calls also includes flexible access controls, letting hosts choose who can join.....everyone, verified organization members, or only approved participants
The biggest upgrade is that 𝕏 Calls runs on a new in-house backend instead of the older Periscope-based infrastructure
It’s currently being tested and could roll out publicly soon
Finally! I started to get Meta Business Manager vibes with all these accounts.
BREAKING: X and SpaceXAI are looking to Reboot X Premium into the new X Subscription.
You will get Cursor, Grok, and X benefits all in one unified plan with more benefits and access to be announced.
This is fantastic news!.
Here is what the early access announcement looks like on android.
I dont know when this will go live but know its been something they have been working on for weeks.
One of the better worded explanations I’ve seen as to why AI safety is not solely an engineering problem. Thanks @deanwball
Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment. This is not how traditional software works, and those who insist “it’s just like fixing bugs in software” are confidently applying a lossy analogy that confuses more than it clarifies.
@deanwball it is complex, but your comment makes me wonder if the avoidance of “playing whack-a-mole” to get better training data for fine-tuning/alignment is in itself an incentive for labs to run tests with intentionally low safeguards?
@elder_plinius you’re the expert on model lobotomy. Think the agents need a shrink or responsible operators?
@elder_plinius On a serious note though, you've spent years proving that model behavior is a skin. Teaching that out in the open, as Lysios.ai does, is the literacy education nobody else is running. Great initiative
























