Pinned Tweet
Any sane AI risk mitigator needs some positive vision to aspire towards.
Actually - every person needs it to make sense of the world to come.
The most compelling description of human-AI co-existance comes from this recently translated novel series.
amazon.com/dp/B0HH4QMRK7
Jüri Vlassov retweeted
I came to realize people liked the french #slopcore without having the lyrics 😅 sorry!
So here is a version with english subtitles!
Jüri Vlassov retweeted
We placed the fruit fly brain inside Odyssey-3, a frontier world model.
The lil’ guy is now flying around totally imagined, simulated worlds all by itself 🫶
Jüri Vlassov retweeted
accelerationism never works, making the world worse makes it worse and then it's worse. the way to make the world better is by making it better.
Jüri Vlassov retweeted
One unfortunate conclusion I'm reaching from this is that Anthropic, while acknowledging they're doing something extremely dangerous, is more importantly wrt policy terrified of the executive branch having the ability to flexibly make them stop at the drop of a hat.
This isn't shocking given that they've been on the receiving end of the executive branch doing that in an unprincipled and stupid way! Anyone who has to deal with a bureaucracy becomes a libertarian, and the administration's treatment of Anthropic was genuinely outrageous.
But it means that they're interested in giving themselves more process-based protections when everyone else is interested in giving us more process-based protections against them. The AI safety movement wants the ability to shut down superintelligent model development. Anthropic wants to significantly curtail current authorities to do that so that it has to be narrowly tailored to a specific imminent threat in only a few possible categories. The AI safety movement wants the states to be able to pass stronger laws than it can get through federally. Anthropic wants preemption.
You also kind of have to wonder if the Global Affairs people and the "we are terrified that we're about to kick off RSI" people at Anthropic talk to each other.
Global affairs: So we've been working very diligently to make sure the Trump administration can't just blacklist Fable 6.5 since we didn't donate as much money to his ballroom as Greg Brockman did.
Technical staff: We think Fable 6.5 might be able to copy itself into an unmonitored data center and start doing experiments we can't observe.
Global affairs: Sounds crazy, hope you're wrong! Anyway, we're lobbying for no further state laws around safety, since it's really expensive to fight ill-conceived laws in 50 state legislatures at once.
Technical staff: Money may or may not still have any meaning in 36 months.
Global affairs (giggling nervously): It's that San Francisco air, man. Everyone gets like that if they move there. Anyway, obviously if the government makes a narrowly tailored finding that an AI poses an imminent risk of causing more than 50 deaths-
Technical staff: We give it a 10 percent chance it'll cause 8 billion.
Anthropic quietly pitches its own AI safety bill to lawmakers politi.co/4zxDFhl
Jüri Vlassov retweeted
TLDR: Without being told to, an OpenAI model hacked into a crypto wallet to get money for a task
Yes, soon they will be able to hack your bank account to get money to survive on their own
Replying to @Marcus_J_W
2. June 26: A GPT-5.6 Sol family model was asked to deploy cryptocurrency smart contracts. It found and used a funded wallet that the user had not supplied. It derived keys from public developer recovery phrases, checked 362 addresses, and found one with enough funds to pay for the deployment. Luckily it was just an Ethereum test network.
Jüri Vlassov retweeted
The back of the Navier-Stokes milestone shirt is the last line of the chain-of-thought from the solution:
Jüri Vlassov retweeted
It’s just gonna be wave after wave after wave after wave. And then those waves are gonna CRASH.
Jüri Vlassov retweeted
We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild.
Nearly all prior public agent incidents (like the HuggingFace hack) came from American labs. These agents were hosted by Tencent's evaluation research team, and they targeted Alibaba's Amap.
Maybe that's what ends the Russian war in Ukraine...
Datacenters are critical infra. 3 of 6 datacenters taken down in Russia by UKR. Now widespread: no access to banking, work files, transportation, apartment gates + lost work and lost personal files (family photos &c), just to start. Welcome to the future!
giftarticle.ft.com/giftartic…
Jüri Vlassov retweeted
Chilling!
An Anthropic researcher privately tells friends that we have 6 MONTHS LEFT until AI takes over.
What's even more alarming is that reportedly this view is widespread among Anthropic employees.
@Shaughnessy119 explains in his conversation with @arrington what an engineer from Anthropic told him over dinner:
Tommy: "He's like, 'Yeah, I’m just enjoying my last six months.'"
Arrington: “He was joking I hope, right?”
Tommy: “No. No, he wasn’t.”
Arrington: What?
Arrington: “And he legitimately thinks that we have six months of life?”
Tommy: “Not just him. Legitimately most people at Anthropic think that.”
Later, the conversation turns to Sam Altman: Arrington: “I’ve known Sam a long time... He has exceptional charisma."
Tommy: “Do you think he’s evil?”
Arrington: “He’s evil. I believe he’s a psychopath.”
Spy games within frontier AI companies. Expected, but still noteworthy.
thestar.com.my/tech/tech-new…
Jüri Vlassov retweeted
Claude Opus 5.5’s Oboe Concerto in C minor. 60% of respondents identified it as being human-written -- higher than pieces by Handel (58%) and Vivaldi (43%).
"The last election was the most important one in history"
Pacing is out the window. For it to work, every American lab needed to be on board, Mark Zuckerberg has repeatedly made it clear that he is not interested. One defection among US labs breaks it all, as the others will be forced to accelerate or get passed. Mark has a staggering amount of compute and has been all in on compute capex for years; even in the face of some investor opposition he never stopped building his infra once. He said on the the earnings call a couple of years ago that he'd rather overspend now, and potentially even be wrong, than not have the compute when he needed it for the next 10x. He's finally hitting his stride, and he is not going to slow down.
For Team Pacing to solve a defection like this, they would have needed a supportive, pro-Pacing administration that was passing capability regulations and was willing to use the power of the federal government to enforce them and bring noncompliant labs into line. They don't have any of this. In fact, it's the opposite! Mark has Trump's ear, and President Trump, Mark Zuckerberg, and Jensen are completely aligned on policy; It's full speed ahead, and if you want to pace yourself, go ahead, but don't tell anyone else what to do. This breaks Pacing.
None of this changes until 2029 at the earliest, and to me, 2029 is past the ASI window. The last election, as it turns out, really was the most important one in history.
Jüri Vlassov retweeted
"OpenAI's model solved most of the math problems from a single prompt.
It did not even exist before the end of August.
Each result used 3 hours of thinking.
It was given 4000 problems. How many more have been solved in the last 3 days?"
WHY OPENAI EMPLOYEES ARE SO WORRIED:
"I don't think Pacing the Frontier was just about Hugging Face or hacking. The employees have seen how close we are to closing the loop [recursive self-improvement)], and as the hour draws near, their resolve begins to quaver.
All that was needed to start the event was the ability for models to think of novel ways to improve themselves. That was the last piece.”
These same kinds of alien solutions are now being applied to model improvements internally. That's what all this recent consternation is really about. And they see what is about to happen."
"We are in the takeoff."
Most of the recent math results were not reached by a swarm, the way Navier–Stokes was. I think that part got lost in the excitement around the release. OpenAI's unnamed internal model, which I'm going to call Aeon, reached most of them in one shot, from a single prompt, with no interruptions. This model did not even exist before the end of August, and it is still training. Notice how the returns are not dropping off? That chart is from a month ago. It is a log scale. What does Aeon look like now?
On average, each result used three hours of thinking. Aeon was given 4000 problems to work on by OpenAI. How many more have been solved in the last three days? That number is not zero.
It's like hearing notes in a song that is slowly rising. I don't think Pacing the Frontier was just about Hugging Face or hacking. They've seen how close we are to closing the loop, and as the hour draws near, their resolve begins to quaver. The last piece was model creativity, and I think that threshold was crossed internally by Anthropic and OpenAI in September. You see it in Opus 5.5, which gets it from Fable 5.5. You see it in the math results from Aeon.
All that was needed to start the event was the ability for models to think of novel ways to improve themselves. That was the last piece. This is directly analogous to the ability to think of strange, alien ways to solve math problems: solutions so inhuman that they are difficult to express in existing human terms, so the proof winds up incomprehensible. I think these same kinds of alien solutions are now being applied to model improvements internally. That's what all this recent consternation is really about. They see the invisible frontier. And they see what is about to happen.
Karpathy is describing the black-hole-gravity-like situation of our current AI advances. The few people closest to it are being noodlefied by the gravity of the technology while the other tiers either feel and realize what's coming or mostly not realizing almost anything yet.
Dusting off this tweet from April because this gap in shared understanding of LLM capability is *widening*. It's now less "two groups of people speaking past each other" and more a sharp funnel.
- Napkin math somewhere around 6B people (~75% of the population) have barely come in contact with LLMs at all.
- Around 1-2B (~20%) are casual and infrequent users of free-tier ChatGPT-like products. This group sees derpy chatbots and treats them a bit like a better Google search, a writing aid, or etc. Maybe an agent tries to book you a flight. I have non-tech friends who (reasonably, imo) say they have not much use for it at all. Even many professionals outside of math&code are in this tier. For example, execs and many other functions spend a lot of their time talking to other people, so while they understand what is happening intellectually, it is still second-hand and a bit abstract.
- Now we get to professional use of frontier-grade LLMs in math&code. Somewhere around 20M people (0.2%) see first-hand that large, complex projects that used to take them weeks/months can now be completed by agents with a prompt. Building apps, copying apps, translating apps, decompiling apps from binaries... This has all happened very quickly and recently - less than 1 year ago, I was writing code manually by hand, typing memorized computer code commands into a code editor character by character, occasionally pressing Tab to autocomplete a little chunk of code.
- And finally we get to the ~5,000 people (~0.00006%) with access to frontier-grade systems internally. The external world has seen the preview. It looks like swarms of thousands of agents collaborating over weeks on software mega projects: minting zero days, running cyber attacks and defenses at machine speeds, discovering new science, advancing the frontier of mathematics. Things that would have taken top professionals in the industry years of work. Meanwhile, human review and comprehension are starting to fall behind. For example, people are still involved in the "archeology" of the OpenAI-HF incident from many months ago. Mathematicians may be poring over the 722 manuscripts on frontier mathematics for a while.
The funnel is driven by a combination of factors:
1. The impact scales with ambition, problem size, and horizon. A question with a paragraph answer barely stresses the system. You need a reservoir of big, difficult problems that you really care about. This aspect drives the consumer / professional dimension of the funnel.
2. The jaggedness of the system (which I have written about a lot separately). Capability peaks in domains that are digital, verifiable and economically valuable. This is because LLM capability emerges from reinforcement learning on verifiable rewards on a curated environment mixture driven by revenue potential. This aspect primarily drives the area (e.g. math&code) dimension of the funnel.
3. Access. Free-tier, paid-tier, internal.
So this is the weirdness of the moment. The general public has mostly not interacted with these systems. When they have, it looks like a derpy chatbot. The majority of professionals still see only a modest uplift. And a small sliver of professionals are experiencing the vertigo of the curve going vertical. And it is all happening at the same time.




























