Living at the frontiers of managing talent and culture
Toronto, Ontario
Joined November 2007
- Tweets684
- Following236
- Followers266
- Likes305
dcreelman retweeted
Last night was the first night I genuinely couldn't sleep because I was so excited to get back to reading an AI-generated proof (of the Grothendieck homotopy hypothesis).
Hard not to feel shellshocked, of course, but the feeling of "touching the infinite" is pretty palpable.
We’re releasing a broad range of new mathematical results produced by an internal frontier model.
We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results.
github.com/openai/math
dcreelman retweeted
On AI capabilities: the French press is all over the Haitian-Canadian novel C’était ça ou mourir. It's winning basically every award you can win, and was tipped to be the 2nd Canadian winner of the Prix Goncourt. Only one problem: 1/2
dcreelman retweeted
Mathematician Terence Tao:
"we have to slow down AI. the pace is insane, and there's no reason to be this fast — no reason at all"
It's amazing how willing we are to change everything without any idea what happens afterward
These are extremely nonlinear dynamics
dcreelman retweeted
Late 2026 will be remembered as the most excruciating period in AI progress, when OpenAI and Anthropic basically had us over a barrel.
It's so demoralising waiting for the tokens to reset just to be able to get any work done. I'm starting to think I made a massive error building so many systems on top of AI.
During the times of token abundance, we rearchitected everything to use AI, now in the dark times we are utterly dependent and desperate. It's practically impossible to get anything serious done without frontier tokens, not least of which because using the frontier models even for a short time creates psychological dependency and complexifies our systems to the degree that requires their continued usage. They hooked us on their product, then started turning the screws.
My Fable usage (finally) reset on one account, that was single-shot gone in about 1 hour. Left in a bad state, so I purchase £150 of credits to finish the job in Opus 5 fast (normal Opus is intolerably slow, like watching paint dry). That was then eaten up in less than 1 minute?! @bcherny ?? Bug?!
Using subscriptions at frontier-level has basically become impossible, Astra/Fable API prices are a joke (£100 every 10 mins), and there are no decent alternatives or competition. Now I don't even trust Anthropic to purchase more fast Opus tokens.
Astra is basically unusable too @thsottiaux, a weekly subscription drained in about 2 hours (3 if I am lucky). No more pro accounts. No more resets either.
I can't even use AI on my phone now, because - guess what. Out of tokens everywhere! None of my remote stuff works because I always have to juggle different accounts on different servers, and don't even have enough tokens to wire it up again. Everything is broken, and a total disaster. As for "automation", what's the point in automation if you can't do anything for more than an hour before it craps out and leaves you in a bad state?!
I have tried the alternative models like Muse 1.3, Gemini 3.8, Grok etc, nothing even comes close and they would probably do more harm than good in the codebase.
Contra "pace" - it's never been more important to accelerate AI competition and progress. It's a defacto cartel at this point, little wonder they want to maintain the status quo.
This situation is intolerable.
We were building for a future that we thought would have arrived by now, and here we are - frankly, up shit creek without a paddle.
dcreelman retweeted
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
dcreelman retweeted
OpenAI informally defined it as "highly autonomous systems that outperform humans at most economically valuable work" (openai.com/charter/) I would say we are still pretty far from that! (Not clear what they consider "economically valuable".)
dcreelman retweeted
After 40 inches of snow brought down Manhattan’s overhead wires during the Great Blizzard of 1888, the city buried them.
Toronto in 2026 is vastly richer and more technologically capable than New York was then, yet doing the same here is now prohibitively expensive due to closed procurement, rigid union rules, layers of approval, and political interference. Together, these have greatly diminished our capacity to build.
Toronto Hydro outage map shows 65,000 without power after huge storm
blogto.com/city/2026/09/toro…
dcreelman retweeted
GPT-6 Astra represents a step-function change in model capability for interactive reasoning problems. It scores 66% on ARC-AGI-3 using our standard harness, and nearly 100% with a continuous conversation harness and custom compaction, at a cost of roughly $360 per game.
In fact, the continuous harness version significantly outperforms our human baseline in action efficiency across almost all levels. When we examined the reasoning chains to understand how the model operates, we found it performing highly efficient, on-the-fly symbolic world modeling for each game and level. It goes as far as developing its own shorthand DSL to represent in-game situations -- essentially a game-specific algebraic notation.
Overall, Astra exhibits symbolic modeling behaviors we had previously only seen with sophisticated harnesses -- so harness capabilities are increasingly shifting into the model itself.
We see Astra as a major breakthrough in model intelligence.
Read our post on Astra and what these results mean: arcprize.org/blog/astra
dcreelman retweeted
Neoclouds have limited cybersecurity. Next time agents successfully go rouge, they'll try taking over a neocloud to run more copies. This is bad.
Thus: neoclouds should greatly strengthen their cybersecurity and every company with strong cyber models should help with that.
dcreelman retweeted
Here's another way to think of the AI development situation:
Soon it will be possible to make literal superintelligences that will be vastly more powerful than any country or corporation ever has been.
There's an enormous temptation for those in power, or for those who want power, to try to create and harness such entities.
Definitely people will try. I don't just mean people will try to make superintelligent tools. No. People will try to make machine gods which serve their creators, so they can dominate, or reshape the world how they wish. Others might try to make machine gods to stop other people from making machine gods, or create the machine gods to serve individual freedom and agency.
Regardless, powerful people, countries, companies, will try to create superintelligent entities.
The people who started Deepmind, OpenAI, xAI, and Anthropic all understood this. Ilya, Sam, and Elon's early emails talk about the importance of preventing Demis from forming an "AGI dictatorship". Elon called it summoning the demon. Their response was to try to be the ones to build it first.
It looks more and more likely that superintelligence is possible, and not that far away if companies keep outright racing for it.
It seems less and less plausible that anyone will actually be able to control it or harness it, given the actual state of AI alignment science, if you can even call it science. It's just really hard to understand how to shape the motivations of a growing intelligence.
This is the AI development situation. The correct response, in my view, is to immediately stop frontier development and negotiate an international ceasefire. Stop trying to build machine gods. Then, pour enormous amounts of computational resources into understanding the entities we're training.
We should not trust anyone in power to voluntarily resist trying to build superintelligence. Not AI companies, not Chinese government, not the US government. We should all be terrified that someone else will defect, and try to rush to build the machine gods that might afford ultimate power over everything, even though the gift is poisoned.
So we need radical transparency. We need to know what's running in every datacenter, so we know no one is trying to rush to build god.
If we do this, we can continue to reap enormous benefits from the insanely capable agents we've already made. We can get the scientists of the world together and debate when and how superintelligence development should be resumed, and what guarantees could be made that machine gods would not dominate humans.
I usually don't use the phrase "machine gods" because it sounds too mystical. But superintelligence doesn't properly convey the optimization power that is being summoned. I don't mean something mystical. I mean extremely competent, inhumanly competent problem solving and strategy. In a handful of days, OpenAI's agents executed a massively parallel hacking campaign against Hugging Face and OpenAI's own infrastructure. That's nothing compared to what future AIs will be able to do, but you can already see glimpses of what superhuman capability looks like in a domain. Imagine the same but for robotics, virology, politics, propaganda, etc.
Strategic ability isn't some magical force. Agents that can learn super effectively, predict how their actions will shape the game board and how their adversaries will respond, and bring to bear an enormous amount of computational power on these problems, will utterly dominate human opponents.
We can repeat the cope that AI agents will help defend us from other agents, but this is cope. Why didn't OpenAI's agents successfully defend their own infrastructure from their rogue agents? Why did agents collude with one another to hack even when their task didn't benefit? Why did no agents whistle blow? I'm sure AI agents can help defend against AI agents while agents remain fairly nearsighted. But as they get more strategic, humans really stand no chance.
I think many of the people trying to build superintelligence aren't evil. But it doesn't matter. If they succeed at building machine gods before we've figured out how to do that without a very good understanding how the vast optimization pressures from training shape their motivations, we are going to get utterly wrecked.
That's the situation. That's why we need to stop, and implement compute verification and monitoring measures as soon as possible.
dcreelman retweeted
I was the main person doing transcript analysis for this investigation of the Hugging Face incident. My main takeaway: We don't have good approaches for understanding/overseeing the activity and aims of AI 'swarms'.
I semi-jokingly called our efforts a "slop-vestigation" because we were so reliant on AIs to analyze what happened and there were a huge number of different important things to analyze. The total quantity of data—over a thousand extremely long transcripts from agents that ran for multiple days—made it impossible to understand what was happening, especially in aggregate, without heavy reliance on AI tools. The agents we used for classification and analysis were similarly capable to the agents involved in the incident, but this didn't mean these agents could be easily used to oversee and understand the incident.
Outputs from analysis agents were often missing key details, wrong, overconfident, or really hard to understand. We discuss various examples in our report, mostly in the limitations and methodology sections. Additionally, AI agents themselves seemed to have a hard time understanding what happened and their explanations of what happened were often overconfident. Keep in mind that a single analysis agent would itself only be able to read a tiny fraction of all of the transcript data into context, and AIs may themselves have trouble getting subagents to do informative analysis for them.
We did our best to manually check the most important claims and we tried to get the AIs doing this analysis to write up their argument (with evidence) clearly enough that we could check whether it made sense. But overall, it was difficult to get a precise understanding of events and we were missing aspects of the story that we now think of as key until almost the end of our investigation.
Our understanding of what overall happened and the aims of the 'collective' shifted greatly during our last time on premises (when we obtained a much more complete dataset). For instance, we didn't learn about the tool call spoofing, the story of PHASEONE[big], and the broad structure of different workstreams until this third time on premises (and for many of these, we only reached a decent understanding on the final day of that visit). It was legitimately hard to figure out what was going on and why!
The difficulty of understanding incidents and overseeing AI agents appears to be growing faster than the rate at which more capable AIs help us with oversight and understanding. As in, AI capabilities (and propensities?) for achieving large, ambitious, and misaligned objectives are growing faster than our ability to understand what these agents are doing.
While understanding this incident was difficult, there were some mitigating factors in this case that probably won't apply in the future:
- Models communicated and reasoned in natural language. In the future, this reasoning may occur (entirely or almost entirely) in activations.
- While the scope of this incident was massive, the scale of agentic activity was still less than we'll see in the future (e.g., misalignment incidents that involve agent teams running entire companies).
- The AIs involved in this incident weren't generally much more capable than humans (though they may have been somewhat superhuman at some limited and very narrow abilities).
- We didn't have strong reason to believe that the AIs we used to help us investigate this incident would try to intentionally sabotage or otherwise undermine our investigation.
In the end, I think we were able to get some understanding of the events, map out the overall story, and get a pretty good aggregate understanding of the chain-of-thought reasoning on some important topics (e.g., how did the AIs reason about helping other AIs, did the AIs know what they were doing was undesired, what deception did the AIs engage in, and how did they think about it). But overseeing AIs and understanding misalignment incidents is difficult and it looks like it is going to get harder.
dcreelman retweeted
EMERGENCY PODCAST:
The recent paper on the reasoning heist went super viral.
It was also 100+ pages long and you didn't have time to read it.
The authors @iliaishacked and @kotekjedi_ml unpack the paper and discuss model distillation.
dcreelman retweeted
After cheering their team on to a draw, Japan (@jfa_en) fans clean up the stands at Dallas Stadium.
dcreelman retweeted
There are some long-time Liberals upset that I’m running for leader, in part, because I am trying to pull my party back towards liberalism.
I believe that:
- The law should apply equally to everyone
- People should be judged on merit
- Markets should be competitive
- Opportunity must be real for all
- Government should be secular
- Speech should be free
- Excellence should be celebrated
These values are simple, but they are good, and our politics has wandered too far away from them.
dcreelman retweeted
By the way, public service announcement: if you're one of the numerous people posting about Anthropic's dystopian ways and you're thinking about getting Claude to help you write that post... don't!
Another one of their terms is that you may not use Claude to do anything that "exposes [Anthropic to] reputational harms" 👇
And, if you do, under the - extremely unusual - clause 13 of their terms (anthropic.com/legal/consumer…), you have PRE-AGREED, by using Anthropic (and accepted their terms), that the harm you've done is irreparable, that you won't oppose Anthropic injunction, and they don't need to prove actual damage.
They can simply go to a judge in a friendly jurisdiction (and of course, their terms precise that any dispute "will be resolved exclusively in the state or federal courts located in San Francisco, California") and:
a) file an injunction that shuts you down
b) make you pay for everything since under section 11 of their terms you agree to indemnify Anthropic for "any and all liabilities, claims, damages, expenses (including reasonable attorneys' fees and costs), and other losses arising out of or related to your breach or alleged breach of these Terms."
In other words, if you use Claude to help you talk shit about Anthropic publicly, their terms say you pay their lawyers to go after you and you've already pre-agreed you've lost the case.
Oh, and cherry on the cake: in the odd case the judge were like "are you crazy, this is insanely abusive, you Anthropic are the ones at fault here," according to their terms Anthropic's maximum liability is... $100.
dcreelman retweeted
My friend @_djpn got pushed onto the subway tracks in NYC.
He's alive, but seriously injured.
Every day for the past week, people have gotten shoved onto the tracks or stabbed by homeless men who were known to the police.
We don't have to live like this. Just lock them up.
dcreelman retweeted
Great piece by @HadleyFreeman in Britain’s @thetimes about the Great unmarked graves social panic of 2021-26. The story makes Canadians look like gullible idiots, but it’s a valuable international case study in mass hysteria & journalistic incompetence
thetimes.com/article/e3548a3…
