working on pretraining and model scaling. now @smallco, prev @bigco. freedom lover. guobaorou enthusiast. 🍊

London, England
Joined August 2009
björn retweeted
looking at the data and simply laughing
92
6,370
1,436
45,257
björn retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
863
2,599
1,420
19,619
4,341,946
are apples the only fruit with two emojis? who is the applehead in the unicode consortium
2
106
had a million beers this past weekend. paris is beautiful
6
356
back in paris back on the beautiful continent
1
2
171
eurostar is so goated every time. suddenly being in central paris after two hours never gets old
3
116
opus 5.5 and three new gpt-6 models at a lower price point and with higher token limits in a day consider the frontier paced
1
2
226
they’ve got ursula von der leyen out here talking about pacing the frontier. it’s so over folks
1
1
115
we’re in the part of ai take-off where this is the start of an actual wsj article
2
71
when claude tells you something is “one caveat genuinely worth knowing” and it is actually the one caveat genuinely worth knowing
2
100
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
20,540
167,262
39,434
801,576
175,255,712
björn retweeted
High MTS circles
2
2
29
892
back in london after a week at the center of the universe (new york)
3
172
the problem with open source projects is that maintainers inevitably try to force their ideology on their users, even if paying. for-profit companies do not generally do this
1
1
155
case in point
sourcehut now bans any repo “written with or which facilitates the use of LLMs” lmao they and codeberg can now safely be ruled out as potential alternatives to github sourcehut.org/blog/2026-08-2…
1
1
171
one day you will write your last line of code and you won’t even know it
1
191