
yudkowsky's bulldog | AI safety grantmaking @coeff_giving (opinions my own)
Oakland, CA
Joined August 2012
- Tweets17.5K
- Following115
- Followers1.9K
- Likes16.2K
huge result: santa actually lives at the *south* pole
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
I do actually think in the longterm future it would be good for humans to be the ones making art and doing mathematics
I’ve finally memorized all the words to this youtu.be/pRisDso99s0?is=MQIm…
Quinoah 🔍⏸️ retweeted
the elizabeth holmes movie inspired me to worship my evil autistic wife even harder
I binged a bunch of Nathan Fielder in preparation for the documentary and he has quickly become one of my comedy heroes. How does his mind work like that
I used to think I was a really responsive texter. It turns out I was just unemployed or hated my job.
Reading Scott’s post like
"It's not going to be Uncle Fluffy"
We knew Scott's reply was going to be a tour de force as soon as Pinker's article was published, and he does not disappoint.
astralcodexten.com/p/an-open…
Quinoah 🔍⏸️ retweeted
"It's not going to be Uncle Fluffy"
We knew Scott's reply was going to be a tour de force as soon as Pinker's article was published, and he does not disappoint.
astralcodexten.com/p/an-open…
Replying to @justalexoki
Quinoah 🔍⏸️ retweeted
🚨NEW: Pinker argues heaps don't exist
On AI and "superintelligence":
"The power will increase, but there's no point at which it's meaningful to say, 'Well, yesterday we didn't have superintelligence. Today we do have superintelligence.'
That's why I think it's meaningless to say, 'What will happen if one day we have superintelligence?' I don't even understand the question. It's: 'Will technology improve?' Almost certainly.
It will get better. It'll never be omniscient. It'll never be omnipotent. That's out of comic books out of religion. There are laws of physics. There are limits on information. There's no system that could learn the position and velocity of every particle in the universe. So as long as that is true, there's not going to be an AI system that can do anything or can know everything. But they will get—obviously, like any technology—they'll get more powerful."
Full interview: youtube.com/watch?v=eWC47aga…





















