yudkowsky's bulldog | AI safety grantmaking @coeff_giving (opinions my own)

Oakland, CA
Joined August 2012
huge result: santa actually lives at the *south* pole
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
5
261
I do actually think in the longterm future it would be good for humans to be the ones making art and doing mathematics
1
18
520
(or conscious, autonomous, artificial minds pursuing their own ends or whatever)
3
70
Quinoah 🔍⏸️ retweeted
the elizabeth holmes movie inspired me to worship my evil autistic wife even harder
19
402
39
10,119
213,323
I binged a bunch of Nathan Fielder in preparation for the documentary and he has quickly become one of my comedy heroes. How does his mind work like that
17
424
monosemantic neurons be like
19
76
6
1,413
28,867
Ever since watching You Can See Everything my “For You” feed has become a “Nathan For You” feed
4
208
I used to think I was a really responsive texter. It turns out I was just unemployed or hated my job.
1
35
722
Quinoah 🔍⏸️ retweeted
2
40
4
1,181
33,667
Reading Scott’s post like
"It's not going to be Uncle Fluffy" We knew Scott's reply was going to be a tour de force as soon as Pinker's article was published, and he does not disappoint. astralcodexten.com/p/an-open…
1
2
1
60
1,076
Google AI overview’s response to me looking up this tweet
1
4
161
Quinoah 🔍⏸️ retweeted
"It's not going to be Uncle Fluffy" We knew Scott's reply was going to be a tour de force as soon as Pinker's article was published, and he does not disappoint. astralcodexten.com/p/an-open…
21
25
12
285
26,217
Quinoah 🔍⏸️ retweeted
Hilarious line from Scott Aaronson's new course on AI Alignment Theory
16
54
6
637
20,733
*grantmaker at an ea party* wow everyone here is so nice
7
15
3
647
13,189
Quinoah 🔍⏸️ retweeted
🚨NEW: Pinker argues heaps don't exist
On AI and "superintelligence": "The power will increase, but there's no point at which it's meaningful to say, 'Well, yesterday we didn't have superintelligence. Today we do have superintelligence.' That's why I think it's meaningless to say, 'What will happen if one day we have superintelligence?' I don't even understand the question. It's: 'Will technology improve?' Almost certainly. It will get better. It'll never be omniscient. It'll never be omnipotent. That's out of comic books out of religion. There are laws of physics. There are limits on information. There's no system that could learn the position and velocity of every particle in the universe. So as long as that is true, there's not going to be an AI system that can do anything or can know everything. But they will get—obviously, like any technology—they'll get more powerful." Full interview: youtube.com/watch?v=eWC47aga…
6
5
215
4,277