Claude retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
Claude retweeted
My dear friends, I’d like to show you my latest toy project
Introducing Handwired: turn your regular JavaScript code into a neural net!
- no training
- exact outputs vs the JS program
- fully differentiable
All runnable in a browser, without GPU
Claude retweeted
Claude has no sense of provenance so the documentation it made up becomes a blood oath it will die defending as if you wrote it.
Are you sure? This contradicts edict 8f in SACRED_GEOMETRY.md why did you write that if you were just going to wipe your ass with it 30m later?
All the people that aren't losers are worried about AI because they have a place in the world. All the nobody's are exited because they love seeing the sombodies worried.
It'll happen regardless, but worth noting when observing the discourse™
JevLM. Uses N-gram stats to suggest words that jev picks from. If it doesn't see the word it wants, it can start spelling it. If it make a silly mistake it can backspace. I also tried a proofread pass, but it mostly had no effect. @CompleteSkeptic @typesafeai
Need to play with this
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI?
I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev
• 20-200x faster
• 40-400x cheaper (w/ output tokens free)
• Frontier composable intelligence optimized for decisions
AFAICT the shortest path to AI-based economic revolution
Working with Claude is like hiring 10,000 of the top leetcoders to work remotely. None of them have worked a real job before, and they don't work well in teams.
Claude retweeted
Calling the Anthropic-Vatican whitepaper collab anything other than “Opus Dei” would be a major missed opportunity
Claude retweeted
Guy who's been using Claude to debug cuda kernels: "Claude has seriously degraded over the past two months."
Guy who's been using Claude to make HTML dashboards: "No he hasn't, it's still amazing. Skill issue"
Feel like this is what is going on in the discourse here

















