Author of GRPO-Zero library, PhD, AlphaZero in JAX, text-to-speech models, mechanistic interpretability, exploring neural nets' internal circuits...

Singapore
Joined February 2012
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Nice work on J-space! Fun coincidence, I explored a very similar technique called logit prisms two years ago: neuralblog.github.io/logit-p… @Jack_W_Lindsey might be worth a look, and a citation would mean a lot if it fits!
Replying to @AnthropicAI
The J-space lets us read, audit, and shape what Claude is actively thinking about—useful tools for keeping models trustworthy as they grow more capable. And it suggests surprising parallels between language models and our own minds. Read the full paper: transformer-circuits.pub/202…
2
273
Replying to @giffmana
People who pick "MoEs are elegant" need to explain themselves lol. MoEs are non-differentiable monsters.
1
1
149
Anthropic should slow down and fix its services.
Anthony Morris ツ
@amorriscodeJun 5
working on a fix for issues with Opus 4.7 and Opus 4.8 status.claude.com/
99
ok i really like this model architecture, which somewhat proves my intuition that we don't really need a deep encoder for vision/audio modalities, the transformer backbone itself can process the image/audio tokens raw. The vision/audio encoder should be considered to play the same role as the "embedding" layer.
Google Gemma
@googlegemmaJun 3
Meet Gemma 4 12B! A unified, encoder-free multimodal model designed to bring high-performance intelligence directly to your laptop, and released under an Apache 2.0 license. Bridging the gap between edge efficiency and advanced reasoning. Here is what’s new with Gemma 4 12B: 👇
152
Another day of Google not quite reaching the AI capability frontier.
40
Replying to @DanielleFong
This isn't actually true, at least with the current version! (That said, Anthropic does offer a context editing feature in the API that lets you clear tool results and/or thinking blocks.) If you want to test it yourself, try this: 1 Ask Claude: "What is 123123123123 x 34534543564654645? No tools, just thinking." 2 Step away for 2 hours to make sure the KV cache gets flushed. 3 Come back and ask: "Give me a 10-word summary for every 200 words in your thinking block before the final answer."
232
They don't teach you this in school, but Transformers are RNNs. The KV cache is the hidden state.
About "transformers are recurrent": teacher-forced discrete tokens cannot play a mind's melody.
102
Replying to @Figure_robot
This looks very impressive, but am I the only one seeing something off here? Do we really need a humanoid robot for this particular task? It feels like someone with a mechanical engineering degree could design a simple machine to do the same thing, right?
1
10
1,080
Replying to @suchenzang
In this clip, Dario was talking about *the latest model we release, Claude Opus 4.5* I've already seen a few cases where people post old clips of Dario for various reasons. I'm not commenting on whether Dario is purposely sending *fear-mongering* messages or if he honestly believes in this stuff. I just want to point out that some people are purposely posting old clips of Dario for engagement and/or other agendas.
2
9
2,642
Replying to @tdietterich
Someone needs to create a Claude skill to check for hallucinated references and other "meta comments from the LLM" 😅
339
Cancel your subscription and switch to Codex instead. You'll be doing others a favor too, freeing up compute for the people who actually need it.
Best AI models now : Backend : GPT-5.5 Frontend : Kimi-K2.6 Agentic : MiMo-V2.5-Pro Best Price : Deepseek-V4-Flash Worst Price : Opus-4.7 Fast Research : Grok 4.3 Image : GPT-Image-2 Video : Seedance 2.0 (#1 for 3 months) Yes, Claude sucks.
128
I am kind of tired of people's crazy takes on Anthropic. AI twitter is an upside-down world in which the honest people get ridiculed while the liars get celebrated.
53
Too much of the *hype* around Mythos is focused on cyber. But… Mythos is incredibly good at SWE as well. In fact, cyber is really just a side quest. I'd bet Mythos is great at other tasks too. And I don't think we're prepared for this.
83
Replying to @AnthropicAI
If you want to listen to Claude’s Constitution in your favorite podcast app, I have created an RSS link for it at gist.githubusercontent.com/N… Use your app’s Add podcast by URL / RSS URL option. On iOS Apple Podcasts: Library → Shows → Follow a Show by URL. On Android AntennaPod/Podcast Addict: add/import by RSS URL.
1
2
351
Replying to @yaroslavvb
Much better developer experience (Python vs. C++). Much better compile time. Same performance as C++ CUDA.
624
The dashboard is one self-contained HTML file. State + chart in one file you can email around. Here is a live example, mid-run on ResNet-18 / Flowers-102 fine-tune: ntt123.github.io/hill-climbi…
1
203
Six skills that compose: • onboard (interactive setup) • execute (pick top idea, do the work) • verify (run verifier.sh, parse {status, score, notes}) • brainstorm (diagnose + diversify when stuck) • loop (autopilot) • hillclimb (end-to-end orchestrator)
1
66
Extends @karpathy's auto-research idea into a generalized Claude Code plugin: optimize any measurable objective with whatever verifier script you write. Hyper-parameter sweeps. Kernel optimization. Accuracy. MSE. TFLOP/s.
1
42
I built a Claude Code plugin this weekend: turn any "chase a number" problem into a stateful hill-climbing loop. You give a metric and a verifier script. Claude does the iterating. State lives in a self-contained HTML dashboard. 🧵 below ↓
1
110