Author of GRPO-Zero library, PhD, AlphaZero in JAX, text-to-speech models, mechanistic interpretability, exploring neural nets' internal circuits...
Singapore
Joined February 2012
- Tweets677
- Following729
- Followers295
- Likes2.9K
Pinned Tweet
My weekend project: GRPO:Zero.
An implementation of the GRPO algorithm from scratch, with zero dependencies.
Say goodbye to unnecessary abstractions, every line of code is visible and everything is customizable.
Runs on a single A40 GPU (48GB VRAM) for a few hours to achieve good results. It'll cost you only a few dollars.
Nice work on J-space! Fun coincidence, I explored a very similar technique called logit prisms two years ago: neuralblog.github.io/logit-p…
@Jack_W_Lindsey might be worth a look, and a citation would mean a lot if it fits!
The J-space lets us read, audit, and shape what Claude is actively thinking about—useful tools for keeping models trustworthy as they grow more capable. And it suggests surprising parallels between language models and our own minds.
Read the full paper: transformer-circuits.pub/202…
ok i really like this model architecture, which somewhat proves my intuition that we don't really need a deep encoder for vision/audio modalities, the transformer backbone itself can process the image/audio tokens raw. The vision/audio encoder should be considered to play the same role as the "embedding" layer.
Cancel your subscription and switch to Codex instead. You'll be doing others a favor too, freeing up compute for the people who actually need it.
Best AI models now :
Backend : GPT-5.5
Frontend : Kimi-K2.6
Agentic : MiMo-V2.5-Pro
Best Price : Deepseek-V4-Flash
Worst Price : Opus-4.7 Fast
Research : Grok 4.3
Image : GPT-Image-2
Video : Seedance 2.0 (#1 for 3 months)
Yes, Claude sucks.
I am kind of tired of people's crazy takes on Anthropic. AI twitter is an upside-down world in which the honest people get ridiculed while the liars get celebrated.
Too much of the *hype* around Mythos is focused on cyber. But… Mythos is incredibly good at SWE as well. In fact, cyber is really just a side quest.
I'd bet Mythos is great at other tasks too. And I don't think we're prepared for this.
I built a Claude Code plugin this weekend: turn any "chase a number" problem into a stateful hill-climbing loop.
You give a metric and a verifier script. Claude does the iterating. State lives in a self-contained HTML dashboard.
🧵 below ↓
The dashboard is one self-contained HTML file. State + chart in one file you can email around.
Here is a live example, mid-run on ResNet-18 / Flowers-102 fine-tune: ntt123.github.io/hill-climbi…
github.com/NTT123/hill-climb…
In Claude Code:
/plugin marketplace add NTT123/hill-climbing-skills
/plugin install hillclimb@hill-climbing-skills
Then: "Run hillclimb on X. Maximize Y from baseline Z."
I think looking at neural activity through a geometric lens is very promising.
Here's another (simple) example from my earlier Logit Prisms work: when we look at digit embeddings inside an LLM, they form a nice heart-like <3 shape in 2D PCA.
One interesting thing I learned from @dwarkesh_sp and @reinerpope's recent lecture that few people mention is that the 1m and 1h caches are likely stored on Flash and HDD.
That was a bit of a surprise to me. I thought the 1m cache was stored in HBM, which turns out to be wrong.
TT Nguyen retweeted
Leonardo DiCaprio is urging his 60 million Instagram followers to contact members of the U.S. House of Representatives and urge them to vote “no” on a bill that seeks to dismantle the Endangered Species Act (ESA).
“Today, on Earth Day of all days, the U.S. House of Representatives is set to vote to gut the Endangered Species Act (ESA), trading the future of life on Earth for the short-term economic gain of a wealthy few... Today’s bill would devastate the most vulnerable species, which are essential to functioning ecosystems. I urge the House to reject this existential threat to our national security and choose to protect and recover species, and defend the living systems we all depend on. Call your U.S. Representative today to urge them to vote ‘no’ on the ESA Amendments Act of 2025 (H.R. 1897). U.S. Capitol switchboard: 202-224-3121.”
variety.com/2026/film/news/l…
Now what I really need is Mythos as the advisor for my Opus😅
youtube.com/watch?v=V0aXMTpZ…
Funny enough, rewatching this video makes me think.... IBM Watson was so ahead of its time 🤣
I like the new Claude Code 'advisor' feature already. It's always nice to have an advisor and/or a second opinion on the task that Claude is doing. Well done 👍
strongly recommend this book
Reminder that I wrote a little book about deep-learning, which is phone-formatted, entirely free, and nearing the 1M download:
fleuret.org/francois/lbdl.ht…
