Helping models grow wise @Anthropic | Hertz Fellow | Prev: LAION-5B & OpenCLIP @UCBerkeley

Berkeley, CA
Joined December 2020
Excited to announce our new work! 🧬 Some highlights are: - sequences likelihoods predict zero-shot fitness capabilities - a new method to calculate pLM likelihood in O(1) instead of O(L) forward passes - providing a causal between training data and outputs - suggesting a new finetuning method to improve pLM capabilities (1/9) biorxiv.org/content/10.1101/…
2
33
4
204
47,803
It is extremely sad that this didn't end up as an example of how the labs could cooperate/coordinate, because the stakes will be so much higher in the future.
69
131
29
2,794
420,125
Cade Gordon retweeted
Introducing Claude Fable 5: a Mythos-class model that we’ve made safe for general use. Its capabilities exceed those of any model we’ve ever made generally available.
4,913
14,109
9,949
103,404
57,696,084
Many have asked how they'd know if Anthropic lived up to its principles. They have their answer. I'm proud of the people beside me, and the America we were taught to be.
1
8
256
4,613
Cade Gordon retweeted
for all the sonnet enjoyers:))
Replying to @claudeai
Sonnet 4.6 has improved on benchmarks across the board. It approaches Opus-level intelligence at a price point that makes it practical for far more tasks.
1
8
1,330
Patient work, careful hands. See what grew.
Introducing Claude Opus 4.5: the best model in the world for coding, agents, and computer use. Opus 4.5 is a step forward in what AI systems can do, and a preview of larger changes to how work gets done.
4
1
86
7,594
Cade Gordon retweeted
Introducing the next generation: Claude Opus 4 and Claude Sonnet 4. Claude Opus 4 is our most powerful model yet, and the world’s best coding model. Claude Sonnet 4 is a significant upgrade from its predecessor, delivering superior coding and reasoning.
920
3,111
1,492
20,436
4,297,651
Excited to share that I'll be joining @Anthropic to work on pretraining science! I've chosen to defer my Stanford PhD, where I'm honored to be supported by the Hertz Fellowship. There's something special about the science, this place, and these people. Looking forward to joining some of my most brilliant and compassionate colleagues!
42
7
1
748
59,034
👏 Meet the 2025 Hertz Fellows—19 rising leaders in science and tech advancing breakthroughs in robotics, energy, medicine & more. 🔗Learn more: bit.ly/2025HertzFellows
10
7
33
12,985
🎓🤖 We’re thrilled to welcome @CadeGordonML to the 2025 class of Hertz Fellows! Cade’s AI research is advancing biomedical discovery. A future PhD student at @Stanford, he joins a growing community shaping the future of #science and #tech! 🔗 bit.ly/4daXZLO
2
2
29
2,573
Cade Gordon retweeted
Documenting and sharing research in real-time is underrated in discussions about open science. @jainhiya_ and I think software can help change problem selection, collaboration, and funding. We write about how and why we should create real-time, open lab notebooks.
5
9
2
60
12,538
Cade Gordon retweeted
Chinese policy on clinical trial approvals liberalized massively in the mid 2010s. A decade later the effects of this move are perceptible in where our drugs come from.
This quoted post is unavailable.
1
3
17
2,873
Cade Gordon retweeted
Arrived in Singapore for ICLR—excited to see old & new friends! I’ll also be at the: - Thursday 3:30-5pm main conference poster session, presenting work led by @CadeGordonML on the subtleties of using protein LM likelihoods for fitness prediction (see 🔗👇) - GEM workshop presenting our all-atom latent diffusion work with @nc_frey @KevinKaichuang @wilson1yan & others (unrelatedly, I’ve never been so infatuated with an airport before…check out this gradient descent sculpture)
5
4
106
8,129
Cade Gordon retweeted
A simple idea to build the @UCBerkeley startup alumni network has grown beyond my wildest dreams into #AccelScholars, a tight-knit community of the most ambitious, talented, kind-hearted people, whose individual stories we’ve been fortunate to support for the past eight years
7
38
8
166
29,296
the IGI wrote a bit about our (in progress) work on building statistical tools for genome mining and discovery! check it out below ⬇️ 🔍
A new IGI article delves into the story behind our method for statistically guaranteed genome mining and discovery of genes of unknown function. The piece offers insights into the journey and motivation driving our work! Read more here: innovativegenomics.org/news/…
7
1
55
5,436
🧪 Introducing POPPER: an AI agent that automates hypothesis validation by sequentially designing and executing falsification experiments with statistical rigor. 🔥POPPER matched PhD-level scientists on complex bio hypothesis validation - while reducing time by 10-fold! 🧵👇
25
219
28
1,188
157,364
Live tweet of NanoGPT speedrun 📉 implementing the new "Harmonic Loss" with the goals of: 1. Seeing how this loss fairs on more LM experiments 2. Giving a brief glimpse into the NanoGPT library 3. Show how much open source software accelerates science
Replying to @dbaek__
Interesting! For testing faster convergence in LLMs, I would recommend using the nanogpt speedrun repository from @kellerjordan0 , which offers well tuned baselines and can be ran for a couple dollars. github.com/KellerJordan/modd…
2
14
2,567
We have a similar trick available for writing out the log of harmax, which motivates a way that we can rewrite the equation into logits.
1
1
827
Spent a good few hours and $50 wrangling with a few different implementations not yet finding success. Initial issues in compilation and now OOMs that would need me to reduce batch size or attempt some other tricks. I hope someone can give my code a whirl and have better luck!
543