Pinned Tweet
🧬 Introducing ProtGPT3, a new open-source family of protein language models, from 112M to 10B parameters, now live on Hugging Face! @Filippo_Stocco_ @LasseMiddendorf @ferruz_noelia
Thread 🧵👇
Michele retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
Michele retweeted
ProtRL just got an upgrade!
We’ve added:
1) Distributed training for scaling up protein RL
2) Easier support for custom loss
3) New experimental results in the updated preprint
Now you can make your proteins go BRRRR at scale 🚀
Want to get started? 👉 colab.research.google.com/dr…
Michele retweeted
Upload your CSV, and it will fine-tune, apply RL, and generate new sequences from your experimental data!
ProtRL: github.com/AI4PDLab/ProtRL
Updated preprint: arxiv.org/abs/2412.12979
Thanks to @infinitycrab2, @ferruz_noelia, @mariartigues, @talaldotpdb, @marcguellc and Andi.
Michele retweeted
ProteinGuide is finally officially out. Congrats to the amazing team of @junhaobearxiong, @Ishan__Gaur, @MariaLukarska, and Hunter Nisonoff, in our continued great collaboration with @SavageCatsOnly.
Property guidance for protein sequence generative models with ProteinGuide nature.com/articles/s41587-0…
5/ Beyond family-conditioning, prompts can steer properties too.
Prompting ProtGPT3-MSA with more stable variants biases generation toward higher-stability sequences. More broadly, we explore inference-time steering via Feynman–Kac-style sequential Monte Carlo.
6/ Try it yourself — no GPU needed:
🔗 Online API for ProtGPT3-MSA: huggingface.co/spaces/AI4PD/…
Just upload a FASTA file and get homolog-conditioned designs.
Preprint: doi.org/10.64898/2026.06.04.…





