A sparse reward agent

Joined April 2012
Tremo retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
863
2,604
1,423
19,645
4,366,675
Here’s to the wanting. Here’s to the dreaming. Here’s to everyone.
742
1,187
530
13,701
5,696,386
the default is distraction, you have to actively align towards your goal
21
you get the motivation after you show up, not before. so show up more often and don't wait for perfect motivation
23
try to track/measure every metric possible, it gives you what specifically works or not for you
23
train yourself to accept friction instead of escaping it
19
I know it's math-specific but this surely suprising in all positive & negative ways
“To solve the Navier-Stokes problem, we used an internal model that is significantly more capable than GPT-6 Astra.”
25
Muse Spark 1.3 is rolling out today with frontier performance almost too cheap to meter. This is the biggest jump we've made so far on coding and agentic work. Try it in Muse Code and our API. Next up 🍉 and Muse Spark open weights releases coming soon.
1,445
1,608
1,228
19,909
3,798,397
monitor more, it will help give you a tighter feedback on positive vs negative actions that accumulate over the days
17
Today we're also opening the weights for Muse Glimmer, a great 30B parameter dense model that can run locally. Soon we'll also release the weights for Muse Spark 1.2, our latest foundation model. Meta is a strong supporter of open source and I'm proud of these releases. Congrats to @alexandr_wang and the MSL team for all your great work on these models.
1,854
2,528
1,246
30,342
5,286,268
1/ big announcement today: we will be releasing an open weight version of muse spark 1.2 soon. we also are releasing muse glimmer, a 30B agentic model with open weights under apache 2.0. muse glimmer can run on 24GB of VRAM without losing agentic reliability. 🧵
387
724
276
9,518
1,383,652
finding the right balance needs experimenting & reflecting
32
tough days show more clearly in your mind. you have to actively reflect and document good days, so you don't over-generalise and stop too early when you're on the right path
23
know yourself and know what's your best output env
27
small optimisations matter the most earlier as they compound
15
at some point you need to trust your intuition and stop overthinking every micro optimisation
10
when overwhelmed, just communicate your state, and tunnel vision on the smallest positive step you can take. your future self will thank you
13
cognitive strength is the key to everything good in life
11
every tool has its benefit, but only if you can control yourself to use it the right way
12
Glad to share what I've been working on over the past year at MSL. I have contributed to Muse Spark's SOTA computer-use capabilities and coding diversity across harnesses. Go try it out through the new API or meta.ai
We’re excited to introduce Muse Spark 1.1, a significant upgrade from the first Muse Spark model we released earlier this year. Along with this release, we are launching a public preview of the new Meta Model API where developers can access Muse Spark 1.1. The model is also available now in "Thinking" mode in the Meta AI app and on meta.ai. Learn more: go.meta.me/ff8e2c
5
146