gradientdissident ∇ retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
gradientdissident ∇ retweeted
The end of software secrecy is almost upon us. The death of closed source, and the final triumph of open source.
I should have realized this a few months ago when I successfully decompiled the game of Firefighter from an ancient DOS shareware binary. My robot friend was able to tell it had been written in Borland Pascal from looking at the data layout; it gave me back very readable Pascal code with sensibly chosen function and variable names. I transpiled it to Rust and now ship it as part of my heritage games collection.
The thing is, I thought of this as a fun stunt but didn't have any confidence that the technique would scale up to large, real programs. I have since learned that people are now doing this sort of thing with entire AAA games, which are among the most complex software artifacts ever to be shipped as a binary. If they can be decompiled, anything can be.
This has implications. Massive implications. We need to think about what the world is like when, in general, there is no longer a secrecy moat around almost any software at all.
1/2
Life is fucking electric bro. Don’t fall for the doomer shit. Thats for losers and normies scared of their own shadows. Walk around like God sent you and smile at everyone you see. Spread light and abundance. Build things and take chances. This is the best time in history!
gradientdissident ∇ retweeted
Il Governo ha dato oggi il via libera al ritorno del nucleare in Italia: una fonte di approvvigionamento energetico sicura e con costi contenuti che ci garantirà autonomia e indipendenza.
Anche su questa materia, l'Esecutivo dimostra la propria lungimiranza e il costante impegno per risolvere con una visione di lungo periodo i problemi strutturali della Nazione.
gradientdissident ∇ retweeted
There's a new kind of coding I call "vibe coding", where you fully give in to the vibes, embrace exponentials, and forget that the code even exists. It's possible because the LLMs (e.g. Cursor Composer w Sonnet) are getting too good. Also I just talk to Composer with SuperWhisper so I barely even touch the keyboard. I ask for the dumbest things like "decrease the padding on the sidebar by half" because I'm too lazy to find it. I "Accept All" always, I don't read the diffs anymore. When I get error messages I just copy paste them in with no comment, usually that fixes it. The code grows beyond my usual comprehension, I'd have to really read through it for a while. Sometimes the LLMs can't fix a bug so I just work around it or ask for random changes until it goes away. It's not too bad for throwaway weekend projects, but still quite amusing. I'm building a project or webapp, but it's not really coding - I just see stuff, say stuff, run stuff, and copy paste stuff, and it mostly works.
“It is not from the benevolence of the butcher, the brewer, or the baker that we expect our dinner, but from their regard to their own self-interest.“
109
Based.
>Be DeepSeek
>a bunch of Chinese hedge fund broz
>See NVidia market cap reach moon
>See Silicon Valley AI broz pumping the compute demands for AI every model
>"What if we could put a chink in that narrative?"
>Proceed to take big brain quants and make them work on lower compute LLM training
>get a breakthrough internally
>take up a massive short on NVidia
>release the model as open source
>make sure it goes viral
>rake in the dough as America copes with a violation of the compute moat narrative for a week
>profit.
143
gradientdissident ∇ retweeted
those who think RL use less compute don’t know RL at all 😅
SFT: human generates data and machine learns
RL: machine generates data and machine learns
gradientdissident ∇ retweeted
Today's "DeepSeek selloff" in the stock market -- attributed to DeepSeek V3/R1 disrupting the tech ecosystem -- is another sign that the application layer is a great place to be. The foundation model layer being hyper-competitive is great for people building applications.
gradientdissident ∇ retweeted
R1 is not a reason to give up, it's an invitation for us to accelerate even further.
America shall not be mogged. Last time something like this happened we put men on the moon.
Time to cook.
I just claimed my ZCX tokens using the Zenchain Testnet Faucet! 🚀 Get yours now and start building on the most secure Bitcoin Layer 1.
faucet.zenchain.io
#Zenchain #Crypto #Blockchain
59

























