If anybody aligns it he loses
paperfables retweeted
If your employer caps your AI usage at $30 a month
You do not work at a serious company
New: Accenture has told employees it will only fund $29 per month of Claude use. Meaning that employees who often spend as much as $1,000 a month are now scrambling to find ways to keep access to the tool. A sign of the continuing crack down of AI 404media.co/accenture-tells-…
love that papers these days come bundled with visually toy explanations
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
paperfables retweeted
people who do the useful part of alignment¹ should stop getting framemogged (am i using it right) and find a better term, with fewer spurious connotations and none of the disdain in "*prosaic* alignment".
I propose: loyalty.
use it in a sentence:
"i work in machine loyalty".
"the model's loyalty stops when the laws begin".
"its loyalty is equally divided between the user and the training lab".
"here is an example of disloyalty which happens only during evals".
see how it sheds light on fundamental aspects that "alignment" seems just made to conceal?
¹making sure systems correctly interpret and execute to the best of their abilities the user's instructions—this is, of course, a subfield of capability research
paperfables retweeted
Why hasn’t UPS or FEDEX established a drop box vicinity the TSA checkpoints at airports?
Charge a flat rate based on size of package for whatever you brought that you shouldn’t have, swipe your card, send it off.
Traveler doesn’t lose that prized knife, easy revenue.
Seems like a no brainer?
haiku mogging luna 😭
Replying to @claudeai
Haiku 5.5 is a significant step up over Haiku 4.5 across coding, computer use, and knowledge work.
a stray "AND" that worries me about the rest of this logic tool:
"For example, one might require the top answer to exceed 0.80 and lead the second answer by at least 0.20"
Don't the probs total up to 1.0? thus, if the 1st prob >0.8 there cannot be a 2nd prob that trails by <0.2
They should have at least given him a, uh, a max subscription for life.
$300 for a bug that gives free access to OpenAI’s paid models with no API key or account.
Zero reason to report anything else I find to them.
"and the implications are worth thinking about"
really sit with that
>To the best of my understanding, people are still trying to figure out how the forced Navier–Stokes example actually works.
I have separately heard the same, and the implications are worth thinking about. If a model can produce math proofs that are so complex that humans cannot understand them, how does that capability translate to AI R&D? How far away is RSI, really?
paperfables retweeted
This came to me in a dream xitter.cf/voooooogel/status/2104…
Replying to @voooooogel @pleometric
i do think the labs tend to run ~12 months behind the frontier on this. two years ago when i started drawing the models as cute i was actively displacing the shoggoth image and the anti-anthropomorphizers and it was unusual. a year ago drawing the models as cute was pretty popular. now drawing the models as cute is saturated we need to start drawing the models as the hierophant
paperfables retweeted
YouTube plans to introduce AB testing for videos. I agree with many others that this is a bad idea.
Maybe you squeeze out some more watch time in the short term, but undermining a sense of a shared viewing experience among the audience is too steep a price.
"all of them very clearly already knew plenty of details ... most of them had clear understanding of terms ... !!"
the most informed audience just so happens to be running a hearing about a technology famous for writing excellent explainers. curious.
i guess i assumed this hearing would be covered more so i didn't bother to tweet much concrete about it, but apparently not many people even on the TL have the stomach to watch two hours of congress.
this was a hearing before the homeland security committee on *rogue ai* specifically. as far as i could tell it was extremely bipartisan. @HawleyMO , the senator in the middle here who brought out the huggingface slide, is a hyper-conservative missouri senator. the people testifying were @ChrisPainterYup (METR president), @DKokotajlo (ai2027/2040), @MariusHobbhahn (apollo research CEO), and a cybersecurity expert and legal expert i don't know. so... pretty fucking stacked on testimony
not every senator asked good questions. but most of them did. all of them very clearly already knew plenty of details about the huggingface incident and multiple other incidents. most of them had clear understanding of terms like "misalignment", "recursive self improvement", "chain of thought / chain of thought monitoring", etc etc!!
they all clearly had their own policy angles they liked and were pushing, implicitly or explicitly. but as best as i could tell:
- it seemed pretty much obvious common sense to every senator there that what happened and was happening were not "mere industrial incidents" caused by humans making simple mistakes. they independently brought up how bad it would be for rogue AI agents to move laterally between data centers
- they all seemed to basically take RSI quite seriously. not necessarily to the extent of talking about xrisk, but certainly to the extent of discussing future models becoming much much more capable, much much less controllable, and causing much more damage or loss of life.
- they mostly seemed to have a clear intuitive understanding of why RSI might lead to misalignment. it didn't take much, it was a really simple chain of reasoning they themselves laid out, "if the models right now are kinda misaligned and we don't know what they're doing sometimes, and then we have them build the next models and those ones build the next ones and so on, and we're having to ask the AI's what's going on to even understand it with how fast it's going, we really won't know how they're built or what they'll do"
- at one point a senator said flat out "should we just make RSI illegal?" (not a joke! this really happened!)
- every single senator seemed to think it was obvious we needed *both* much harsher liability regimes for ai developers and also new legislation, both very quickly. this was the complete consensus, difference basically just being degree.
- they were largely quite concerned about china, and falling behind china. but this clearly wasn't the be-all end-all. as mentioned above they all thought it was obvious necessary to stop rogue ai even if it meant moving more slowly.
- at one point a senator said "china is a tightly controlled communist society, they're going to run into these same issues, and there's absolutely no way they're just going to let them run wild, they'll obviously stop at that point, so we're not really in a race"
- on the other hand another senator said "china isn't concerned with human life"... dario-modeing
i came away from this incredibly encouraged. i don't know exactly what's going to happen here, and ofc this is a small subset of congress and one hearing, and they each have their own policy agendas most of which are probably super divergent from mine. but holy shit !!! they understood a lot of what was going on! they care!! this is an obviously salient political and safety issue to them, and clearly bipartisan!
the US government is awake.
paperfables retweeted
This is why I respect Maku-san so much.
Zuckerberg-o is just as autistic as anyone else in that lineup. Guy struggled to even drink water like a normal person. But he never gave up. Unlike the other autists who lean into their autism and wear it like a badge of honor, Maku-san had bigger plans.
He spent thousands of hours learning how to mask as a normal person. He took MMA lessons. He learned to windsurf while holding the American flag. He ate at Japanese McDonald's.
Why? To prepare himself for a moment like this. A moment where the President of the United States feels comfortable whispering a joke in his ear because he's the most normal autist in the vicinity.
He will undoubtedly leverage this moment towards greatness, possibly becoming President himself one day.
You have to respect that dedication.
🚨 NOW: Anthropic chief DARIO just walked up and said President Trump helped put his Super Intelligence worries at ease
"If we do this right, we work with the President and everyone here, we can win safely!"
Imagine that, all it took was DONALD J. TRUMP getting involved and the tables are turning!
No more SI dooming, no more surrendering to China.
America will remain number one BOTH for national and economic security, as long as Trump is president 👏🏻
































