London
Joined December 2011
Sounds plausible
I added more explanation for why this incident felt to me like it was more than halfway to AI takeover compared to incidents from six months ago. Obviously all opinions my own, not my employer’s or fellow investigators’!
51
Overall, I’m very surprised at how little media coverage there’s been around the OpenAI / Hugging Face attack. It’s clearly one of the most important things to happen this year.
603
919
211
12,282
1,283,398
We're partnering with @huggingface to investigate an unprecedented security incident. Cyber-capable OpenAI models compromised Hugging Face production during a benchmark evaluation. Sharing preliminary findings to help defenders understand emerging risks: openai.com/index/hugging-fac…
16
36
3
568
33,681
Val Che retweeted
wait what
29
48
24
1,302
295,408
Val Che retweeted
hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final ((1+xy)^3 z + y^2 (1+xy) (4+3xy), y + 3 x (1+xy)^2 z + 3 x y^2 (4+3xy), 2 x - 3 x^2 y - x^3 z): \C^3\to \C^3, has jacobian determinant -2, and sends (0, 0, -1/4), (1, -3/2, 13/2), and (-1, 3/2, 13/2) to (-1/4, 0, 0)
1,701
5,389
3,151
43,838
40,094,378
Val Che retweeted
this is my personal singularity moment this post may sound like a paid ad. I only wish. I'm concerned, more so than happy. the world is changing, and, among the scenarios where AI goes terribly wrong, inequality is the most realistic, yet, the one Anthropic seems to be the least concerned about. I'm glad OpenAI is taking the opposite stance: *personal AGI for everyone*. I think this is a commendable position in the times we live. but who am I in the queue of the bread? anyway, Fable is here, so I'll just report my first-hour experience first of all, all my pet prompts are solved. → λ-calculus puzzles → bug questions → one-shot apps all are trivial to it. I don't have anything harder other than my ongoing work so, in the last several days, I've been toying with HVM5, a new interaction net evaluator with a faster loop. after writing the first version, I left 32 GPT-5 agents working for ~20 hours each. this resulted in up to 2x speedups, but the file size increased by 2-fold and quality decreased significantly. I then simplified the whole thing into an even simpler core, and left Opus 4.8 and GPT 5.5 optimizing it for 8 hours. Opus got a legit 6% - 34% speedup in most benches. GPT got better results, but, sadly, an unusable file. I then asked Fable to optimize it. 2 hours later, it landed a 1770% speedup in one case, 100%+ in other 4, and 22% in average. yes, in 2 hours it outperformed me, opus 4.8 and a swarm of gpt 5.5 agents, by one order of magnitude. that could not possibly be legit. "it must be hardcoding the benchmarks" (GPT trauma). so I read its explanation and what it did was, indeed, the most high impact optimization one could try first. seems like HVM5 was wasting a lot of time garbage-collecting unused branches of pattern-match nodes. I had optimized that for static mats, but not for dynamic mats. skill issue. Fable figured how to do it for these, resulting in a massive speedup in some benches but wait, is that *correct*? I'm not sure yet, it is credible, but this is the kind of thing that is very easy to get wrong on interaction nets. the problem is, when I was ready to start auditing Fable's solution so I could tell whether it was buggy or legit, it interrupted me to tell me it had found a massive bug on the code *I* had written. ... wait, what? so... for garbage collection purposes, I stored a bit on lambda term pointers that meant "the variable bound by this lambda has been freed, so, its lambda must free whatever argument it is applied to". that's fine. yet, on duplicator nodes, I also used the same bit to mean "one of the duplicated variables was freed, so, treat this dup as a passthrough no-op". so, if a lambda entered a duplicator, it would mistake the lambda's collection bit for its own, resulting in corrupted interaction! that's a mouthful, why I'm writing this? just so you can appreciate the sheer absurdity of what just happened. I didn't ask it to find bugs. I asked it for an optimization. and even if I did ask it to find bugs, this bug is so astonishingly subtle and specific, identifying it takes mastering the domain to an extent that it beyond even me. I'd easily need hours or days to fix it, *if* I ever came across it. chances are it would just go unnoticed. and Fable found it and fixed it like it was nothing, while it was busy adding a 17x speedup to a file that neither I, nor Opus 4.8, nor a fleet of GPT 5.5 managed to barely make 2x faster. oh and there is also another tab where it is also ripping through Bend's codebase and finishing everything I had to do I don't know what to say anymore this isn't about Anthropic or OpenAI, this is about our collective future as a species. the world is changing, and we need to be aware of it, and discuss how to handle this change. receipt below . . .
247
665
196
7,533
1,478,186
If you are a mathematician, then you may want to make sure you are sitting down before reading further.
160
865
199
9,054
3,257,791
137
1,182
216
9,954
1,153,790
neuralese vibes
1
1
154
I can't believe we're entering the year 2026 from the famous blogpost "What 2026 Looks Like"
8
17
4
393
66,896
"How, exactly, could AI take over by 2027?" Introducing AI 2027: a deeply-researched scenario forecast I wrote alongside @slatestarcodex, @eli_lifland, and @thlarsen
402
1,061
619
5,244
3,032,607
I think this day is the biggest day in ai in the history of the field, anything even adjacent to ai should be vertical right now
8
22
6
507
83,776
The thing about all of the economics papers saying there will be like .01% or .3% etc. impact on GDP from AI in 10 years, is that they're just obviously false + embarrassingly so
31
35
14
535
56,463
I set my ai expectations to unrealistically high bonkers ai world and I still underestimated recent progress
22
51
9
1,140
116,671
OpenAI skipping over 'o2' has unfortunate Kabbalistic implications.
17
8
4
213
16,663
Oh boy
Leopold Aschenbrenner’s SITUATIONAL AWARENESS predicts we are on course for Artificial General Intelligence (AGI) by 2027, followed by superintelligence shortly thereafter, posing transformative opportunities and risks. This is an excellent and important read : situational-awareness.ai/ @leopoldasch
23
13
1
567
78,298
Val Che retweeted
Foundations: Why Britain Has Stagnated. A new essay by @bswud, @SCP_Hughes & me. Why the UK's ban on investment in housing, infrastructure and energy is not just a problem. It is *the* problem. And how fixing it is the defining task of our generation. ukfoundations.co/
239
1,091
483
4,376
5,658,405
You know those stupid scenes they always put in horror movies where you wonder how the characters could be so stupid to not see the foreshadowing? Good thing that never happens in real life!
It's a bit cringe that this agent tried to change its own code by removing some obstacles, to better achieve its (completely unrelated) goal. It reminds me of this old sci-fi worry that these doomers had.. 😬
13
18
2
218
16,782
Never any shortage of people willing to offer vaguely conspiratorial takes that sound wise two glasses of chardonnay into a dinner party but don't actually make any sense. Yes dude, suggesting your product could destroy civilization is actually just a clever marketing strategy.
Replying to @rcalo
The second is to try to convince everyone that AI is very, very powerful. So powerful that it could threaten humanity! They want you to think we’ve split the atom again, when in fact they’re using human training data to guess words or pixels or sounds.
52
39
7
589
416,681
Funnily enough, I wrote my first Züb5tаck post right after Twitter decided to heavily punish links to it.
2
525