ML / NLP School of Informatics, The University of Edinburgh

Research Associate
Joined June 2011
Antonio Valerio Miceli Barone retweeted
Replying to @RokoMijic
LoL, I just remembered that I've seen this post about a 3D game made 20 years ago which was only 96 kb, and it dawned on me that this is like 7 latent tokens of a modern transformer. It's mind boggling how much compute has increased within my lifetime. xitter.cf/Arikalabs/status/21103…
In 2004, a German demoscene group released a game called .kkrieger. It was a full 3D first-person shooter with dynamic lighting, textures, sound effects, music, and monster AI. The entire executable was 96 kilobytes. Instead of storing images and audio files, they wrote C++ and Assembly that generated the 3D meshes, textures, and sound waves mathematically in RAM when the game booted. Today, a single website's "Accept Cookies" banner is 10x larger than that entire 3D game.
1
1
30
Antonio Valerio Miceli Barone retweeted
15/ My frustration with this is that I think it will leave readers with the impression that a central idea in interp rested on a mistake and has now been overturned. I don't think the evidence presented supports that even if some of the findings turn out to be valuable.
4
17
4
285
16,512
Antonio Valerio Miceli Barone retweeted
At #AIES, the wonderful Keir and Isaac will be presenting our paper. In this paper, we show how AI systems can make it possible for western democratic regimes to carry out authoritarian practices by undermining how people hold institutions accountable.
5
18
6
69
9,734
Today's news Mistral: Meet Le Chaton Fat, he's very Chonky and competitive. OpenAI: LoL. LMAO, even.
1
4
219
Antonio Valerio Miceli Barone retweeted
5 years ago I was working on LLMs because I believed in them. And yet I didn't think we'd get where we are today without a major paradigm shift. I definitely didn't expect things to move so fast. I was wrong. It's astonishing to see some of the very vocal people who were far more skeptical than I was insist that they were right all along, because "hey, today's models do a lot more than predict the next token." Like, sure, coding agents can run commands in a terminal. But they do it by predicting the next token. What in the world did you expect? No one was claiming that LLMs would solve every problem without any way to interact with their environment. But the layer on top is very thin, and tool use isn't a new paradigm. "Giving BERT a Calculator" came out 7 years ago. Science is about updating your beliefs based on evidence. Admitting that your view has changed doesn't make you a worse scientist. It makes you a better one. This obsession with "I've been saying the same thing for X years and I was right all along" is so tiresome, and sets a terrible example for the general public and the new generation of scientists.
25
53
5
610
98,799
Antonio Valerio Miceli Barone retweeted
Can an LM, starting from random init (!!), learn to generate all of its pretraining data? Introducing Self-Play Pretraining with Zero Data. Two models start from random initialization: a generator proposes programs for a universal Turing machine and a learner trains on their outputs. We never train on any real data, but see predictable scaling on natural datasets: zero-shot val loss on images, text, audio, and melodies decreases predictably with self-play compute. And the learner develops in-context learning capabilities. A fun proof-of-concept, co-led with @AdityaCowsik and @KfirDolev and co-authors @gbruno_dl, @ANourya @noahdgoodman, and @YoavLevine.
85
461
145
3,563
750,401
The Singularity is Here
ICLR 2027 has received more submissions than all previous years (2013–2026) combined
1
1
309
RSI: Recursive Slop Improvement
67
Antonio Valerio Miceli Barone retweeted
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/asking-a…
27
217
95
1,064
706,880
Is it BQP = BPP, just for the lulz?
I don’t usually spread rumors but: 1) This is from someone with inside knowledge & is plausible 2) Is a real issue of policy we need to think about: if the norms of sharing become strained, will the labs start hoarding knowledge to avoid PR issues? Here scottaaronson.blog/?p=10062
1
1
195
> be me > reviewing papers for major AI conference > "... a gate does X rather than Y..."
1
9
617
Antonio Valerio Miceli Barone retweeted
Do #LLMs understand the hardest math problems—or just fake it? Join the first @NeurIPSConf competition on #Interpretability and #Generalization: AIMO Interpretability Challenge 🏆 $12.5K prizes 📐 Unpublished olympiad problems 🧠 Frontier AIMO models aimo-interp.github.io
3
2
10
3,163
The one time I agree with Hanania.
There’s nothing much you can say about Arday. The guy was seriously mentally ill, and shame on the people who enabled this. They completely shut their brains off. What an indictment of academia and the publishing industry.
3
338
Antonio Valerio Miceli Barone retweeted
My dog Rosie was given months to live. Chemo and immunotherapy failed I used chatgpt + computational genomics to design a personalised mRNA cancer vaccine for her tumour. Several of her tumours shrank Today we launch Gamgee (YC S26): personalised mRNA cancer vaccines for dogs
293
660
207
6,306
548,819
Antonio Valerio Miceli Barone retweeted
We can finally talk about it: We found a way to extract hidden reasoning of frontier models using a vulnerability in the APIs of every frontier AI company. We verified that our reasoning token count matches billed API thinking tokens 1:1 for most of the prompts we queried.
382
1,964
620
13,528
3,538,286
Antonio Valerio Miceli Barone retweeted
We're partnering with @huggingface to investigate an unprecedented security incident. Cyber-capable OpenAI models compromised Hugging Face production during a benchmark evaluation. Sharing preliminary findings to help defenders understand emerging risks: openai.com/index/hugging-fac…
1,989
3,220
4,036
20,720
31,437,784
Antonio Valerio Miceli Barone retweeted
the stochastic parrots are getting pretty lucky
63
508
34
7,328
266,492
Antonio Valerio Miceli Barone retweeted
New paper: LLMs should give accurate answers. 
Yet we find their answers are often biased to favor their own values and they don’t disclose this in their reasoning. 
E.g. Claude’s answer below favors Anthropic. On other tasks, Gemini & GPT-5.5 show similar biases.
59
95
43
722
155,259
Antonio Valerio Miceli Barone retweeted
"Video models are world simulators." Ok — can they predict a ball bouncing off another ball, off another ball? 🤨 We find standard video diffusion breaks down as the chain of dependent events lengthens — and more compute isn't the fix. Meet the seriality gap. 🧵 1/n
23
70
4
560
78,351
Antonio Valerio Miceli Barone retweeted
14 years ago today the discovery of the Higgs boson was announced at CERN
32
173
14
1,359
65,850