Imtiaz Adam CS #AI Postgrad |#Strategy #MachineLearning RSI Evolutionary Neurosymbolic |#RL #Agentic | #LLM Liberal | MBA alum @morganstanley @LBS @Columbia_Biz
Joined September 2012
- Tweets65.7K
- Following109K
- Followers136K
- Likes16K
The accurate summarisation of the paper:
Researchers from Stanford and Tsinghua identified sparse hidden-state dimensions associated with expected correctness and changes in expected correctness.
Fewer than 1% of dimensions were sufficient for their probes to preserve much of the relevant predictive information.
The authors call these “value neurons” and “dopamine neurons.”
Ablating selected value neurons severely reduced performance in one MATH500 experiment.
Signals from the proposed dopamine neurons improved inference-time search from 72.2% to 77.8% accuracy in a limited experiment.
Researchers found dopamine neurons inside LLMs.
Stanford and Tsinghua published a paper showing AI models have naturally evolved a biological-style reward subsystem inside their hidden states.
they didn't program this. it just exists.
by probing the network, researchers discovered that a highly sparse subset (less than 1% of neurons) does all the heavy lifting for self-correction.
these neurons map perfectly to two biological equivalents:
• value neurons: these predict the "expected value" of a state, functioning exactly like the human prefrontal cortex. before the model even generates its next word, these neurons light up to signal the model's exact confidence level.
• dopamine neurons: these encode "reward prediction errors." when the ai makes an unexpected logical breakthrough, these neurons physically spike. when the model hits a logical flaw or makes a mistake, the dopamine crashes.
why this is a massive deal for ai development:
right now, scaling "inference-time reasoning" requires building massive, expensive external reward models to grade the ai's thoughts step-by-step.
this paper proves the llm already has an internal reward model built-in.
developers can just hook into the model's own dopamine neurons and use them as a native process reward model (PRM) to guide its logic. and if you ablate (turn off) just this tiny <1% cluster of neurons, the ai completely loses its ability to reason.
synthetic neural networks are starting to behave exactly like biological brains..
AI retweeted
recursive self improvement
OPENAI HAS LARGELY AUTOMATED TRAINING OF NEW EXPERIMENTAL AI MODELS
OpenAI’s internal AI models can now handle much of the process of building and training experimental models, including writing GPU kernels and optimizing the code used to run them.
Researchers can reportedly give an AI a single example of the optimization they want, then let it work for weeks implementing and testing similar improvements.
OpenAI employees also say internal agents increasingly collaborate with each other to solve problems without involving their human users.
The capability has improved significantly in just the last few months, while OpenAI’s growing access to compute is allowing researchers to test ideas much faster. Employees said some experiments that previously could have taken years can now be carried out in about a week.
Source: The Information
RSI is not near, imho it is pretty much here or thereabouts @Dr_Singularity
acceleration news
OpenAI has reportedly automated much of the process of training experimental AI models.
Its internal models can write and optimize GPU kernels, run optimization work for weeks from a single example, and even collaborate with other AI agents without human involvement.
Employees say this level of automation only became possible in the last few months. 👀
The loop is starting to close.
AI retweeted
DeepSeek CEO Liang Wenfeng told investors that using more domestic chips for AI training is now a major priority, with Huawei expected to begin deliveries as early as Q4.
Note: DeepSeek is training a 2T-parameter model and plans to eventually build an 8T-parameter model.
AI retweeted
Apparently Trump's Eva Braun, Natalie Harp, is now running the country. She feeds the 80-year-old dementia-addled psychopath clips of MS NOW and CNN hosts ripping him apart, then watches him lurch into whatever insane, fascistic fantasy her heart desires. Her latest win: Trump banned MS NOW, CNN, and Politico from the White House.
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics.
The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning.
Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community.
openai.com/index/advisory-gr…
AI retweeted
OPENAI HAS LARGELY AUTOMATED TRAINING OF NEW EXPERIMENTAL AI MODELS
OpenAI’s internal AI models can now handle much of the process of building and training experimental models, including writing GPU kernels and optimizing the code used to run them.
Researchers can reportedly give an AI a single example of the optimization they want, then let it work for weeks implementing and testing similar improvements.
OpenAI employees also say internal agents increasingly collaborate with each other to solve problems without involving their human users.
The capability has improved significantly in just the last few months, while OpenAI’s growing access to compute is allowing researchers to test ideas much faster. Employees said some experiments that previously could have taken years can now be carried out in about a week.
Source: The Information
AI retweeted
Introducing Altar-1, our first open-weight security model.
Frontier-grade defensive AI, built to deploy. Own your own security.
AI retweeted
Introducing Xiaomi MiMo-V2.6 — Pro & Flash.
Frontier intelligence, all the modalities, built in public.
🔹 Two omnimodal models, advancing through scaled reinforcement learning
🔹 Pro performs on par with Claude Opus 5 and GPT-5.6 Sol across most agent benchmarks
🔹 Pro scores 46 on the Artificial Analysis Intelligence Index — the highest among open-source models
🔹 Stronger coding, computer use, 3D reasoning and creative capabilities
🔹 Open model weights, technical report, RL environments and training code
Blog:mimo.xiaomi.com/mimo-v2-6
Gary Lineker calls Sir Jim Ratcliffe an ‘unpleasant human being’ amid Man Utd criticism trib.al/lGOuCBn
We just launched GLM-5.3-FlashX. Up to 200 tokens/s. Faster version of Flash.
Been using it myself, the speed makes a real difference. Going back and forth on code feels much smoother.
If you care about speed or do a lot of back and forth work, give it a try:)
Faster GLM-5.3-Flash is now live: up to 200 tokens/s. Model code: glm-5.3-flashx.
Priced at 2.5× GLM-5.3-Flash on both the Coding Plan and API.
Open to all API users. Coding Plan users can apply here:
docs.google.com/forms/d/e/1F…
AI retweeted
Math Academia as we know it is over.
This will trigger some people.
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics.
The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning.
Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community.
openai.com/index/advisory-gr…
holy shit.
OpenAI's newly trained internal model has resolved the Navier–Stokes Millennium Prize problem and more than 100 long-standing open problems across most areas of mathematics
the pace of its progress has surprised even the mathematicians within openai
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics.
The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning.
Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community.
openai.com/index/advisory-gr…
This is the way. Can’t confirm but rumours and gives a source. We hear Sam Altman hint at a launch this week and so we should expect Anthropic to respond. But I am not going to write posts claiming I have knowingly tested Opus 5.2 or 5.5 when I cannot say that with high confidence.,
I can't confirm any of this, but I'm at least hearing the rumors.
1) GPT-6-Sol will be another significant leap forward; its price-performance ratio compared to Astra will be surprisingly good. Most likely, it will be released on Tuesday.
2) Opus 5.5, in response to OpenAI's move, is also expected this week, today or tomorrow. A significant leap forward; OpenAI and Anthropic are currently neck and neck. Opus is a response to GPT-6-Sol.
What's new to me is that "Bel" is internally referred to as AGI. Considering the graph, which still shows how quickly OpenAI's models continue to improve, this isn't surprising (graph below).
Great initiative on data
Announcing one year of LLM inference metadata traces, with 6.12 billion requests.
We hope this dataset can support research on real-world LLM serving workload understanding, system design and infrastructure optimization. Explore the dataset and learn more: data.agentic-system.org
Driven by our great graduate student William Nixon and
in collab with @jon_durbin @airesearch12 @chutes_ai
Competition in next gen LLM looks set to continue to accelerate
Glad that this note has received a community note. Old research using old models and its findings overstated.
Oxford researchers just published a paper arguing LLMs cannot invent anything. Mathematically impossible.
The reason is simple and brutal. A model trained to predict the next word can never believe something the existing data says is wrong. And every real breakthrough in history started with exactly that belief.
In 1903 every prediction machine on Earth would have told the Wright Brothers that human flight was one to ten million years away. Nine weeks later they flew. Not because they had better data. Because they had a theory the data hadn't caught up to yet.
That is the gap between AI and human thinking. LLMs mirror the past. Humans reason into a future that doesn't exist yet. Oxford just proved mathematically that those are two different things.
I use these models every day. This matches what I see. The new stuff always comes from the human at the keyboard who decides the data is wrong.
LLMs don't think. You do.
Readers added context they thought people might want to know
This paper published 2 years ago has zero mathmatical proofs in it at all. It contains no equations and is a conceptual essay. Claiming from it that anything is mathmatically proven is false and misleading.
Original paper:
pubsonline.informs.org/doi/10.1287/st…
AI retweeted
Beware of what you read on social media. @pradeepXkapoor this is Opus 5 training cut-off date - May 2026 and is not evidence of you using Opus 5.5
support.claude.com/en/articl…
Guys, Opus 5 is being routed to Opus 5.5 again for me. I think this confirms tomorrow is a launch day
I checked the moment I saw the first response from Opus 5 in a project I was working on.
Beautiful 😭 time to test Claude Opus 5.5 properly again.
Included the time (I am in IST) in the screenshot too as proof so you don’t think I’m making this up lol.