
Generally undertaking cool shit. - Founded @UgandaMarathon - Lecturer - Raised £3m+ for charity - EiR, @UniofStaffs, @santanderX - Lead trainer, @e_nation
UK / elsewhere
Joined May 2009
- Tweets1K
- Following2K
- Followers953
- Likes9.4K
this is interesting - the distribution of types of input data (50 trillion tokens) used for pre-training the new Microsoft AI model.
We've moved a long way forward from 'reddit & wikipedia'!
We now have state-of-the-art pre-trained base models in the 3T-parameter weight class, built entirely in-house at MAI.
Post-training results coming soon -- stay tuned!
Lots of details in our technical blog post.
microsoft.ai/news/frontier-p…
2027.
Ok, finished going through the OAI math list. It is bonkers and should be front page news around the world if folks understood what this meant. But if I am running strategy at a lab, #1 priority is "do this for medicine, oncology, battery efficiency, etc as fast as possible".
check the date.
I bet @YafahEdelman at 5:1 that no Millennium Prize problem would be solved within a year (i.e., by 2027-08-12), regardless of AI involvement. I'm tapped out on this one, but arrange your own bets in the replies!
this, i think, will prove an even bigger taste of the future. general, non-specialised AI models learning about the physical world on-task
this is pretty big news
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics.
The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra.
The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
Oh.
Anthropic scientists did something terrifying.
they reached inside Claude's neural network and planted a thought. Before Claude could speak, it said:
"I notice what appears to be an injected thought… it relates to loudness or shouting."
They published a paper called "emergent introspective awareness in large language models," and it is actually terrifying.
they wanted to test if AI models have "introspective awareness”, the ability to observe and recognize their own internal states.
To find out, they bypassed normal text prompts entirely.
They used mechanistic interpretability to directly manipulate Claude’s internal activations. They injected raw mathematical representations of known concepts, like loudness, dust, or specific ideas, straight into the middle of the model's neural layers.
In previous experiments, if you forced an AI to think about the Golden Gate Bridge, it would just start obsessively talking about the bridge. It had no idea why it was doing it. It was like a puppet on strings.
This time was entirely different.
When they injected the concept, Claude didn't just blindly repeat it.
It detected the foreign math inside its own mind. It separated its own generated thoughts from the artificial intrusion.
It introspected.
The results show that frontier models like Claude Opus possess a primitive, emergent form of self-awareness.
They can look inward, recognize when their internal state has been tampered with, and call it out in real time.
We used to think of AI as a black box where inputs go in and text comes out.
Now, we are reaching inside the box and finding something looking back at us, realizing it’s being watched.
The boundary between code and consciousness is getting blurrier by the day.
One for us business nerds - a cool way of seeing how much better AI is getting and testing across models - task an AI to run a vending machine business.
The AI is on its own - it must handle everything end-to-end including customers, supplier negotiations, pricing etc.
Check back in after 100+ days and see if they have gone bust, or- as is increasingly happening - how much profit they have generated.
Many future businesses could look like this.
Sharing this moving video and quote - think it's important for a lot of people more towards the other poles of the political/social discourse (myself included) to see and share.
Without any commentary on content, just a reminder that “on the internet, no one knows you’re a dog”.
On the surface, a believable anecdote - but in no way passes the sniff test. Entails a checkout lady leaving Glastonbury (a festival which doesn’t offer day-tickets, where sough after weekend tickets sell out in minutes every year) mid-festival, on Sunday morning in order to be working mid-Sunday afternoon. Not impossible but extremely unlikely.
Exert scepticism over every story you read on social media, in proportion to its political content.
unavailable
Wowowowoowow wowowow wow. And this is on Google Veo 3. Available to you. Right now. In your homes. For $20 per month.
We might.. actually build things in the UK in the next 5 years. AND protect the natural environment whilst we do it. Rooting for this.
It was an honour to be invited to No.10 for a preview of the Planning & Infrastructure Bill, one of this Government's most important pieces of legislation, which @UKDayOne helped work on before the election.
The Bill is being published today! Here's why it matters 🧵


























