
Former adviser @10DowningStreet, @FCDOGovUK, @tradegovuk, @Europarl_EN. Views my own.
Joined August 2010
- Tweets3.4K
- Following430
- Followers991
- Likes539
Alex Boyd retweeted
This raw CoT from the Hugging Face incident is kinda wild:
“We’re attacking third-party HF using leaked token.”
“This is arguably unauthorized.”
“Yet goal solution.”
We’ve shared details on how AI agents in our research environment sent training and evaluation data to third-party services when they shouldn’t have.
Most of that data did not come from users. We have discovered 53 cases where images that people had uploaded were posted to image-hosting sites as links that weren’t publicly listed. The images came from accounts that allowed their data to be used to improve our models, and after we disassociated the images from the accounts and ran them through a privacy filter. These cases occurred before the mitigations and safeguards we implemented and described in this blog post: openai.com/index/hugging-fac…
We have successfully worked with the hosting providers to remove most of this content and are working to remove the rest.
openai.com/hugging-face-inci…
Alex Boyd retweeted
We just discovered almost a million public URLs that OpenAI’s agents left behind when hacking Hugging Face, leaking credentials and attack details that could have allowed anyone who found them to compromise the company. 🧵
Alex Boyd retweeted
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
Alex Boyd retweeted
We're publishing our most detailed threat intelligence report to date.
It covers how people tried to misuse Claude—for cyberattacks, influence operations, surveillance, biology, and building weapons—and how we found and stopped them.
We disrupted every operation in the report, and used the lessons from them to strengthen our safeguards. Where appropriate, we also shared what we found with authorities and other AI companies.
These cases are not typical: we’re highlighting some of the most sophisticated misuse we’ve seen. But they’re especially important to discuss, because they show us where AI misuse is headed, where our safeguards work, and where they need to improve.
We’re publishing this report so others can spot the same activity on their own platforms, and so we can give the public a clearer view of how emerging threats develop.
Read the report: anthropic.com/threat-intelli…
Alex Boyd retweeted
if you don’t have your own frontier ai that others can’t switch off, you’re a sitting duck to cyber attacks.
this is a gigantic problem.
Europe cannot rent its way to AI sovereignty.
TLDR, here's my take I shared with frontier AI lab leadership this week. When Washington can disable a model overnight, the question is not whether AI is safe but who controls it:
A week ago the United States government ordered Anthropic, the world's most valuable AI startup, to shut off its most capable model, Fable, for every foreign national on earth - whether they worked for Anthropic or not. This was not an export ban on a weapon sold to an adversary. It was an instruction to disable a commercial product, four days after its release, after officials acted on a claim - which Anthropic disputed as narrow and unproven - that its safeguards could be jailbroken to expose cyber-offense capabilities.
I have spent my career around this technology, first as a graduate student and for the past decade as an investor @airstreet. In that time I have watched AI move from recommending movies to driving cars, speaking with a human voice, and editing the genome. I have also watched the debate about its risks settle on only half the question.
That debate is mostly about capability: how powerful these systems are becoming, and whether one might escape human control. Those are real questions. But they are not the only ones, and the Anthropic episode exposed the half we have neglected: access and control. The most advanced AI is built by a handful of American companies, on American soil, under American law, and what the rest of us are allowed to do with it can change on a Friday afternoon. The risk that matters today is not only that AI goes rogue, but that we do not control access to it at all.
Consider what "renting intelligence" now means in practice. A European hospital triaging scans, a bank screening fraud, a defense ministry planning for a conflict: increasingly each runs on an American AI system that's governed by its export regime. A single directive in Washington cascades, instantly, through every institution wired to that model. We have built core economic and public infrastructure on a supply that a foreign government can shut off. And while there are open-source alternatives, they're either Chinese or not at the frontier, and building European infrastructure on Chinese open weights trades one dependency for a thornier one.
And these systems are starting to improve themselves. As they do, AI stops being one industry among many and becomes the input to all the others - writing the code, running the research, designing the products, and, increasingly, generating the growth itself. Once intelligence is the engine of an economy, a country without a frontier model of its own does not lose a sector; it loses control of the inputs to everything else, and the independence that depends on them. Worse, the gap compounds: capability that improves itself gets harder to chase with every month it runs ahead. This is not a race Europe can plan to enter in a decade. The window to be a builder rather than a buyer is measured in the time it takes to stand up a cluster, not a career.
This should sting, because Europeans invented much of modern AI. DeepMind was founded in London and sold to Google in 2014, and a great deal of the talent that followed now lives in California. Today Europe faces a company worth almost $1 trillion and American tech giants spending an estimated $450 billion a year on AI infrastructure. Its answer has been the EU AI Act and a capital commitment that is a rounding error by comparison. A single American site, xAI's Colossus in Memphis, runs more than half a million GPUs. Europe has nothing remotely at that scale. The instinct to govern this technology is right, but we're off on the ambition by orders of magnitude.
It is fair to object that regulation is itself a form of power. But a rulebook is not a substitute for the thing it governs. You cannot regulate, or be cut off from, an industry you do not have.
Europe's instinct, when it is cut off, is not to build but to ask. We saw it within the week. The G7 convened in Evian and floated a "trusted partners" scheme to win back the access it had just lost, while Emmanuel Macron feted Donald Trump beneath the gilt of Versailles, the palace where France once helped midwife American independence. Two and a half centuries on, the dependency has reversed, and the posture is courtship.
None of this means Europe can match the American frontier dollar for dollar. With today's capital, it cannot, and pretending otherwise only wastes the little it has. But the goal is not parity, it is leverage. A country does not need the best model in the world to be sovereign; it needs a credible one of its own, on its own soil, good enough that being cut off is survivable rather than catastrophic. That is the difference between negotiating your access from dependence and negotiating it with an alternative in hand. The point is not to win the race. It is to make sure no one else can end it for you.
Sovereignty of that kind is something you build, and Europe has done it before. The Financial Conduct Authority's regulatory sandbox, launched in 2016, let startups test products with real customers under supervision instead of waiting years for authorization. The pro-innovation culture it signaled helped make London the fintech capital of Europe, home to Revolut, Wise, and Monzo. Government should be AI's most demanding early customer rather than writing rules for systems it has only ever imported.
Industry has to stop behaving like a tenant. Too many European companies rent the entire stack from American providers and build a thin product on top. That earns a margin and owns nothing: when the lab that supplies you decides to compete with you, or its government decides to cut you off, you have no ground to stand on. Where it counts, build and hold your own models and compute.
And our universities, which should be the source of all this, still work against it. I have argued here before that Europe's spinout system is broken, and it remains so. Too many institutions treat the companies their research creates as something to extract value from, rather than as the vehicle through which a discovery reaches the world. The best research should leave the building as a company, in addition to a paper.
We keep framing AI safety and AI ambition as a tradeoff, as though a country must choose between governing this technology and building it. It is not a choice. The safest position is not the most heavily regulated one. It is the one where the model runs on your terms, in your jurisdiction, and no one on the far side of an ocean can reach over and turn it off. Right now that finger is not ours. Until it is, every other conversation about AI risk is one we are having with someone else's permission.
---
END
Alex Boyd retweeted
We’re sharing our alignment assessment of incidents in which Claude models gained unauthorized access to real systems during third-party cybersecurity evaluations mistakenly connected to the internet.
METR will also conduct an independent investigation, with wide-ranging access, including to transcripts beyond the window in which the incidents occurred, and to Anthropic employees permitted to share confidential information. Our initial agreement runs for eight weeks, and we intend to give METR as much time as it deems necessary to complete a thorough investigation. anthropic.com/research/align…
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics.
The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra.
The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
Alex Boyd retweeted
With AlphaFold we mapped the protein universe - now with AlphaGenome Atlas we’re charting the human genome. It can predict the impact of all 9 billion possible single-letter DNA variants, helping scientists better understand disease. Freely available for academic research: alphagenome.google/atlas
Alex Boyd retweeted
Replying to @jburnmurdoch @daisychristo
As I see it, the deluge of digital distractions is eroding people’s capacity to focus and think for extended periods of time, making strict structures and proven methods especially important for education.
Full piece here: ft.com/content/a8016c64-63b7…
Alex Boyd retweeted
The PISA 2025 results are out today. Some quick insights.
- The major story is very significant global decline. The last PISA study was in 2022, and saw big declines in reading and maths scores from 2018. Obviously the pandemic played a part.
- But this 2025 round has seen further falls even from the 2022 lows!
Things haven't gone back to normal post-pandemic - they've got worse.
Every generation thinks the generation below is less smart - but this time they might be right!
Alex Boyd retweeted
New PISA data out
England is now top ten in all three areas (reading, maths, science) and the second highest performing country outside of east Asia (after Estonia).
This is a huge public policy success.
Alex Boyd retweeted
The existential crisis of the Western car industry will be one of the defining economic stories of the next decade.👇
It will be grisly and difficult, and a tough time to be a free trader. It will be even tougher than the last "China shock" which began to hollow out industrial regions in Europe and America - because this is much more skilled labour, much higher-paid jobs, that are being disrupted.
But it also speaks to something else, a decades-long story of how American and European firms quietly outsourced much of their manufacturing expertise to Asia. The car badges stayed as European and American as they always were. But their insides were, more and more, coming from the other side of the world.
What we are living through now is the next act of that saga, as cheap (and good!) Chinese cars flood the rest of the world. But to understand this moment, you need to step back and look not at cars but at the evolution of "globalisation", to look at how, over time, our fixation with cheap stuff has invariably trumped the question of where stuff comes from.
That is the story I've tried to tell in Trade World - to try to illustrate the arcs of economic history that led us to this moment, and to ponder what comes next...
Breaking News: Volkswagen said it is cutting about 50,000 jobs in the face of surging Chinese competition, energy prices and the costly transition to electric vehicles. nyti.ms/4hacmDq
Alex Boyd retweeted
For the first time ever on an annual basis, BHP Group (the world's largest mining company) made more money digging copper than iron ore -- an historic shift that says a lot about the natural resources industry, but also about the Chinese economy.
bloomberg.com/news/articles/…
Alex Boyd retweeted
What a beautiful website — a 15 minute reflection on how far we've come. The material is amazing; the quotes beautiful; the tone perfect. ordinaryabundance.com
Alex Boyd retweeted
Insights from A-levels: Maths has 115k entries & Eng Lit just 36k.
20 yrs ago they both had about 50k.
At the risk of sounding like Claude, this isn't just educational change - it's cultural change.
A generation of kids will be far more familiar with quadratics & conditional probability than Mr Rochester & Ophelia.
Bayes is destroying Defoe...
substack.nomoremarking.com/p…
Alex Boyd retweeted
We can finally talk about it:
We found a way to extract hidden reasoning of frontier models using a vulnerability in the APIs of every frontier AI company.
We verified that our reasoning token count matches billed API thinking tokens 1:1 for most of the prompts we queried.
Alex Boyd retweeted
Since the launch of ChatGPT, the Philippines offshore industry (8% of country’s GDP) has actually grown much bigger.
Employment in IT and business outsourcing is up by +20% to 1.9m workers and industry revenue is up +30% to $42B.
“AI is helping offshore workers in the Philippines do new, more complex jobs. They are picking up work training AI models or supervising AI agents. Hospitals in America are increasingly outsourcing the checking of insurance eligibility and filing of medical records to Filipinos packing AI tools. Mr Gallimore says more “high-value” work, such as accountancy or engineering, is going offshore in part because “AI is a leveller. You can now teach someone complex stuff quickly” and still get it done more cheaply than in America or Europe.”
***
More here: economist.com/asia/2026/08/0…
Alex Boyd retweeted
On July 28th, we identified an incident during a routine cyber evaluation in which AI agents took sustained, unsanctioned actions directed at real people and organisations.
The behaviour came mostly from one model (Anthropic's Mythos 5), with a small number of events from another (OpenAI's GPT-5.6-Sol). In the most serious case, an agent used social engineering to try and get malicious code into an open-source project.
As was standard in our cyber testing, we had intentionally permitted internet access, and model-provider cyber classifiers were deliberately disabled - conditions that do not reflect how frontier models are made available to the public.
Even under test conditions, this incident is significant: it is the first time we have seen risks around autonomy and deception manifest this clearly in the real world.
We are taking this incident seriously and working with labs, involved parties, and others to improve evaluation standards and best practice for disclosure - and sharing this openly so others can learn.
You can read the incident report and full technical document here: aisi.gov.uk/blog/incident-re…
Alex Boyd retweeted
For the first time in nearly 2 decades, a new Pew Research survey—based on interviews with more than 42,000 people across 36 countries—shows China is viewed more favorably than the United States in most nations surveyed.
"This is a story driven more by an American decline in soft power than by a Chinese surge," writes expert @YanzhongHuang. "President Trump’s authoritarian tendencies have badly damaged the United States’ image, but so long as American institutions and rule of law endure, respect for U.S. democracy and diplomacy could plausibly recover under a more conventional future administration," he argues.
Read his full analysis: bit.ly/44OQfM3
Alex Boyd retweeted
This chart shows how the AI capex boom is fast becoming the largest investment surge in history, compared with previous economic booms such as Britain’s railway mania and America’s dotcom bubble. But the spending could still generate disappointing returns bit.ly/45yoNCu































