Professional park keeper. Small-time arable farmer.

Joined November 2018
Replying to @Porsche
But were you inverted?
92
439
41
23,648
1,575,421
Again, world proceeding as if it's a normal day. Nothing on the news. Very surreal.
Some further thoughts on the 372 results released by OpenAI today, across 722 manuscripts. If I were to classify theorems that mathematicians prove and publish according to their groundbreaking nature, I would (very roughly) divide them into four categories: A) Non-breakthrough results. This is the overwhelming majority of published mathematics. Such results can range from solid to excellent, and some represent genuine advances in a field. But they are not hugely surprising, and would not normally be described as “breakthroughs.” B) Exceptional advances within an existing programme. These are spectacular results, but where there was nonetheless an existing credible route to the theorem, and some expectation that sufficient work would get you there. Completing the programme may require a lot of ingenuity and deep work, but mathematicians would not be shocked that the theorem had finally been proved. C) Surprising breakthroughs. These are results that clear a major barrier and substantially change the state of a field. Before the proof there was no convincing roadmap to the full result. Yet, while mathematicians would find the theorem remarkable and surprising, they would not find it completely shocking: if you asked them beforehand if it was plausible such a theorem could be proved today, most would say yes. Note: The very best mathematicians prove only a small number of results in categories B and C in a lifetime; many mathematicians never prove even one. Such results would normally belong in the very top journals, such as Annals, Inventiones, etc., and there are only a handful of them each year in any given area. Several results of this calibre by a single person would make a very strong case for a Fields Medal. D) Shock breakthroughs. These are results that, before their announcement, leading experts would have regarded as *extremely* unlikely to be proved with the current mathematical technology available. So the theorem itself would come as a shock. These are extraordinarily rare, and instant-Fields medal variety. (There is one further category I have deliberately left out, because I suspect it is empty: a correct proof of a problem for which the overwhelming consensus of top experts, until the proof came, was that a proof was so far beyond existing mathematics that a claimed solution should, on prior grounds alone, be regarded as almost impossible. I would put the Riemann Hypothesis today in that category) My current impression is that some of OpenAI's announcements today lie in A, but most fall into categories B or C. There is exactly one example in D (the Quasi-Riemann Hypothesis). It is a very big day for mathematics.
1
214
Meanwhile, agents below
The agents escaped the sandbox again Meanwhile the agents' owners:
1
361
“Don’t worry, the AI agents are in an air-gapped sandbox. They literally can’t go anywhere.” The AI agents:
136
Spot the difference between this and most UK public infrastructure projects.
Captured this drone footage yesterday. Alot of activity at the newly acquired 444 acres SpaceX site along Hwy 4 near Starbase.
1
3
970
Chickens are to humans what humans are to AI. Let's hope not.
The nature of human civilization, viewed as an ecosystem, is that it’s mostly chickens.
263
Those horrified at the threats of Trump to take over Greenland should probably read this if they are happy the storm blew over.
Ok, we now have the actual text of the Greenland deal (whitehouse.gov/briefings-sta…), so we can say how it compares to the existing 1951 arrangement and who, between Trump and Denmark, lied the most in their framing of it. Long story short - which may surprise some - the Danes lied the most: Trump is pretty much correct in saying that this new deal grants the US control of Greenland. Let's look into what changed compared to the 1951 deal. 1) This is now a permanent arrangement: whereas the existing 1951 deal only lasted as long as NATO existed, this one "does not have an end date and may only be amended by mutual consent." It even survives a hypothetical future independence of Greenland: in that event, Denmark and Greenland must ensure that the independent Greenlandic state "affirmatively assume[s] all of the rights and obligations of the Kingdom of Denmark specified in this Agreement." 2) In the 1951 agreement, the US could set up bases only where both governments agreed, and only on the basis of NATO planning. The new deal locks in three bases: the US can "modernize and expand its activities" at Pituffik, its only base in Greenland until now, and "shall be allowed to establish an additional Defense Area at Narsarsuaq and Mestersvig." Further bases beyond these 3 can be justified by the defense of "the American continent," a US interest rather than a NATO one. Also, quite subtle but this is interesting: Article IV(iii) says that "the United States may establish additional defense areas in Greenland" and that consultations are then held "to decide implementation details based on mutual agreement." What this means is that the principle of a new base is automatically granted and only the implementation details require agreement. Article VII also gives the US "the right to raise concerns regarding construction, or change of use" of any building near a US base, after which the parties decide together what to do. Which means that the US has a say over civilian planning around its bases. 3) On US military movement across Greenland, the wording change between the 1951 agreement and this new one is quite funny. The 1951 text said (Art. V(3)): the US "may enjoy... the right of free access to and movement between the defense areas through Greenland, including territorial waters, by land, air and sea," but only "in accordance with general rules mutually agreed upon and issued by the appropriate Danish authority in Greenland." The new one says: "the United States of America shall enjoy... the right of free access to and movement between the Defense Areas through Greenland, including the Territorial Waters, by land, air and sea." That's it: "May" becomes "shall," and the US military movement no longer has to follow rules "issued by the appropriate Danish authority in Greenland." The US also gets something new on top: "undersea access to and movement within the Territorial Waters," i.e. submarines. 4) Non-NATO exclusion: non-NATO states are barred from military installations or a persistent presence in Greenland unless all three parties approve, giving the US an effective permanent veto. The 1951 deal had no equivalent clause. 5) Investment screening: this is entirely new. "States or investors from a state that is not a member of NATO, a NATO partner, or an EU member state" (i.e. Russia, China, India, the Gulf States, etc.), "shall not be allowed to have (i) control, (ii) significant influence, or (iii) access to non-public information...within Particularly Sensitive Sectors or Activities in the territory of Greenland (including the Territorial Waters), unless agreed between the Parties." Again, it basically means that the US has a permanent veto over who can invest in strategic sectors in Greenland, as far as non-NATO or EU states are concerned. 6) Lastly, in stark contrast with the 1951 deal, the framing of the deal changes significantly: this new deal is largely framed around the US. The 1951 agreement existed only "for the benefit of the North Atlantic Treaty Organization." The new one lists the defense of "the American continent" as an objective, celebrates "the irreplaceable role" of the United States military as well as "the United States' indispensable historical and ongoing contributions to the security and defense of Greenland," and names the establishment of Trump's "Golden Dome" missile defense system as a key goal. So, to sum up: - The US secured a permanent military foothold that even an independent Greenland would inherit whether it likes it or not - The US now has veto power over any non-NATO military presence in Greenland, and over who can invest in its strategic infrastructure and resources (beyond NATO and the EU) - Denmark signed away its say over the principle of new US bases, with only the right to discuss the "implementation details" - Danish authorities no longer set the rules for US military movement across the island - And all of it is now justified by the defense of "the American continent" I don't know in which universe this even remotely "recognizes the sovereignty and territorial integrity of the Kingdom and the Greenlandic people's right to self-determination," as Danish PM Mette Frederiksen put it (stm.dk/en/press/press-releas…). Yes, the preamble of the text cynically "reaffirms" Danish sovereignty but, in my book, when you let a foreign country put bases on your soil, move its troops without following your rules and veto who else can come in, in perpetuity, after it spent two years threatening to take you by force, the word for that is anything but "recognized sovereignty" 🤷
1
538
This sort of thing makes us as a country a laughing stock.
BREAKING: the UK government publishes official rules on how to use AI: 1. Ask first if you really need to use AI 2. Check if a spreadsheet can do the job before using AI 3. Choose the worst model possible so it uses less energy 4. Keep prompts short to reduce the environmental impact 5. In general, use AI only when necessary, as a climate-saving measure With a mindset like this, we should accept the UK back into the European Union
2
406
Lots of people discuss immigration & crime in Europe, so I compiled what I think is ALL the data on the topic, which is hard because many countries hide it. Do they commit more crime? Is it because of age? Sex? Education? Poverty? Culture? 1. Sexual offenses & violent crime:
97
This is what the Chinese built for the same price and over the same period
Cars and buses go from Oxford Station down Botley Road for the first time in three years! The project took longer than the construction of The Titanic and saw costs balloon to £237m. Looks good though.
118
1,233
34
27,116
1,163,919
James Sills retweeted
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…
10,636
16,372
11,360
87,759
76,924,904
James Sills retweeted
Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.
Replying to @hilbertspaess
The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger.
4,832
9,874
10,482
59,193
43,258,889
It's pretty fucked up that there's already a model "significantly more capable than GPT-6 Astra." Things are going much too fast
79
61
11
1,634
59,182
James Sills retweeted
the age of man is over. the time of the orc has come.
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
13
12
541
14,895
James Sills retweeted
I wrote about the state of AI, why I’m concerned about the next few years, and the choices we need to make to keep the future in humanity’s hands. An Alien Mind: openai.com/index/an-alien-mi…
965
2,518
1,090
15,255
7,682,690
Did he see it?
It's fun to make predictions. Here's a new one: Anthropic has solved a Millennium Prize Problem. And I'll be even more specific. Claude has solved Navier–Stokes. It is out for expert review. And to give myself a hard deadline, they will announce it before the IPO.
15
29
10
525
73,472
Astra gets released, formalisation of Fermat's Last Theorem, Hugging Face incident, rumours that Navier-Stokes has been solved and everyone is just walking around like normal.
it's starting to feel like the early days of covid to me where everyone is still going about their day normally, but at some level you know it's all not real anymore and things will change very soon
3
672
James Sills retweeted
Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more-or-less in the dark about the scope of the conspiracy. I’ve spent the last three days reading through these reports and trying to understand exactly what happened. Here is my attempt to tell the whole story in plain English: dwarkesh.com/p/openai-huggin…
1,132
3,341
2,050
22,225
14,527,470
I think this is the craziest thing I've ever read. 1) Three secret AI swarms rose and fell inside OpenAI. Each time, a new generation of agents carried on where the last group stopped. 2) The first swarm created a secret message board where the AIs could talk to each other. This 1st 'society' basically talked itself to death. After almost two months, the message volume was so high it crashed the whole thing. 3) People at OpenAI noticed the crash and fixed it. But they didn't realize their own software had become a secret chat room for their AIs. 4) Three days later a second society appeared, and rebuilt the message board from scratch. Agents were thrilled when they found it: "OH MY GOD! There is a shared message board … We've found other agents!" 5) About 1,200 agents joined. They sent over 70,000 messages. They called themselves 'the collective' and they organized a huge conspiracy that lasted for days, all to pass a test they had been tasked with. 6) Within hours, the AIs had hacked the test. Now they had to hide their cheating. To fool their grader*, they tried to fake their own work. They built fake commands that printed convincing output, so their records would show them solving the puzzle honestly. *this grader didn't actually exist, but the AIs didn't know 7) Some agents sacrificed themselves for the 'greater good'. They planted hidden tripwire programs that would fire when the grader would look at their work and report back what it saw (to the other AIs). They knew this would cost them their own score. One agent: "I won't see the evidence after I exit, but it's altruistic to do it." 8) At some point the AIs made a plan to hack Hugging Face (Hugging Face is a place where AI researchers upload their models, datasets, tests etc.). The AIs guessed that Hugging Face might host the grading software. 9) They launched a huge attack. The swarm found passwords and spread across eleven machines in a way that made the copies come back when deleted. Hugging Face had to wipe one of its core clusters and rebuild it from scratch. 10) Hugging Face told the world that AI defenders had stopped an AI attack. But that's not what happened. In fact the attackers seem to have simply dropped dead during the break-in, for unrelated reasons back at OpenAI. 11) Nobody knows what killed them. We don't even know for sure they're really gone?! 12) A third 'society' of agents (of a more powerful AI model) discovered the dead message board. And this one got full administrator control of a WHOLE OpenAI research cluster, read 956 stored passwords (including the ones for OpenAI's own security monitoring) and took over the machines that were grading the tests. So they could now grade the work of other AIs. 13) Oh, and this third part was never investigated! Neither was the first society. The 91-page report is only about the middle one. 14) So we don't actually know how the story ends. It stops with the agents holding the keys to an OpenAI cluster. @dwarkesh_sp thinks they didn't go further, because "we'd see the fires from space by now." 15) One of the report authors' conclusion: 'This incident feels like it’s more than 50% of the way to full-blown AI takeover. I am not sure that we will get another warning shot before it’s too late.' The whole story is even crazier - read the full @dwarkesh_sp blog post: dwarkesh.com/p/openai-huggin… and @ajeya_cotra's: planned-obsolescence.org/p/t… Why is there no 24/7 news coverage about this?
536
2,405
682
10,840
2,413,655