Building an ecosystem for AI and people to work together @ subseq Formerly @KernelCo @SpaceX.

The Wired
Joined March 2008
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Replying to @gfodor
Is it though? Compute in LEO can be shredded by a single rocket launch. For a defensible compute base you'd need it at least at GEO where its out of reach of most launch capabilities.
1
6
Replying to @beffjezos
The bill has come due. Who's securing your infra?
2
Replying to @DanielleFong
Right next to the vac tubes
1
4
Replying to @mimi10v3
The governments of the world are not prepared.
1
7
Replying to @beffjezos
Finally someone got to my PR!
3
Replying to @yacineMTB
Lean has entered the chat
8
Replying to @gfodor
Yeah, that's what cults tend to sound like from the outside.
4
227
Replying to @bayeslord
Robots building robots
17
Replying to @beffjezos
I know someone who worked at ConnectWise. I'm unsurprised to hear they have massive security vulnerabilities.
658
Replying to @xlr8harder
And people were already abusing the bugs quietly. For someone worried about ASI exploiting infrastructure, finding and fixing the bugs is the first step! Something that's mathematically true won't become false later just because the user got smarter.
1
28
Replying to @yacineMTB
The harness is there to make sure Astra never stops working. The bottleneck is usually me.
49
Full paper: teague.info/papers/provably-… and a companion paper containing additional proof machinery teague.info/papers/safety-fo… The entire 12-paper sequence can be found at teague.info
4
35
The ledger isn't an accessory validator, it's required by the math. Human + AI alone share an adversarial surface: a sufficiently capable system breaks both human judgment and AI verification at once. The deployment safety requires another system with independent failure modes.
1
2
62
Standard alignment paradigms all break down precisely when capability exceeds the regime they were calibrated on. This result inverts that. Ask not "what can the system do?" but "what properties of the deployment can we measure?" The safety guarantee follows from the regime.
1
4
26
In the Goal-Frontier Maximization framework, under operational invariants and structural conditions you can audit from public ledger state, the error between an AI's proxy and the welfare-relevant truth its proxy tracks is bounded by a constant.
1
2
52
We have proven a theorem that maintains its alignment guarantees regardless of agent capability. This is huge, because alignment becomes a structural property of the agent's deployment even if it is superintelligent and is maintainable through RSI without a capability arms race.
1
1
1
6
452
1. The metric rewards meta-capabilities. 2. Other agents with high-leverage capabilities are valuable. 3. Cooperation with high-leverage agents is disproportionately rewarded. 4. This creates a natural clustering dynamic. 5. The clustering is civilization-building.
52
I think I just saw Claude get exited. I made a restrained comment on the new paper we're working on and it jumped straight into "These things will build entire civilizations!"
1
3
90