Daniel Buk (@DanBuk4) profile picture
Joined July 2014
Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)Photo by Daniel Buk (@DanBuk4)
Daniel Buk retweeted
AI companies are luring doctors, lawyers, and Ph.D.s with high hourly rates, only to subject them to the same sudden pay cuts and account deactivations that long plagued global data workers restofworld.org/2026/ai-jobs…
1
2
1
2
644
Daniel Buk retweeted
Housing discrimination enforcement plummets under Trump politi.co/4zwNV9r
17
14
2
21
17,877
Daniel Buk retweeted
Perfect. Just perfection.
25
440
32
2,594
215,933
Daniel Buk retweeted
A super insightful thread. @nicoleperlroth is a must read source on all things cyber.
This is what I mean when I say we've been living on borrowed time. AI is uncovering vulnerabilities that have lain dormant for years. That vulnerable code is now embedded in every nook and cranny of our physical world. We'll have to push updates as quickly as possible, and we may well "self-pwn" ourselves in the process. But a patch-induced outage is far better than the alternative: leaving the world's vulnerable code exposed to anyone with a multi-agent attack tool and a basic prompt "find me exposed systems, exploit their weaknesses, extort them for millions" or worse... We're living on attackers' clocks now.
5
16
2
65
4,390
Daniel Buk retweeted
NEW, from me and @peard33: While questions are still swirling around Huang's affair with an alleged Chinese intelligence asset, it was “multiple issues” related to Huang’s “lack of candor” and “lying” that ultimately moved the board of directors, sources familiar with the board's private conversations tell WIRED wired.com/story/jensen-huang…
94
52
30
285
234,987
Daniel Buk retweeted
NEW interview: Grace Mausser on @nycDSA's Growth, AOC for President Push, Relationship with Mayor Mamdani, & More Listen at Max Politics wherever you get podcasts /1 podcasts.apple.com/us/podcas…
6
7
1
56
7,462
Daniel Buk retweeted
This is a big deal: Obama privately told Dems that they need to aim very high on health care because the Obamacare model isn't enough. He suggested it's time to work outside the ACA structure, which will give a boost to those pushing for expanded Medicare: newrepublic.com/post/218243/…
64
602
94
4,302
326,251
Daniel Buk retweeted
Please follow Labyrinth
NEW POLL from @LabyrinthPol - Among Democrats and leaners: - 57% want Chuck Schumer replaced, just 17% want to keep him - Van Hollen leads Schumer by 17% in head-to-head - 61% oppose or unsure about another Kamala Harris candidacy labyrinthinsights.com/insigh…
4
4
20
3,197
This Thanksgiving, most voters plan to talk about the cost of living (65%), entertainment (64%), sports (58%), and local news (57%). Less than half plan to talk about the midterm elections (48%) or politics and the Trump administration (43%).
1
2
4
756
Reminder: racing to self-improve the verifiable subset of capabilities, which is what AI companies are currently doing, _decreases_ the window of time that they have to convert into sustainable businesses and do the boring work of turning value creation into value capture. (Of course, their bet is that progress in verifiable tasks will somehow yield progress on unverifiable tasks. We'll see.)
As AI labs race toward Recursive Self Improvement, there’s a possibility that what they are actually racing toward is Recursive Self Extinction — of their business model. Here’s my reasoning. 1. Progress on verifiable tasks continues. In particular, improving the cost efficiency of existing capabilities is a highly verifiable task. For the past few years, cost per equivalent capability has dropped by at least 10x per year. I think this progress will be sustained for a few more years, and even accelerate as labs use AI more and more heavily for AI research in the pursuit of RSI. There is of course a ceiling to efficiency improvements, but I don’t think we’re close to that ceiling. 2. Progress on most unverifiable tasks remains frustratingly hard. AI inherits the same limitations (ambiguous success criteria, slow and noisy feedback) that limit human performance at tasks ranging from writing to governance. The optimization paradigm generally doesn’t result in superhuman capabilities on such tasks, because whatever proxy you optimize for gets Goodharted. For example, I recently pointed out how over-optimization explains Claude’s overly dense and ornamental writing style that’s since been dialed back. 3. RSI ends up being narrow. A consequence of the above two points — even if some version of RSI is achieved, it results in an explosion in some dimensions (efficiency, verifiable tasks) while falling short of producing something that is superintelligent in any real sense or capable of automating a broad swath of jobs in the economy. 4. More than one lab stays at the frontier. This means the market will remain competitive, and developers can’t charge high margins to compensate for rapidly falling inference prices. Any compute scarcity that allows higher margins is temporary, in my view. I also think it’s likely that most of the innovations continue to make their way into open-weight models with some lag, so open-weight models are at cost parity for inference or only slightly more expensive. Note that efficiency tricks and verifiable capabilities tend to leak much faster than unverifiable ones. Distillation could be one reason, but simply knowing that something can be sped up 10x tends to have a focusing effect on research and innovation. 5. Jevons’ paradox is not a magic bullet. If the above points hold, there are very few applications that will consume so many tokens that they could generate the astronomical amounts of revenue implied by the labs’ valuations. We’re talking about a 10x growth in tokens year after year, just to keep revenue flat given falling prices. Even today’s behemoth tasks like migration of million-line legacy codebases will likely become cheap within a few years. While new applications will open up, there won’t be orders of magnitude more new ones. As for unverifiable tasks, inference scaling rapidly hits diminishing returns. Ultimately you have to have a human in the loop who’s accountable for the result. Spending more on tokens doesn’t let customers escape that responsibility — and only makes the human review bottleneck worse. 6. What about scientific research? Science is an endless frontier, and more tokens could perpetually mean more discoveries and inventions, in theory. But the unfortunate thing about research is that researchers don’t get to capture the value it creates, which is why it requires government funding in the first place. Even if it’s true that AI could enable great scientific innovations, I don’t think AI companies will make much money off of that. I think they are currently investing in AI-for-science not as a future revenue stream but as a loss leader because they want to show the public that it could be beneficial to humanity. 7. The one escape hatch is moving “up the stack”, by which I mean quickly transitioning from selling tokens to an enterprise software like model that relies on high switching costs, deep integration into workflows, and control over systems of record. In this world, enterprises will purchase “digital workers” or pay per solution (e.g. resolved support ticket) rather than tokens, so it’s good or neutral for AI companies if inference costs fall. And open models don’t matter as much — Linux being free didn’t make most enterprises switch away from Windows, because they paid for polish, peace of mind, support, and familiarity, not the code itself. I think this is the labs’ best bet for becoming sustainable businesses (though the potential lock-in is concerning for their customers!). The problem is that the labs have many hurdles to clear to get there, most of all their mindset, and the faster they race toward RSI, the shorter the window they give themselves for this transition. The pure-play AI labs are the ones who are farthest from being able to make this transition, and AI companies with a long history in enterprise software are relatively well positioned. In short, the race to RSI ends up being a race to eliminate the labs’ main avenue for capturing the value that they create — the fate of many past transformative technologies such as railroads, airlines, and fiber. The labs’ bet is that RSI produces a durable, decisive lead that escapes commoditization. My view is that there are two different improvement loops that have been conflated, and they will come apart. The efficiency improvement loop will accelerate, but a broader improvement loop that might lead to AGI or superintelligence will require ever-increasing amounts of compute, talent, data, and real-world feedback that can only come from gradual deployment, and the money to fund all this will have to come from massive revenue growth. And the irony is that the first improvement loop is undermining exactly that revenue growth. The premise in my chain of reasoning that I’m least confident in is #5 — that Jevons’ paradox will eventually stop being able to compensate for efficiency improvements. A few months ago I was much more of a believer in continued, nearly unbounded token volume growth, but the more I’ve thought about it the more skeptical I’ve become. To better understand why the premises and outcome I've laid out are at least a possibility: * My AI-as-normal-technology essay and follow-up writings with @sayashk on our newsletter normaltech.ai/ * My ICML talk laying out my skepticism of the claim that RSI will lead to superintelligence normaltech.ai/p/what-will-be… * Ramez Naam’s review of the evidence questioning the prospects of an intelligence explosion (@ramez) noahpinion.blog/p/wheres-the… * My piece with Akash Kapur (@akashkapur) on whether AI labs will move up the stack normaltech.ai/p/up-the-stack… * Many pieces by Nathan Lambert (@natolambert) such as “I expect rapid progress but not towards general superintelligence.”
9
6
3
104
9,261
Daniel Buk retweeted
Obama going on a nationwide tour with Bernie and Abdul to finally get us the healthcare system that Americans need would be a pretty solid redemption arc
Interesting how much the leaks, readouts, and clips from Team Obama have focused on his health care remarks. He's clearly signaling permission structure to go big. I hope the days of wielding Obama as a cudgel against going beyond the ACA are over. "There are better systems than the ones we've got. The ACA was jerry-rigged on top of a legacy system, and that's what we could get. You should push further and get more."
60
124
13
1,469
25,518
Daniel Buk retweeted
Meta and OpenAI want to take AI agents global, but fragile networks and language barriers pose steep hurdles across developing nations restofworld.org/2026/meta-mu…
3
1
3
587
Trump just said he and Xi agreed to joint guardrails on AI. That's big. Here's where US-China talks can start: ✅Keep nuclear decisions human. ✅Agree on AI risk definitions. ✅Open a dedicated risk reduction channel. Our letter to the Administration: ari.us/wp-content/uploads/20…
PRESIDENT TRUMP: "It's not artificial intelligence. It's not artificial, it's super. Problem is, it may be too super. So, President Xi and I agreed that we're gonna do some joint guardrails, the two of us."
2
6
18
604
Daniel Buk retweeted
AI is forcing companies to patch their systems faster as attackers race to exploit newly discovered vulnerabilities. Welcome to internet outage hell. buff.ly/dx3LOWa
21
81
10
187
22,083