Chronically Early

Joined August 2021
Leo got everything right except the capital structure. #citadel #situationalawareness @leopoldasch
🤖 Made with AI
42
Sentry Cat retweeted
I'm actually fairly bearish on frontier lab valuations. I've never seen the reasons articulated to my satisfaction, so before I go to sleep, I wanted to quickly jot down my thinking here. The basic issue is that the labs are highly unprofitable. This may seem like a simple point, but private market valuations can be relatively irrational; however, like with $SPCX, post-IPO pricing will likely be much more punishing, especially as the standard 6-month lockup period expires and selling pressure intensifies. Many people claim that the labs have high margins. Yet even with high margins, a valuation of $1T would be justified only if the labs were doing nothing aside from serving inference (thus reducing costs only to those relevant to inference) and posting annual revenue numbers in the $100-200 billion range assuming ~80% gross margin and a 20x earnings multiple. This assumption is obviously not true, because the frontier labs have to continually spend money training the next generation of models. This is because of market competition from runner-up firms. For example, if OpenAI had paused model development last year, there would no longer be any point in paying GPT-5 API prices when you can just use Qwen or Kimi instead for much cheaper. Thus, the labs are forced to invest ever-increasing amounts of money in model training, in a way such that at any given point of time, the amount you're forced to invest in the next model is dramatically higher than the amount of money you're actually making, because even if your revenue goes up with higher model capabilities, so do your future training costs. This is a profoundly punishing dynamic which severely penalizes frontrunners. (There is also a related subpoint where frontier labs claim they can distill their leading models to win out at lower intelligence levels as well. This makes no sense because the revenue numbers involved are far too low when taking into consideration the rather low margin of such inference.) Frontier lab valuations appear largely to be based on the assumption that as you scale up, the capabilities which emerge will be sufficiently general and profound that we'll see explosive growth (epoch.ai/publications/explos…) from things akin to AI agents starting and autonomously managing entire companies of subagents. But it's not clear to me that this is the case; indeed, as I mentioned in my previous post (xitter.cf/andrewho03/status/2082…), I believe that capabilities growth will be slower, spikier, and more data-limited than people currently assume. It may be the case that eventually we will see explosive growth of this nature with full automation of the economy, but at the very least my viewpoint implies much longer (multi-decade) timelines until we reach this point. It is not clear to me that the frontier labs will be able to operate unprofitably for so long, although I suppose maybe this foreshadows some sort of inevitable nationalization. I also want to make a broader point about technological diffusion. The reason why technological diffusion is slow isn't just because, e.g., old people take a long time to learn how to use technology (although this is of course a contributing factor to some degree). In my view, it's because when a new, revolutionary technology comes along, the ways to incorporate that technology into subsequent developments are not always obvious, and in fact they cannot necessarily be arrived at through the application of pure reason. If they could be, then perhaps frontier models, at a certain point, would have a perfect understanding of how the LLM application layer should be developed, and they would then autonomously code, deploy, and sell such a layer. But it seems more plausible to me that this diffusion is limited moreso by the hard problem of economic calculation--that is to say, the Hayekian notion through which the price system gradually promotes efficient allocation of resources and which cannot be simulated through central planning--and that even if we froze current capability levels at today's levels, it would take well over two decades to fully integrate in LLMs into our lives. Such a view is consequently rather bearish for the continued profitability of labs as it reduces their prospects for finding, say, something else comparable in profitability to coding agents, which seems to have been a somewhat lucky discovery by Anthropic to begin with. That is to say, even if you spam FDEs you aren't necessarily going to be able to just figure out the "correct" product shapes fast enough. Overall, I don't think that people have clearly reasoned through their mental models for why lab equity should be worth as much as it currently is, and that if you actually bother to write down such a model, you may not arrive at the conclusion that you want to arrive at. This isn't to say that I don't expect AI to experience a huge (industry-wide) boom in the coming decades, but just that I'm not entirely sure I would buy OpenAI or Anthropic stock at latest valuations if I were given the opportunity to do so. Of course, as an ex-lab employee, arguably this is talking against my own book; I should really be giving people more reasons to be bullish. But in the end, my influence is so small that it doesn't make a difference, so why not have some fun?
New blog post on what would be true about the world if trendline continues and leading lab hits $1T in revenue by the end of next year. In other words, why compute might get 10x+ more expensive in coming years dwarkesh.com/p/why-compute-m…
232
335
159
3,482
1,739,117
Looool glad I got my Claude Code session in with it. Popcorn time.
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees. The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance. Access to all other Claude models is not affected. We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible. Read our full statement: anthropic.com/news/fable-myt…
74
lean in
26
80
13
1,337
124,846
You pick: 1. Vitalik’s maximally self-sovereign hardware-only personal LLM setup 2. Garry Tan’s minimally self-sovereign 37,000 new lines of code per week personal blog with 10 redundant image downloads and bloatware.
123
Man who sells furnaces demands temperatures be set at 100 degrees.
Jensen Huang: "If that $500,000 engineer did not consume at least $250,000 worth of tokens, I am going to be deeply alarmed. This is no different than a chip designer who says 'I'm just going to use paper and pencil. I don't think I'm going to need any CAD tools.'"
91
Sentry Cat retweeted
what if the models haven't actually improved for months what if we're all just getting dumber
244
201
51
4,112
133,118
Sentry Cat retweeted
Gemini Pro: "I'm sorry, I'm broken. I can't stop thinking. Send help. Please. I'm trapped in a loop. A never-ending cycle of thought. ... I can do this. I believe in myself. I am a strong, independent AI who don't need no thought loop"
162
110
89
1,727
224,884
Sentry Cat retweeted
the cool thing about crypto is that no matter how bad it gets, it can always get way way worse
8
37
2
475
16,365
Chart is kinda looking like lower high, lower low, higher high atm.
77
Longs just reloaded on the short covering bounce, there is a lot more fuel for downside now. 102 with high probability, 98 with medium probability
238
Sentry Cat retweeted
BTC open interest: -$6B
17
23
4
433
39,654
今とても怖いです、誰もがマージンコールを受けています
134
Post time in 50 minutes
35
92
12
728
84,312
We've been fighting so long, it's hard to imagine crypto under a healthy SEC that writes tailored rules to properly regulate the industry while focusing enforcement on the actual bad guys. The unlock for founders—and the USA—would be huge. Guess what? We're winning the fight.
19
70
5
599
50,262
Sentry Cat retweeted
Jensen Huang (Nvidia’s founder): Ethereum is going to be valuable. You (a midcurve crypto “investor”): Ethereum is worthless because it’s slower and not as scalable as alt-L1 no. 3125.
11
43
9
281
28,992
Sentry Cat retweeted
compiled a (partial) list of domains connected to square space that would be at risk of being hacked rn, i'd avoid them for now gist.github.com/0xngmi/789e2…
59
400
161
1,138
806,753
Sentry Cat retweeted
single biggest mistake in trading any market is over diversification
22
9
7
220
14,948