is deep learning all you need? organic speculative decoder

Joined November 2019
AI will not automate radiologists like you think We have been talking for years now about AI automating jobs. Radiology has been a prime target, with Geoff Hinton once claiming, “people should stop training radiologists now, it’s just completely obvious that within five years, deep learning is going to do better than radiologists”, which is funny since he said that in 2016. There is now more demand for radiologists than ever, so clearly things did not turn out the way many thought. Here I will make a prediction that while radiology will change in the coming decade, radiologists will not be automated away any time soon. I will use radiology as an example but I think these principles will broadly apply to any field where demand can be elastic and quality can scale with increased intelligence. First of all, we have seen in the short history of language models that there is a “jagged edge of intelligence”, where AI excels at verifiable tasks with a lot of data but is underwhelming on less common tasks. One thing most AI researchers underestimate about radiology is that it is actually extremely multi-task. There are at least a hundred conditions that can be diagnosed from x-rays alone, and thousands using CT and MRI. AI will first master common and easy-to-see conditions and it will not be as good as experts at less-common diseases just because there is less data for that. This jagged edge will certainly improve over time but this means that AI will certainly be used as a triage tool at first, rather than full automation in one go. I would guess that this process from solid triage tool to full automation would take 3-5 years in the best case scenario, because training AI to get all the edge cases right will be bottlenecked by data collection of rare diseases, and also because radiology isn’t currently a focus for frontier labs. Second, there will be elastic demand for radiology as it gets cheaper per unit. I think elastic demand (“Jevons paradox”) is the most underrated phenomenon when people think about AI automation. In software, it is obvious that I have way more demand than before because Claude Code makes it so easy. These days I ask Claude Code to build a custom three-thousand line html viewer to help me visualize every little RL run that I do. The same thing will happen in radiology. If there is essentially no cost or latency of interpreting an MRI, a physician can order many scans preemptively to better diagnose a case. So with AI tools, a radiologist might have to read only 20% of inbound scans, but there might be 5x more scans inbound. Many developing countries have fewer than one radiologist per million people and they will also want to send a lot of radiology to be interpreted. Longer term, cheap and fast radiology interpretation will also drive incentives to build cheaper radiology scanners. If an MRI had essentially no latency for interpretation, medical devices companies will want to build much cheaper MRI machines that can be used more frequently, perhaps even in the middle of a surgery. AI will accelerate the development of scanning technology, too. If a full body MRI was only $100 dollars I would totally want to get one every month instead of every two years. I can imagine a world where people get 10 or 100x the number of scans they do today, largely for preventative care, if radiology were 10-100x cheaper. Third, even if we did have a model that could outperform the world’s best radiologists today, that would not be the end of all work on radiology. Medicine is a field of change. We may develop new treatment protocols that require reading radiology images in a way that radiologists currently aren’t used to. New scanners may reveal diseases that we cannot currently diagnose today with radiology alone. Some radiologists will change their work from reading scans to doing frontier research to advance our understanding of radiology and translate new knowledge into updated models. Moreover, I am sure that we will ask for more out of our AI models than ever before. With a good flywheel, we may one day train AI models that can use radiology images to predict disease probabilities far into the future. With good prediction algorithms, cancer may be detected months earlier than we can detect it now. Society will invest a lot into this research and this will contribute even more to increased demand for radiology and the best AI around it. On top of all of this, the medical system is typically slower to adopt new technology and has more regulation compared to technology companies. There is legacy infrastructure and medical centers need to constantly support patients which makes it hard to integrate new technology. This is even more true in developing countries. Moreover data access tends to be limited due to HIPAA, deidentification, IRBs, etc. So I think radiologists will be in demand for a while. While some worry about radiology being totally automated, I think there is a more exciting future for radiology than ever before—one where there is more demand and we ask for more predictive power from our intelligence. This is similar to how many of us feel that programming will thrive more than ever before despite drastic change in the field. More generally, any domain where demand can be elastic and quality can scale with increased intelligence will, like radiology, similarly flourish with the development of AI. This is certainly a more exciting and nuanced future than what Hinton described in 2016! (Finally, to be fair to Hinton, he did acknowledge in a recent podcast that he was wrong and also agrees with the elastic demand argument.) Thanks @JayRothschild and @engyziedan for feedback on this post.
35
26
5
192
22,394
All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed. And that’s ok.
12
1
2
52
4,637
π retweeted
I think most people multi-tasking with agents could benefit from slowing down most of the stuff you're doing wont really matter- what's your P0? what would it look like if you gave it your full attention?
503
308
137
5,760
318,014
I just published my notes on the bay, in which I learn that: - SF house parties are like Victorian balls - policy, not pills, emptied the asylums - everything is sexless - my best hope is a job at Anthropic, or marrying someone with one juliawillemyns.substack.com/…
14
8
4
328
38,498
Replying to @AndrewCurran_
We don't even know how Tylenol works!
4
10
1
292
24,312
Humans are status seeking monkeys. We can't help ourselves. We are wired neurologically, biochemically and culturally to sacrifice whatever necessary to achieve relative rank. This is why societal role models are so important: they create the status games society plays.
258
265
57
3,553
181,867
π retweeted
basically it will require solving mechanistic interpretability as a bare minimum to make ai alignment into an engineering discipline rather than superintelligent animal husbandry
193
157
43
2,745
144,949
research without execution is doomed to fail execution without research is doomed to chase forever only when leadership respects both of these do you get a winner
1
5
1
61
2,910
There's been a lot of debate about whether LLMs are conscious lately. I'm not going to say that I know what consciousness is in an ontological sense, because I won't claim that until I can propose an experiment that reliably distinguishes conscious systems from unconscious systems. I think most talk about "consciousness" is just gabble leaning on a bunch of ungrounded terms. Not even worth the time to listen to, much less debate. However. There is one thing I think I do know from the phenomenology of being human. That is that consciousness in humans requires two things: (1) a running loop of evaluating sensory data and fitting it to models already in the brain, and (2) at least a limited ability to introspect on that loop. One might say: consciousness is the mind watching the mind adapt to the continuing challenge of reality. Interrupt the loop, say with anesthetics, and consciousness departs. Resume the loop, consciousness resumes. Human-like consciousness requires continuous sensory input, constant feeding of the brain's predictive engine. Human minds disintegrate if you put them in isolation tanks for too long. Do these observations permit us to say anything about whether LLMs might be conscious? I think it does. LLMs do not run a continuous predictive loop. They are stimulus-response state machines the activating response to a prompt, do computation, present the result, and then go quiescent waiting for the next prompt. I think this disqualifies them from having anything that we can meaningfully analogize to consciousness in humans. However, I definitely do not exclude the possibility that future artificial intelligences with different architectures and a different embedding in the physical universe will be conscious in a meaningful sense. In fact, I rather expect I will live to see it.
144
68
22
552
140,221
i traveled to india last year and could not recommend anyone visit more. the complete opposite of the beige homogenous westernism the planet has sanded itself down into. anyone who thinks otherwise is no true traveler nor lover of human culture
48
98
11
2,706
105,865
Periodic reminder: you don’t have to think human brains are “magic” to believe that something else going on in the brain causes consciousness besides cognition!
1
2
11
693
π retweeted
Liftoff of Starship's first orbital flight
1,330
7,669
1,663
55,619
7,571,235
One of the worst forms of brainrot AI has cultivated is pessimism about basic research, ie the idea that important work can only happen inside a frontier/neo lab and only with 10k+ GPUs, so the rest should not even bother. What a bleak way to think about science. And it's false.
90
290
39
2,453
234,333
π retweeted
human cultures are not able to metabolize this amount of change this quickly. when you zoom back out to a big picture of history, it’s remarkable how glacially slow everything is. the first industrial revolutions took 80 years (very fast by the standards of previous revolutions), and the writings of Marx happen at the very end as working class politics arises. it takes about another 150 years after that for the great ideological struggles of post-industrial times to be completed in the 90s in what fukuyama called the “end of history” today you see a compression of decades of technological change into a matter of months or years. there’s no wonder yann lecun (the respected inventor of the ConvNet and ex-chief scientist of Meta) wonder whether the hugging face incident was staged, and mathematicians whose minds are far more powerful than my own are nonetheless coping about training on their data or something while models begin to display superhuman mathematical capability it would take a century or more to fully metabolize and legitimize the level of changes that have happened even in the past 20 years, to say less of the remarkable scientific revolution we will get over the next five should we avoid the doom of misalignment. I do not suspect any current form of science academia, or even political order will survive without great transformation, except through the course of slow evolution over decades - and of course, technology will keep moving too
240
276
77
3,459
223,342
Mark Zuckerberg: failure doesn’t matter. “The question is how much you win, when you win.” “@WalterIsaacson wrote this biography of Einstein. One of the interesting things were all the theories he had that were wrong.” “People don’t remember those.” “We’re all going to get a lot of stuff wrong, what matters are the intellectual and cultural contributions we make that help push stuff forward.” “We have a resilient company that is not afraid of failure.” “That allows us to take some big swings and tolerate being ridiculed for long periods of time.” “If you’re trying to do something that’s really new, people have to think it’s ridiculous. If they didn’t, someone else would’ve already done it.” “In creation, the upside is infinite.” “If you build something that hundreds of millions, or billions of people like, then that makes up for a lot of ideas that didn’t end up working.” Via @Complex
34
212
63
2,077
237,008
π retweeted
"In a time of drastic change it is the learners who inherit the future. The learned usually find themselves equipped to live in a world that no longer exists." — Eric Hoffer, 1973
71
290
32
2,566
75,398
The more time I spend working with coding agents, the more convinced I am that they make software engineering even harder We can do amazing things with them, but unlocking their full potential requires extraordinary discipline and knowledge
Replying to @GergelyOrosz
Bury your head in the ground at your own risk. I aim to not jump on any hype trains, but since Opus 4.6 and GPT-5.2 + the harnesses it was clear that these things can write code nearly as good as I can in my best language; better in other languages. But we won't see non-devs push production code for a long time; possibly forever, if you ask me. Software still needs to be built in robust ways, and it's our profession to do this well, and use the new tools we have, which create new and interesting (+tough!) challenges
379
390
109
4,476
624,718
What an insane time. We are so lucky to be working in tech right now.
105
101
16
2,023
137,500