Funding 11T of AI Capex by 2029 will be no easy feat. 7T in debt will be raised, with 1T to be raised in 2026 - the last year that AI debt issuance will be less than 10% of all US Debt Issuance. We explore this and much more in my latest pod with Jordan.
youtu.be/XlnyFCviN4o
Daniel Nishball retweeted
Github search needs some nudging.
github.com/pytorch/pytorch/p…
github.com/pytorch/pytorch/c…
There’s no evidence this ever existed, yet it’s presented as fact at the top of the article, for people to blindly accept and repeat.
github.com/search?q=repo%3Ap…
Daniel Nishball retweeted
The Nvidia Tensor Core is the most important evolution of computer architecture in the last decade
We explain why / how it's evolved
Shout out to collaborators @spectorb @tri_dao @colfaxintl @charles_irl @ia_buck Neil Movva Jonah Alben
esp @simonguozirui for the cutest cover pic
NVIDIA Tensor Core Evolution
From Volta To Blackwell
Amdahl’s Law, Strong Scaling
Asynchronous Execution
Blackwell, Hopper, Ampere, Turing, Volta
semianalysis.com/2025/06/23/…
Daniel Nishball retweeted
Full Speaker List:
Mark Saroufim of GPU Mode @marksaroufim
Vijay Thakkar of Nvidia CUTLASS @__tensorcore__
Horace He of Thinking Machines @cHHillee
Philippe Tillet of OpenAI
Tri Dao of TogetherAI @tri_dao
Daniel Nishball retweeted
Speakers include Philippe Tillet of OpenAI, @tri_dao of TogetherAI, @cHHillee of Thinking Machines, and more. Sponsors: @togethercompute , @LambdaAPI , @googlecloud, @nvidia, @GPU_MODE, @thinkymachines, @OpenAI, @PyTorch, @CoreWeave, @nebiusai. Apply now!
semianalysis.com/hackathon-2…
Daniel Nishball retweeted
SemiAnalysis is hosting an Nvidia Blackwell GPU Hackathon on Sunday March 16th. It is the ultimate playground for Blackwell PTX tech enthusiasts, offering hands-on exploration of Blackwell & PTX infrastructure while collaborating on open-source projects.
Daniel Nishball retweeted
Here's the links for my 5-hour conversation on the future of AI with @dylan522p and @natolambert:
YouTube: youtube.com/watch?v=_1f-o0nq…
Spotify: open.spotify.com/show/2MAi0B…
Podcast: lexfridman.com/podcast
Daniel Nishball retweeted
Met with @LisaSu today for 1.5 hours as we went through everything
She acknowledged the gaps in AMD software stack
She took our specific recommendations seriously
She asked her team and us a lot of questions
Many changes are in flight already!
Excited to see improvements coming – at Georgia, USA
Daniel Nishball retweeted
MI300X vs H100 vs H200 Benchmark Part 1: Training
CUDA Moat Still Alive
Our 5 month journey conducting independent analysis + benchmarking
User Experience, Usability
GEMM + attention
InfiniBand vs Spectrum-X vs RoCEv2 Ethernet
SHARP
Total Cost of Ownership
semianalysis.com/2024/12/22/…
Happening now - the Thrilla on Chinchilla
Latent Space LIVE! - Best of 2024: Startups, Vision, Open Src, Reasoning... youtube.com/live/wT636THdZZo… via @YouTube
1/5 - H100 SXM on-demand rental prices cut by 30% in the last two months. Today, you can rent H100 SXMs on-demand for as low as $2.99 per hour. What's going on?
4/5 - Blackwell's impact is another important factor. How many B100+B200s hit the Neocloud market? Will GB200 NVL36/72s be readily available in 2025 given liquid cooling tightness? How will Neocloud Giants set GB200 NVL72 debut rental price?
5/5 - Read all about AI Neocloud economics, anatomy and cluster setup in our AI Neocloud Playbook and Anatomy Article:
semianalysis.com/p/ai-neoclo…
Daniel Nishball retweeted
1/4 - Chevron deference has just been struck down by the US Supreme Court. What is it and how does it affect semiconductor companies? ⬇️
Under that 40-yr-old legal doctrine, US federal agencies had the power to create their own rules & regulations when a law is ambiguous. In our industry, this is particularly relevant for technology export controls – agencies were in the driver’s seat and didn’t have to worry about being challenged in Court. This is now over, and the power has been handed back to the Court system after the Supreme Court’s ruling in Loper Bridge Enterprises v Raimondo.
Peeling away the layers of the 30x Performance Gains Onion
semianalysis.com/p/nvidia-bl…
NVL72 is not the optical Bogeyman you should be watching out for. Read more about the Real Optical Bogeyman below:
semianalysis.com/p/nvidias-o…
