Senior Staff Engineer at Samsung SSIR. Primary interests: machine learning & NLP. Author of books on fasttext and ML with Rust. AI to make peoples lives easier.
Joined January 2012
- Tweets3K
- Following283
- Followers233
- Likes1.8K
GPUs are behind the rise of AI and the current change in the world order. But what's actually inside these GPUs? 🧵
The golden rule of GPU performance:
Keep data as HIGH in the memory hierarchy as possible.
Constantly reading/writing from HBM = slow cores, wasted compute.
Data in registers or shared memory = blazing throughput. This is the whole game.
1/ NVIDIA just dropped the Vera Rubin technical report.
I spent last couple of days going through it.
Here's what it tells every AI/ML developer about where to invest their learning time 🧵
