light (@reprompting) profile picture

learning from first principles

Joined May 2025
Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)Photo by light (@reprompting)
This is the roadmap I've put together for the next few months. While I already have a background in ML, I've never really explored the performance engineering or CUDA side of things. It should be an interesting few months ahead.
1
2
54
1,687
reading about tritonforge today arxiv.org/pdf/2512.09196
3
19
645
reading about kernelfoundry today arxiv.org/pdf/2603.12440
1
8
65
2,218
i can understand the intent behind it, but the current version of chatgpt, where it loads visuals in addition to text (it should have always been text), takes noticeable time to load, making the UI look buggy/laggy
4
265
reading about how warp divergence has evolved across GPU generations arxiv.org/pdf/2607.23402
10
53
1,730
reading about zipserv today arxiv.org/pdf/2603.17435
2
45
2,068
reading about the NVIDIA hopper architecture today arxiv.org/pdf/2501.12084
21
1
172
6,225
you would have to be crazy to outsource your cognition to AI agents
Introducing dots, powered by GPT-6 Astra. Remarkably capable, always-on agents built to handle everything.
5
521
reading about kernel-smith today (also found out about InternLM through this) arxiv.org/pdf/2603.28342
1
16
460
I’ve always felt like Rabbit’s form factor was quite good.
Metas one more thing moment - they unveiled hardware for Meta Muse (beating OpenAI to an AI hardware device unveil) Always on w/fingerprint sensor “by far the fastest way to talk to your muse” shipping in time for the holidays I think OpenAI can one up this but we will see 👀
5
134
interesting read. it provides a thorough walkthrough of triton, starting from the basics and building all the way up to a full implementation of the mamba algorithm. srush.github.io/annotated-ma…
1
26
282
10,902
reading about tritonBLAS today arxiv.org/pdf/2512.04226
11
61
3,975
the genie is already out of the bottle and dario is still debating how fast to open it
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…
2
11
575
reading about autokernel today arxiv.org/pdf/2603.21331
6
55
1,411
when the going gets tough, the tough get going. i am certain the whale will take us to the moon.
🚀 Introducing DeepSeek-V4.1-Flash: smarter, faster, more efficient. 🔹 Introducing the smallest model in our new architecture family, with native visual understanding. 🔹 Designed for greater capability, faster inference, higher throughput, and scaling to larger models. 1/6
3
359
reading about squeezed attention today arxiv.org/pdf/2411.09688
1
15
2
117
4,428
funnily, most people are interested in it mainly because of the conspiracy involved, not the actual math. people just love gossip.
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
1
6
335
reading about S2-attention today arxiv.org/pdf/2407.17678
7
49
1,884
the year is 1982 and the machines are sentient
1
5
810
reading about the the anatomy of a triton attention kernel today arxiv.org/pdf/2511.11581
26
249
8,665
reading about flashattention today arxiv.org/pdf/2205.14135
14
632