becoming.

the warp
Joined August 2020
Replying to @thebeyondr
I really don’t know how to answer this besides work 100x more
2
1
1
28
10/10
Just found out about recency bias. Maybe the most important bias ever
2
42
beyondr🏴‍☠️𓂀 retweeted
MAKE YOUR LIFE A TESTAMENT TO WHAT YOU’RE CAPABLE OF. RELENTLESSLY PURSUE YOUR POTENTIAL. DIE EMPTY.
2
241
9
1,702
24,735
People need to read "The Last Question" by Isaac Asimov thelastquestion.net/
ngl "let there be light" sounds like a prompt
1
63
lol it happens. don't ask me how I know. its fine with me though, the best revenge is not repeating that mistake and moving forward.
Absolute shameless behavior. Imagine being a designer, getting excited because a successful startup wants to hire you, spending hours working on an assignment for free, only to be told they’re not actually ready to hire. Then seeing them publicly begging for more designers. All while the founder celebrates his nine-figure company. If true, heads need to roll here.
1
31
required reading along with "how to unclench" imo. I realize I already exhibit high agency traits but there are vast measures of improvement to pursue. exciting and terrifying. also, my new favorite meme image is in it:
24
beyondr🏴‍☠️𓂀 retweeted
"No man ever runs an experiment on the same infra twice, for it's not the same infra and he's not the same man." - Heraclitus
25
301
11
3,650
94,521
great read, highly recommend. its not relaxing. though relaxing is my preferred gateway. its the full body release that comes with it that defines unclenching so well. the great allowing of release through bodily awareness. it can be quite profound.
After months of writing, 'How to Unclench' is finally live! It's an interactive essay packed with stories, science & guided practices to help you unclench. → howtounclench.com
1
1
127
is this a late april fool's joke? you *have to* see it right?
They say cockroaches will outlast us all. We'd settle for outlasting your database problems. New look, same resilience: distinct parts, adapting together, make the whole stronger.
69
still cooked because they're all "be in US" roles
My agent tells me that inference engineering job openings have doubled in the past 6 months. I think that's an underestimate. Demand for inference has inflected, again. So too has demand for engineers who can operate AI models in production.
3
136
huge nostalgia wave hit my brain clicking this video. thank you for all the tutorials all these years bucky you are a legend in my book and I hope you are doing well irl.
1
22
beyondr🏴‍☠️𓂀 retweeted
They’ll expect one of us in the training data
50
555
25
8,666
220,549
beyondr🏴‍☠️𓂀 retweeted
A retard in motion is always better than a genius at rest
590
14,021
995
156,823
12,564,113
beyondr🏴‍☠️𓂀 retweeted
Teach your agents inference. The full text of Inference Engineering is now available to LLMs everywhere. No more parsing PDFs. 3,000 tokens | links to each chapter: baseten.co/inference-enginee… 70,000 tokens | full text: baseten.co/inference-enginee…
21
63
9
545
32,576
beyondr🏴‍☠️𓂀 retweeted
Here's my advice for engineers looking to up their design game.
56
293
38
3,248
867,852
beyondr🏴‍☠️𓂀 retweeted
We just released a massive update on our gpu performance engineering resource list AI Performance Engineering v2 this is the most comprehensive resource list for learning gpu and ai perf engineering link in thread 🧵 this version starts with how a single inference request works, then builds through the cuda execution model, roofline, transformer arithmetic, ttft/tpot/goodput, and kernel optimization. it's an opinionated list on what we think is important to deeply understand how to optimize inference systems. also added: - flashattention-4, blackwell tensor memory, and low-precision tensor cores - continuous batching, kv-cache systems, quantization, speculative decoding, and structured decoding - moe serving, collectives, topology, and prefill/decode disaggregation - blackwell ultra, mi350/cdna 4, ironwood, and trainium3 - kernelbench-verified and sol-execbench, plus a separate watchlist for rubin and cdna 5
28
71
6
588
41,819
beyondr🏴‍☠️𓂀 retweeted
NOW IS IT CPU BOUND, OR IS IT MEMORY BOUND?
71
510
35
14,234
288,802
whos doing this for llm serving / inference?
In this (extremely long) video, I'll build a distributed training framework from first principles using PyTorch. We'll derive everything from first principles, explaining the mathematics behind distributed training as well as every auxiliary component we build along the way, including Multi-head Latent Attention (MLA), Rotary Position Embeddings (RoPE) and YaRN. I'll explain process groups, ranks, collective communication operations, distributed autograd, device meshes and distributed tensors, and then use these foundations to implement the major forms of parallelism used to train modern language models. We'll derive and code pipeline parallelism, data parallelism, FSDP, HSDP, tensor parallelism and context parallelism, including pipeline schedules, block matrix multiplication, model sharding and ring attention. We'll then combine these techniques and examine how tensor layouts and gradients must be tracked as data moves between devices. Most importantly, we won't study each parallelism technique in isolation. We'll combine pipeline, data, tensor, context and expert parallelism into a single working framework and follow the tensors, communication operations and gradients as they move across GPUs. By the end, you'll understand not only how these techniques work individually, but how modern distributed training systems compose them to train large dense and mixture-of-experts models. We'll also build the important components of a modern transformer, including rotary embeddings, long-context extensions, multi-head latent attention and a mixture-of-experts architecture. This leads into expert parallelism, expert tensor parallelism, token dispatching, all-to-all communication and combining different parallel dimensions through dense and sparse device meshes. We'll also build the supporting training infrastructure, including the training loop, optimizer, learning-rate schedule, checkpointing and metrics. The goal is to give you the foundations required to understand how distributed training frameworks work internally and how to design and implement new parallelization strategies yourself. No prior knowledge of distributed training is required. Link to the video: youtube.com/watch?v=XoGvCBRn…
1
74
beyondr🏴‍☠️𓂀 retweeted
3/4) We all expect the best app design work from @thebeyondr , and he did not disappoint with Pacto! We recommend a watch; you’ll learn something! tv.creativeplatform.xyz/disc…
1
1
3
70
surely you jest.
Celebrating small wins is hardwired into "Achieve," our goal-tracking sample app. We wanted the simple act of checking off a task to feel like a celebration. Instead of the standard #Material ripple, we used Styles to drop in a custom, high-contrast completion animation—specifically, a brand-colored ring that expands and fades on tap, paired with a subtle pressed-state gradient. It lets us focus entirely on polishing those custom, rewarding micro-interactions while Material handles the foundation. #GoogleDesign #MaterialDesign #JetpackCompose #AndroidDev #UXDesign #InteractionDesign
1
80