Wrote anti-cheat ml, do ML/AI at places you know off and probably use; systems ML person who still cares about cycles, graphics, compilers in the agentic era
Helsinki
Joined July 2015
- Tweets3.1K
- Following3.1K
- Followers335
- Likes14.7K
Pinned Tweet
We could just have a thread on the best talks/ content you've seen there.
youtu.be/8X69_42Mj-g?si=cVeF… 1 HR absolutely fantastic talk ( some follow ups on the llvm dev meetings). I would love the potential of LLMs with a chemistry DSL!
λndres Mariscal retweeted
Hi folks! I'm looking for my next tech role and would really appreciate help spreading the word. I have 10+ YoE and am open to Senior/Staff/Principal, Tech Lead, and Engineering Manager roles. An intro or RT would mean a lot. ❤️ #OpenToWork
[ Rust, C#, Python, JS, AI, Infosec ]
λndres Mariscal retweeted
🚨 [Token][ization] Paper Alert 🚨
Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!
λndres Mariscal retweeted
In case you missed it, the full N64 programming video was made public last week! You can check it out here: xitter.cf/rfleury/status/2100359…
The next entry, dealing with interrupt handling, diagnostic rendering, and controller input, will go public today.
. With agentic coding, I think this approach will be a lot more common! gamedev used to do it quite a lot like it too, I remember we had everything from re-implementations of stdlib stuff too for our anticheat. TigerBeetle really resonates with good engineering imo
λndres Mariscal retweeted
At TigerBeetle, as systems engineers, we:
1. write code, sharpening skill and second order understanding
2. read code, walking through the building to constantly improve things
3. review code, ensuring no code is merged without two engineers’ understanding and review.
λndres Mariscal retweeted
Managers will literally fire their best engineers if they fear they threaten their position.
It's all politics. Maximizing shareholder value my ass.
Two months ago I was fired by Google for creating the Google Workspace CLI. It went viral, hit #1 on Hacker News, gained thousands of GitHub stars and many thousands of actual users in just a couple days.
It was an incredible, confusing journey, from directors and leaders asking what they could learn from the tool to getting grilled by legal about why the Google logo and brand colors are on the Google Workspace GitHub code repositories.
I think the cause was that Workspace and certain leaders (and projects) were afraid of being disrupted. But the fear wasn't specific to my CLI, it was a broader fear in what agents meant for Workspace. Either way, the irony of my termination was the announcement at Google Cloud Next two days before I was fired that an official Workspace CLI was coming.
I want this out there because it is easier for me to explain my story and it is an experience I want to fully own. It's also part of my healing.
Nearly 7 years at Google was an incredible opportunity for me and I was fortunate to have wonderful teammates and a manager that fully supported me through these last few months. Thank you.
λndres Mariscal retweeted
Nvidia is proposing a beast of a CPU system for Windows PCs.
It has 128 GB of shared memory and comes with up to 6,144 state-of-the-art CUDA cores.
CPU wise, the chip has 10 performance cores and 10 efficiency cores. The performance cores are based on the Cortex-X925. These chips appear to support six 128-bit SIMD execution units (SVE2), not as good as recent AMD chips, but better than Apple Silicon (on paper).
The game changer is the unified 128 GB memory. That is the path Apple took years ago. Instead of separate memory for the CPU and GPU, everything shares a single pool. It is increasingly popular.
The memory is not as fast as dedicated GPU memory, but it is cheap enough while delivering enough bandwidth to run AI models locally.
I am not sure how many people will run AI models locally. It still seems like a niche application to me. However, it will make decent machines to play video games.
It will be interesting to see how Intel and AMD respond. I think that the AVX-512 instructions supported by all recent AMD processors are far superior to the SVE2 instructions of the Cortex-X925. They can eat more data and they are more versatile. But Intel has been shy, thus far, in making it available on customer systems.
λndres Mariscal retweeted
one of the very first things i worked on after joining kimi was speeding up KDA's kernels with @yzhang_cs and @uniartisan (i got carried :D). it was super fun optimizing those triton kernels... and now comes FlashKDA, a highly efficient KDA in CUTLASS for the open community!
side note: knowing how to write a kernel matters less and less, but knowing how it actually works efficiently matters as much as ever.
although I rarely write kernels anymore, and instead mostly use kimi k2.6 / opus 4.5-7 to write them—far from optimized ones, simply for the sake of testing for signs of life—for me, those days of trying to make algorithms as hardware-aligned as possible turned out to be special and shaped many intuition for architectural designs that followed. (arch and infra are really two sides of the same coin).
would highly recommend reading basic flash/linear attention's triton kernels in FLA (github.com/fla-org/flash-lin…) for anyone wanting to better understand how efficient kernels work btw
We're open-sourcing FlashKDA — our high-performance CUTLASS-based implementation of Kimi Delta Attention kernels. Achieves 1.72×–2.22× prefill speedup over the flash-linear-attention baseline on H20, and works as a drop-in backend for flash-linear-attention.
Explore on github: github.com/MoonshotAI/FlashK…
100% agree a win for Zig, but disagree with the out-of-distribution generalisation, Zig is fine-tuned for performance "writing" and as a result you a over-represented high quality performance focused corpus (Bun, TigerBeetle, etc. and all of the Mike Acton inspired talks!)
λndres Mariscal retweeted
An awesome thread where @AgileJebrim talks about his custom language, compiler and programming model for GPUs. By restricting certain features/instructions, he is able to guarantee deterministic execution time, making it viable for real-time applications.
10x compression (32 bytes) looks great on paper, but jumping from 0.034 to 0.117 distortion is a total quality cliff. Johnson-Lindenstrauss lemma. Cutting QJL from 128 to 64 bits doesn't just "lose precision"it breaks the ds preservation guarantees. ideas?
λndres Mariscal retweeted
Trtllmgen kernels are now open. Fastest prefill and decode kernels for our target workloads. We wrote these to win InferenceX, MLPerf, other benchmarks. Powering some of today’s top served models. Dive in, learn, use them, or level up your own. Enjoy.
github.com/flashinfer-ai/fla…
λndres Mariscal retweeted
Strudel REPL but for gamedev;
that was proof of concept cljs;
going for the moon no re-star'.
xitter.cf/HostOfMeta/status/1776…
Need more tools to bind all these feature together:
xitter.cf/Lambda_Coder/status/17…
λndres Mariscal retweeted
Amazing! 🙌@TigerBeetleDB
youtube.com/watch?v=y2_BqkKT…
λndres Mariscal retweeted
IronBeetle⚡️ Ep 105
Zig's comptime is A W E S O M E for CLI argument parsing
youtu.be/BDGkD3jtWpM
λndres Mariscal retweeted
Without getting all the way down to performance counters, GPU power from nvidia-smi is a better indicator of true utilization than job scheduling or “gpu busy”. I would love to see animated “heat maps” of the big data centers, with each pixel being an individual GPU’s power draw.
I am confident that inference and frontier training at the big labs is highly efficient, but I wonder how many GPUs would be dark due to scheduling and inefficient research code.
With a little calibration for base load and peak, just the power bill for the datacenter would be a pretty good first order indicator of utilization.
λndres Mariscal retweeted
Released WinDbg MCP — attach Claude (or any LLM) to a live Windows process and let it poke around. set breakpoints, read memory, walk the stack, load crash dumps. 55 tools over MCP.
github.com/gengstah/windbg-m…
λndres Mariscal retweeted
One of these things is not like the other…
The other day @PratapRanade brought home 3 RF circuits. Ok “10GHz band pass-filters” he says, to be precise. The first two are human-made, the third is what they’re calling “an alien geometry” 👾
Look how funky it is.
That’s the world’s first-ever AI-made RF circuit achieved by the electromagnetism foundation model @arenaphysica.
No human would have created it this way. It’s odd, it looks random, but it really works & it might be the future guts inside every satellite, radar, microwave etc one day.
Today, we're announcing Heaviside, our foundation model for electromagnetism.
Trained on tens of millions of designs and over 20 years of proprietary simulation data, Heaviside predicts electromagnetic behavior from geometry in 13ms, which is 800,000x faster than a commercial solver.
Heaviside is not a language model, and it’s not a surrogate model. Heaviside marks a new class of foundation model for physics which understands the fundamental relationships between materials, the geometries and the electromagnetic fields they generate.
We’re releasing a research preview of Heaviside in Atlas RF Studio, an interactive agentic sandbox where you describe the EM behavior you want and the model generates the physical structure that produces it.
@arenaphysica , we believe the implications of this class of model extend well beyond RF, as the frontier of exquisite hardware is electromagnetically-governed: wireless communication, radar, power delivery, high-speed computing, and the interconnects inside every chip on earth.
In the months ahead, we’re excited to scale up Heaviside to broader frequency ranges, design spaces, and to support silicon-level designs, and deploy it with our closest partners and collaborators in service of their biggest design challenges.
If you’ve read our thesis, this is just Step 2 in our pursuit of electromagnetic superintelligence.
Read the full announcement and try Atlas RF Studio…tell us what you think: arenaphysica.com/publication…