@MatthewBonanni

MLE @RedHat | maintainer @vllm_project prev: combustion CFD @stanford

matthewbonanni.github.io
Joined April 2022
  • Tweets36
  • Following166
  • Followers129
9Media
Matthew Bonanni retweeted
vLLM
@vllm_projectOct 21
High throughput on the grill. Zero latency on the drinks. vLLM maintainers and friends gathered during the PyTorch Conference for an evening of Brazilian steak, drinks, and great conversation! 🥩🥂 Grateful for this community and everyone who keeps vLLM moving forward. 🚀
3
10
3
110
12,981
Matthew Bonanni retweeted
Red Hat AI
@RedHat_AISep 10
1/ GLM 5.3 at full 1M context on a single 8xH200 node. That didn't fit before. Agentic serving is why it's hard: many concurrent requests, each with a long context that keeps growing. The GPU block pool is fixed, so the KV cache runs out of room. Something has to give.
One pool, two growing requests: preempt vs offload

ALT One pool, two growing requests: preempt vs offload

4
7
1
58
3,331
Matthew Bonanni retweeted
vLLM
@vllm_projectSep 8
Sparse MLA only attends to the top-K tokens, so the rest of the KV need not live on the GPU. Hybrid HiSparse in vLLM builds on that, and a request keeps decoding after its KV stops fitting in HBM. It keeps KV on the GPU while there is room. Under pressure a request releases its coldest pages to host memory, keeps a small hot buffer of what the indexer asks for, and keeps decoding instead of being preempted. 📊 Demonstrated on GLM 5.3, one 8× H200 node, full 1M context. Same host memory, configured concurrency 32: KV offloading kept 5-6 requests running. Hybrid HiSparse kept 19-25. 🔹 Hot pages are ordinary KV blocks from the same pool (Hybrid Memory Allocator) 🔹 One fused kernel resolves resident, hot and missing rows, CUDA-graph capturable 🔹 Prefix caching, OffloadingConnector, P/D imports and MTP keep working Built by @RedHat_AI and @PrimeIntellect with the vLLM community. Planned for v0.30; pinned commit, flags and calculator are in the post👇 🔗 vllm.ai/blog/2026-09-08-glm5…
9
28
2
166
29,343
Matthew Bonanni retweeted
Red Hat AI
@RedHat_AIAug 13
~4x faster Kimi-K3 decoding. Our new DSpark speculator takes single-stream interactivity from ~110 to ~435 tok/s/user on math reasoning, delivers ~3.5x the output throughput at matched interactivity under load, and thanks to sliding window attention (2048-token window across all 5 draft layers), our model holds steady acceptance out to 20K context across 10 LongBench domains. Check it out! huggingface.co/RedHatAI/Kimi… More details in reply:
4
25
8
219
19,605
Throwback to yesterday, with our very own @MatthewBonanni in his PhD Defense! We congratulate him for this tremendous achievement and wish him all the best for the future!
4
1
11
811
Excited to have our lab members present our research at ICNC in Kyoto, Japan! Here’s our PI, Matthias, in his presentation on Machine Learning for Combustion. @Combustion_Intl
2
7
749
Rotating detonation engines are next-gen propulsion systems that promise better thermo efficiency 🚀 Check out our new paper (coauthored by @MatthewBonanni) where we performed high-fidelity sims and developed a wavenumber analysis method. Link: doi.org/10.1016/j.combustfla…
2
19
1,004
Celebrating the new @Stanford school year with a lab trip to @GoldenGateNPS Marin Headlands! Abstract: 💡->🚶🚶‍♀️->🌉->🌮
2
1
11
2,146
Check out this @GoogleAI article featuring our PI, Matthias Ihme!
Google AI
@GoogleAI7 Sep 2023
Introducing a new simulation framework that leverages advances on @TensorFlow and TPU architecture to enable efficient large-scale simulations of turbulent flows (e.g., for cloud formation, wildfires, and more) at unprecedented scale. Learn more at goo.gle/45WU93Q
Simulation for homogeneous isotropic turbulence (HIT) — a canonical and well studied flow in which the statistical properties, such as kinetic energy, are invariant under translations and rotations of the coordinate axes. We perform direct numerical simulations with more than eight billion degrees of freedom — equivalent to a three-dimensional mesh with 2,048 grid points along each of the three directions — using 512 TPU-v4 cores over a total of 400,000 timesteps. 50 TB data, which includes the velocity and density fields, is stored for 400 timesteps (every 1,000th step) and released as a new benchmark. To our knowledge, this is one of the largest turbulent flow simulations of its kind conducted to date. Here we show the x-component of the velocity along the z midplane.

ALT Simulation for homogeneous isotropic turbulence (HIT) — a canonical and well studied flow in which the statistical properties, such as kinetic energy, are invariant under translations and rotations of the coordinate axes. We perform direct numerical simulations with more than eight billion degrees of freedom — equivalent to a three-dimensional mesh with 2,048 grid points along each of the three directions — using 512 TPU-v4 cores over a total of 400,000 timesteps. 50 TB data, which includes the velocity and density fields, is stored for 400 timesteps (every 1,000th step) and released as a new benchmark. To our knowledge, this is one of the largest turbulent flow simulations of its kind conducted to date. Here we show the x-component of the velocity along the z midplane.

3
16
1,719
Matthew Bonanni retweeted
Google AI
@GoogleAI7 Sep 2023
Introducing a new simulation framework that leverages advances on @TensorFlow and TPU architecture to enable efficient large-scale simulations of turbulent flows (e.g., for cloud formation, wildfires, and more) at unprecedented scale. Learn more at goo.gle/45WU93Q
Simulation for homogeneous isotropic turbulence (HIT) — a canonical and well studied flow in which the statistical properties, such as kinetic energy, are invariant under translations and rotations of the coordinate axes. We perform direct numerical simulations with more than eight billion degrees of freedom — equivalent to a three-dimensional mesh with 2,048 grid points along each of the three directions — using 512 TPU-v4 cores over a total of 400,000 timesteps. 50 TB data, which includes the velocity and density fields, is stored for 400 timesteps (every 1,000th step) and released as a new benchmark. To our knowledge, this is one of the largest turbulent flow simulations of its kind conducted to date. Here we show the x-component of the velocity along the z midplane.

ALT Simulation for homogeneous isotropic turbulence (HIT) — a canonical and well studied flow in which the statistical properties, such as kinetic energy, are invariant under translations and rotations of the coordinate axes. We perform direct numerical simulations with more than eight billion degrees of freedom — equivalent to a three-dimensional mesh with 2,048 grid points along each of the three directions — using 512 TPU-v4 cores over a total of 400,000 timesteps. 50 TB data, which includes the velocity and density fields, is stored for 400 timesteps (every 1,000th step) and released as a new benchmark. To our knowledge, this is one of the largest turbulent flow simulations of its kind conducted to date. Here we show the x-component of the velocity along the z midplane.

23
58
8
284
83,168
Recurrent Convolutional #DeepNeuralNetworks for Modeling Time-Resolved #Wildfire Spread Behavior by John Burge, @MatthewBonanni, R. Lily Hu & Matthias Ihme ➡ bitly.ws/RbYA @FxLabStanford @StanfordEng
2
6
647
Wildfires are increasingly relevant in a world with changing climate. In this collab with @Google, we developed predictive models for wildfire spread with ML approaches Check out this @FireTechnology paper co-authored by PhD student @MatthewBonanni: link.springer.com/article/10…
2
5
573
Check out this hot simulation by @MatthewBonanni. Check out his presentation at Indiana!!
Matthew Bonanni@MatthewBonanni19 Nov 2022
Looking forward to presenting my work on LES of a scramjet combustor at #APSDFD2022! I'll be in session T25: meetings.aps.org/Meeting/DFD…
1
7
Great look @ the exhaust of the NASA Langley 8-ft High Temperature Tunnel, perhaps the most impressive hypersonic test facility in the world The exhaust coming out is still hot & there is ~100 meters of asphalt between the pipe you see & a grassy berm, which has prev caught fire
Matthew Bonanni@MatthewBonanni12 Sep 2022
Had a great experience at NASA Langley this summer. Here's me and a few other students at the outlet of the 8-Foot High Temperature Tunnel - such an incredible facility!
5
3
36
A couple of members of our lab will be presenting at Vancouver! Check out the oral presentations by @wt_chung and @MatthewBonanni while you're there.
The Combustion Institute@Combustion_Intl23 Jul 2022
Just one more day until the #39thISOC kicks off! We are looking forward to seeing you all in Vancouver! #TheCombustionInstitute #Combustion
2
5
Congrats @MatthewBonanni!! Our research in @StanfordEng studies fundamental fuel phenomena, directly impacting propulsion systems like jet and liquid rocket engines ✈ 🚀
Matthew Bonanni@MatthewBonanni15 Jul 2022
Excited to share my recent publication in the Proceedings of the Combustion Institute on multicomponent spray flames: authors.elsevier.com/a/1fPp5…
2
5
Our students certainly shoot for the stars ✨ – at Los Angeles, CA
Matthew Bonanni@MatthewBonanni6 Jun 2022
I’m happy to share that today I'm starting the first Center-Based Research Experience of my NASA Fellowship at @NASA_Langley!
1
2
Interested in wildfires? Our lab uses X-ray scans and @TensorFlow-based simulations to study wildfire behavior. More info from @Stanford: news.stanford.edu/2020/09/22…
2
3
Load more