Thinker, tinker, twitter.
Massachusetts
Joined May 2014
- Tweets1.3K
- Following77
- Followers314
- Likes798
Huamin Chen retweeted
[vLLM Office Hours #34] AI-Powered vLLM Semantic Router - October 09, 2025 xitter.cf/i/broadcasts/1djxXWkpO…
Huamin Chen retweeted
When to Reason: Semantic Router for vLLM. arxiv.org/abs/2510.08731
Huamin Chen retweeted
Next Thursday, October 3, join us for bi-weekly @vllm_project office hours to learn about the new AI Powered vLLM Semantic Router.
GitHub: github.com/vllm-project/sema…
Register for office hours: red.ht/office-hours
ALT vLLM office hours on vLLM's Semantic Router
Huamin Chen retweeted
Talks and demos will include:
• Getting started w/ vLLM — @wattsteve (PyTorch ambassador)
• Intermediate vLLM: PagedAttention, quant, spec decode, continuous batching — @luka_govedic (vLLM core)
• vLLM Semantic Router — Huamin Chen @root_fs (project creator)
• Scaling w/ llm‑d — Greg Pereira (maintainer)
Huamin Chen retweeted
New on the Red Hat Developer blog: vLLM Semantic Router – Improving Efficiency in AI Reasoning
An open source router that sends the right query to the right model, reducing cost and latency while maintaining accuracy.
Read here: developers.redhat.com/articl…
Huamin Chen retweeted
Austin friends - we’ve got something special coming up on Wednesday, September 17 at @CapitalFactory!
PyTorch ATX + vLLM are teaming up for a joint meetup. Over 200 folks are already signed up, and there’s still a few spots left. Come hang out, learn, and meet others building with LLMs. Here’s what’s on the agenda:
1⃣ Getting started with vLLM inference - Steve Watt, PyTorch ambassador (@wattsteve)
2⃣ Intermediate vLLM: PagedAttention, quantization, speculative decoding & more - Luka Govedič, vLLM committer (@luka_govedic)
3⃣ Semantic Router: Auto-reasoning router for efficient mixture-of-models inference – Huamin Chen, project creator (@root_fs)
4⃣ Scaling vLLM with Kubernetes + llm-d - Greg Pereira, maintainer
Sign up here: meetup.com/pytorch-atx/event…
Please help us share the event 🙏
Huamin Chen retweeted
Next up in emerging tech - @somalley108 shows us how she uses Project Kepler to monitor power consumption in resource-constrained edge devices: red.ht/46VE1R6
Huamin Chen retweeted
In this episode of Technically Speaking with @kernelcdub, we explore the possibilities of more sustainable #cloudnative workloads with @KeplerProject and its co-founder @root_fs. Watch Now: red.ht/45kLZSd
Huamin Chen retweeted
What's next in green computing? @piparul and @root_fs explain the ins and outs of Project Kepler, the CNCF sandbox project that is bringing power monitoring to Kubernetes and beyond! red.ht/45Fuo7U
Huamin Chen retweeted
The five steps to deploy #cloudnative sustainable foundation #AI models starts with the obvious two: #containers to manage the workloads and #Kubernetes to deploy across a distributed infrastructure. We talked about all the steps with @root_fs of @redhat. bit.ly/3NByE15
Huamin Chen retweeted
Absolutely agree, I can say at least the folks talking today genuinely care. On the Microsoft and Azure side, we're doubling down in this space, more right after this and throughout summer!
Huamin Chen retweeted
Get ready to explore sustainable computing with Kepler - the Kubernetes-based Efficient Power Level Exporter! Listen to an insightful conversation with @root_fs on Cloud7's Red Hat series. #sustainablecomputing #Kepler #Kubernetes
cloud7.news/podcasts/sustain…
Accelerate Sustainable Computing with Community Collaboration - Cara Delia, Principal Community Architect Financial Services and Sustainability, Red Hat & Huamin Chen, Senior Principal Software Engineer, Red Hat at KubeCon + CloudNativeCon Europe 2023 sched.co/1HyPf
Huamin Chen retweeted
THIS WEDNESDAY is the next meeting.
We will have Kepler (github.com/sustainable-compu…) presenting for the first half hour followed by KubeCon prep discussions.
Meetings every 1st and 3rd Wednesday, 5pm GMT +2:00, 8 AM PST, 11AM ET
zoom.us/my/cncftagenvsustain…
Passcode: 77777
Huamin Chen retweeted
At #MobileWorldCongress, Red Hat and IBM Research launched an open source project to capture power usage metrics from #Kubernetes clusters.
containerjournal.com/feature…
