Istio @Soloio_inc. More content at https://xitter.cf/t.co/tBbI542Pdw.
Joined December 2020
- Tweets162
- Following104
- Followers330
- Likes214
howardjohn retweeted
You've gotta patch your dependencies super fast because they're full of vulns (PHP, Node, eMudhra, etc), but not _too_ fast because they're full of backdoors (LiteLLM). Good luck!
Congrats! Blacksmith makes our CI ~5x faster, couldn't do without it
@sequoia is leading our Series C at a $1B valuation.
We started Blacksmith in 2024 to make CI faster and less painful. In January we ran 5 million CI jobs a week. Today it's over 90 million and growing, and we’re still early.
ALT Line chart of weekly CI jobs run on Blacksmith, growing from 5.4M in January to 90.5M in October 2026.
howardjohn retweeted
🚀 #agentgateway 1.4.0-alpha.1 drops today!
MCP 2026-07-28 support + XAA auth foundation, CEL filters, standalone Helm, tons of fixes. Pre-release now, full v1.4 soon.
github.com/agentgateway/agen… #MCP #AIgateway
howardjohn retweeted
Production AI needs more than model APIs.
Agentgateway v1.3.0 adds built in cost tracking, virtual model routing, reusable providers and guardrails, plus expanded provider support, giving platform teams more control over agentic workloads from a single gateway.
Read the blog by Sebastian Maniak from Solo.io: bit.ly/4y6FCBp
howardjohn retweeted
Scaling Model Context Protocol: From a Proxy to an Agentgateway . linkedin.com/posts/blakeroma…
howardjohn retweeted
The open source, AI-native proxy, created by @soloio_inc to optimize connectivity, security and observability for AI agentic software, has joined the @linuxfoundation.
By @sjvn thenewstack.io/why-tech-gian…
howardjohn retweeted
The open source, AI-native proxy, created by @soloio_inc to optimize connectivity, security and observability for AI agentic software, has joined the @linuxfoundation.
By @sjvn thenewstack.io/why-tech-gian…
Today marks exactly 6 years from my first commit of a long journey to make @IstioMesh scale.
When I first started, a 100 pod mesh was a "big" mesh. Today, we can handle anything - 100 *million* pods and beyond!
Service mesh scalability is a solved problem.
Link 👇
Top KubeCon question: "Does ambient mesh scale?"
Yes, but a more useful question is "How much effort does it take to scale"?
blog.howardjohn.info/posts/s… covers this in depth.
howardjohn retweeted
Istio 1.24 is out today, and it's kind of a big deal.
istio.io/latest/news/release…
ALT Latest news: Fast, secure and simple: Istio's ambient mode is now Generally Available
howardjohn retweeted
cloudnativenow.com/contribut… Ambient mode — the next-generation architecture for Istio — more than just an incremental improvement to the sidecar-based architecture. #ambientmode #istio #kubecon #multicloud
The new compute is pretty slick... its a shame they are locked to only a few regions and any quota request is instantly denied even years after release.
Live from the App Dev & Infrastructure #GoogleCloudSummit: Our AI Hypercomputer now includes Trillium TPUs in preview, Axion-powered C4A VMs in GA, and, coming soon, A3 Ultra VMs powered by NVIDIA H200 GPUs!
More on these infrastructure innovations → goo.gle/3YKibP0
Powered by Gloo Ambient mesh, I was able to push through *410k requests per second*, with mTLS encryption and HTTP monitoring.
All served by a single 8-core CPU (on GCP).
ALT Dashboard showing 410,000 HTTP requests per second with a 100% success rate
howardjohn retweeted
indeed it is really fast :) github.com/kubernetes/kubern…
howardjohn retweeted
"Istio was able to deliver 56% more queries at 20% lower tail latency [than Cilium]. Taking into account the resources used, Istio processed 2178 queries per core, vs Cilium’s 1815, a 20% improvement."
istio.io/latest/blog/2024/am…
Made a tool to enable kubectl to use persistent connections: github.com/howardjohn/kubeco…. Cuts down command time by ~7x for me, and that is to the closest local AWS zone!
howardjohn retweeted
Amazing resource on @IstioMesh for helping debug ztunnel in Istio ambient mode / Ambient Mesh: github.com/istio/istio/wiki/…
One of the hardest thing for ambient adoption has been getting people to understand how easy it is to use.
Years of tricks and workarounds to make sidecars work can be thrown out since so many things "Just Work", but its hard to detach from the old ways.
