Software Engineer. Working on HyperVizier: + Garden: Meta-frameworks bridging the gap between AI + Deterministic Codegen.
USA / Asia
Joined December 2008
- Tweets105K
- Following2.8K
- Followers976
- Likes105K
when i get bored i vibe code random stuff. yesterday it was a pikmin clone. honestly not too bad for a few turns. might keep at it and make it real.
Gavin retweeted
Started with a hunch 🔥
TensorFold is already making local models feel much faster and in some cases even faster than API.
Extremely happy to be working with Ash on this. All my recipes are destined to run on TF, and will get better over time.
With additional hardware to test things faster, TensorFold can become much better than it is today.
Six months ago I had a hunch.
Local AI won't become the norm until it feels instant. Running a model on your own machine should feel like magic, not like tapping your fingers waiting for a reply.
The response to TensorFold since has blown me away. Thank you to everyone testing it, sending PRs and sharing feedback.
There's a lot more speed to unlock. Right now most of my time goes on reviewing and landing PRs. That matters, and every fix makes TensorFold better, but the biggest gains are in deep performance work I can't get to quickly.
If you want to see what TensorFold can really do, backing would let me work on it full time, with the hardware to test faster and dig into performance, and bring it to everyone in local AI.
All in the open under Apache-2.0.
We have been made aware that TF is being run in real production environments, so we could potentially look into support packages.
To back the project, sponsor hardware or talk about support, my DMs are open.
Even just sharing this post helps. 🫶🏼
Gavin retweeted
Open source is the only way to protect your projects.
GLM-5.3 has helped defend 389 open-source projects, with 4,249 potential vulnerabilities found so far.
OpenVuln is still running. The service remains free, and findings go privately to maintainers.
huggingface.co/spaces/zai-or…
Qwen3.8-27B running locally on my M5 Max, w OpenCode. Putting it through its paces on coding tasks, observing:
~128 - 168 tokens/s 🤯
via @ashxhart's TensorFold + DFlash2 speculative decoding. Not joking, this will let me drop an AI subscription. Ty ty
github.com/ashhart/TensorFol…
Gavin retweeted
I’m incredibly proud to announce that @volatilemarkts and @MiaAI_lab are officially joining me on TensorFold.
Watching this project grow so quickly has been surreal, and I’m hugely grateful to everyone contributing PRs, testing builds and sharing feedback.
TensorFold is becoming more than one person can maintain alone, and Mia will help us build recipes and engine improvements.
Volatile Markets will help with engine improvements as well as shape the project’s direction.
They’re both brilliant people who have supported me for a long time, and I feel incredibly privileged to have them alongside me for this next chapter.
LOCAL AI WILL WIN!!!
Gavin retweeted
TensorFold V0.3.6.3 is live, with more improvements already in the pipeline.
Massive thanks to @ViC305 for the banger of a PR on EXL3, @devopsfortunato for faster CUDA prefill, @AiMan_993 for safer image input, @MiaAI_lab for CUDA tool fixes, @codengod for Gemma support, @ivanfioravanti for helping track down stalls, and everyone contributing code, testing and filing bug reports.
Run "tensorfold update" in cli.
tensorfold.dev
Gavin retweeted
new cat dropped
New cat alert! A call from a wildlife sanctuary about a "weird cat" has led to the first new cat species discovered in over 100 years in Bolivia’s Yungas forest ecoregion. Learn more about this feline surprise: on.natgeo.com/JRuaGj
Gavin retweeted
Trying to explain to someone how i am pro technology but anti the people making the technology.
Somehow, against all odds, Anthropic seems to have united the US hyper-capitalists in the west with the Chinese communists in the east, in total opposition to whatever political/financial game the frontier labs are playing.
Truly incredible things are happening rn lol
Gavin retweeted
They told me you can’t learn anymore I couldn’t believe this I said add more layers and attention is all you need they added more layers now we’re learning let me tell you they’re learning better than ever like we’ve never learned before
Gavin retweeted
They say attention is all you need. Isn't that great? Attention is all you need. We like that, don't we folks? You've gotta stay sharp. You can't be like sleepy Joe.
