Founder of Colibrì a tiny engine for immense model for affordable hardware. 🐦

Joined January 2016
We are working hard for optimize colibrì with the community. This is Qwen 3.6 35b.
2
1
9
335
Dualistic x Lumabri We are cooking! Optimizing software/hardware affinity is our moat and @justvugg is building one of the best optimization tool for LLMs hosting on large scale. Stay tuned
1
2
10
563
I am adding many optimizations and various forms of support to Colibrì to further broaden access to LLMs and make the experience as convenient as possible for instance, by adding support for GGUF, improving CUDA and Vulkan compatibility, and pushing for greater speed.
1
15
356
Thanks to the grant from @rauchg today we got a GPU server from @Hetzner_Online to roll out our optimizations and make Colibri even better from standard machines to systems with GPUs, for those who want to get the most out of their hardware. We’ll keep working and pushing!
3
4
16
452
Hi everyone! Colibrì is at 42,000 stars! As our community grows, so do the work and personal costs behind it. I’d love to support more hardware and take it further. If you’d like to help, your support will fund testing and development. buymeacoffee.com/justvugg
2
9
335
You no longer need an expensive GPU to run powerful AI models locally Colibri is a free GitHub project with nearly 42K stars that runs large AI models on laptops with as little as 8GB of RAM, using smart memory management and supporting Claude Code. Your laptop could become your own private AI server, without a monthly subscription. Repo: github.com/JustVugg/colibri
30
68
5
401
69,785
Qwen-Image-2.1 is now supported in Colibrì! Generate images on your own hardware. Try it out and show us what you create! github.com/JustVugg/colibri
1
6
1
45
1,389
New: System One on Colibri. Ask a question with fixed options, get a probability for each, never an answer off your list. Laya, GLiNER2.5-Decide and Clef run natively in C. Video: GLiNER2.5-Decide plays FlappyBri through it on an i7-1355U laptop (20x).
2
5
1
29
5,930
FlappyBri, the game in the video, is on GitHub: fly it yourself, or let any model in colibri fly it. GLiNER2.5-Decide made 12 pipes. Beat it? Open an issue or a PR with your score and a screenshot: we're building the leaderboard. github.com/JustVugg/flappybr…
3
236
New models: MiMo-V2.6 Flash and Pro, Qwen3-Coder-30B, Qwen3.8-27B, and Qwen-Image-2.1 (512x512 in 61 s on the server's Radeon 780M). On GPUs: 8 GB cards keep the layers that fit, a second GPU holds more experts, and the archives ship Vulkan, Metal and CUDA.
2
5
253
@fastinoAI @Cloudflare New: System One. Ask a question with fixed options, get a probability for each, never an answer off your list. Laya, GLiNER2.5-Decide and Clef run natively in C. Video: GLiNER2.5-Decide plays FlappyBri through it on an i7-1355U laptop (20x).
1
2
137
FlappyBri, the game in the video, is on GitHub: fly it yourself, or let any model in colibri fly it. GLiNER2.5-Decide made 12 pipes. Beat it? Open an issue or a PR with your score and a screenshot: we're building the leaderboard. github.com/JustVugg/flappybr…
1
4
76
colibri 2.0 is out, and the big one is Vulkan on every engine: any GPU now runs the experts and whole layers. And every text engine serves 16 conversations at once. 169 PRs since 1.12.1, 88 from contributors. github.com/JustVugg/colibri/…
3
1
1
34
1,257
Qwen3.8-Flash-Next on our test server, a Ryzen 7 PRO 8700GE with 61 GB of RAM: 185 GB of weights that do not fit, so the experts stream from the NVMe. With int4 experts it decodes 1.4-1.56x faster at the same RAM, and its MTP head now drafts by default: 4.12 → 4.94 tok/s.
1
2
231
JustVugg retweeted
the local half: github.com/justvugg/colibri pure c, streams the experts off disk. k3's checkpoint is ~1.5 tb, so size the ssd first. for qa, use its brio mode: it scores merge / request changes / close instead of writing a review. 0 tokens generated, so a slow 2.8 trillion parameter model still finishes overnight. chatgpt sign-in lives in devin → settings → account → "continue with chatgpt".
1
1
7
279
JustVugg retweeted
if you're still sitting in front of your laptop waiting for your agent to finish, then you're the bottleneck. for an extra $20 a month, you get a night shift engineer that ships while you sleep. here's mine: → devin pro, $20/mo. runs on its own cloud computer, browser included → sign in with chatgpt. gpt-6 sol bills to the plan you already pay for → swe-2 is free on it right now → kimi k3 (2.8 trillion params) runs locally off my ssd as the qa agent devin builds in the cloud. kimi checks it locally. i wake up to a reviewed pr. that's how a 100x engineer moves.
Build the setup that makes people ask, “How the hell did you do all that alone?”
13
4
32
2,547
colibri now generates images: Qwen-Image-2.1 @Alibaba_Qwen on a pure C engine, on the CPU, no PyTorch, in 9 GB of RAM. See the picture in your terminal or the web UI. The GIF is sped up: 16 steps at 1024x576 for legible text. On dev now, soon for everyone.
2
4
25
1,000
Brio mode for colibrì Turn any open LLM supported by colibrì into a Jev-style model. github.com/JustVugg/colibri
3
9
512