Ten model families on Colibrì:
GLM-5.2/5.3/Flash @Zai_org
Inkling @thinkymachines
Kimi K3 @Kimi_Moonshot
DeepSeek V4/4.1 @deepseek_ai
Qwen3.6/3.8/Coder/Image-2.1 @Alibaba_Qwen
MiMo-V2.6 @XiaomiMiMo
OLMoE @allen_ai
System One: GLiNER2.5-Decide, Clef, Laya
github.com/JustVugg/colibri
JustVugg retweeted
Dualistic x Lumabri
We are cooking! Optimizing software/hardware affinity is our moat and @justvugg is building one of the best optimization tool for LLMs hosting on large scale.
Stay tuned
I am adding many optimizations and various forms of support to Colibrì to further broaden access to LLMs and make the experience as convenient as possible for instance, by adding support for GGUF, improving CUDA and Vulkan compatibility, and pushing for greater speed.
Thanks to the grant from @rauchg today we got a GPU server from @Hetzner_Online to roll out our optimizations and make Colibri even better from standard machines to systems with GPUs, for those who want to get the most out of their hardware. We’ll keep working and pushing!
Hi everyone! Colibrì is at 42,000 stars!
As our community grows, so do the work and personal costs behind it. I’d love to support more hardware and take it further. If you’d like to help, your support will fund testing and development.
buymeacoffee.com/justvugg
JustVugg retweeted
You no longer need an expensive GPU to run powerful AI models locally
Colibri is a free GitHub project with nearly 42K stars that runs large AI models on laptops with as little as 8GB of RAM, using smart memory management and supporting Claude Code.
Your laptop could become your own private AI server, without a monthly subscription.
Repo: github.com/JustVugg/colibri
Colibrì just passed 40,000 GitHub stars!
Thank you for every contribution, bug report, test and word of support.
From the new Vulkan support to everything ahead, I’ll keep giving Colibrì my best.
github.com/JustVugg/colibri
FlappyBri, the game in the video, is on GitHub: fly it yourself, or let any model in colibri fly it. GLiNER2.5-Decide made 12 pipes. Beat it? Open an issue or a PR with your score and a screenshot: we're building the leaderboard.
github.com/JustVugg/flappybr…
@fastinoAI @Cloudflare
New: System One. Ask a question with fixed options, get a probability for each, never an answer off your list. Laya, GLiNER2.5-Decide and Clef run natively in C.
Video: GLiNER2.5-Decide plays FlappyBri through it on an i7-1355U laptop (20x).
FlappyBri, the game in the video, is on GitHub: fly it yourself, or let any model in colibri fly it. GLiNER2.5-Decide made 12 pipes.
Beat it? Open an issue or a PR with your score and a screenshot: we're building the leaderboard.
github.com/JustVugg/flappybr…
colibri 2.0 is out, and the big one is Vulkan on every engine: any GPU now runs the experts and whole layers. And every text engine serves 16 conversations at once.
169 PRs since 1.12.1, 88 from contributors.
github.com/JustVugg/colibri/…
JustVugg retweeted
the local half: github.com/justvugg/colibri
pure c, streams the experts off disk. k3's checkpoint is ~1.5 tb, so size the ssd first.
for qa, use its brio mode: it scores merge / request changes / close instead of writing a review. 0 tokens generated, so a slow 2.8 trillion parameter model still finishes overnight.
chatgpt sign-in lives in devin → settings → account → "continue with chatgpt".
JustVugg retweeted
if you're still sitting in front of your laptop waiting for your agent to finish, then you're the bottleneck.
for an extra $20 a month, you get a night shift engineer that ships while you sleep. here's mine:
→ devin pro, $20/mo. runs on its own cloud computer, browser included
→ sign in with chatgpt. gpt-6 sol bills to the plan you already pay for
→ swe-2 is free on it right now
→ kimi k3 (2.8 trillion params) runs locally off my ssd as the qa agent
devin builds in the cloud. kimi checks it locally. i wake up to a reviewed pr.
that's how a 100x engineer moves.
colibri now generates images: Qwen-Image-2.1 @Alibaba_Qwen on a pure C engine, on the CPU, no PyTorch, in 9 GB of RAM. See the picture in your terminal or the web UI. The GIF is sped up: 16 steps at 1024x576 for legible text. On dev now, soon for everyone.
Brio mode for colibrì
Turn any open LLM supported by colibrì into a Jev-style model.
github.com/JustVugg/colibri








