Data Hacker. CTO and Cofounder at https://xitter.cf/t.co/BiP4BcniIt. CTO at https://xitter.cf/t.co/ncrsKFvzYP

38.895864,-77.042532
Joined December 2006
Scrum made sense at companies/teams that shipped a new version of their product every 2-3 months (or less frequent) As soon as a team got to shipping daily or had CD: they only held teams back Most startups + Big Tech moved on a decade+ ago, legacy companies remained only
it's funny how scrum masters completely disappeared and no one really cared
111
112
27
2,290
270,030
The inference stack is becoming more important. Turns out controlling Qwen 3.6 reasoning tokens takes token counting and injecting a magic phrase. Most engines don't. Gory details at entropy-exchange.synaptiq.ai…
3
112
While we are doing lobbying for AI laws, I propose this. All providers of closed source models are 100% liable for their outputs. Copyright, libel, conspiracy, fraud, etc... If you want safe harbor from this liability, release the weights. This is real AI safety legislation.
44
105
13
1,530
64,184
Very proud to share that we just release Luce KVFlash. Run your preferred model inside Lucebox at 256k context, without thinking about KVCache and OOM, up to 2.9x faster decoding at long context. Taking inspiration from OS paging and using our speculative prefill method (Luce PFlash), we managed to make KV vram usage almost constant. Offloading what is not needed dynamically. Opensource must win now more than ever.
14
31
5
331
26,309
You can now run @luceboxai engine in a container, with one image for every supported GPU. Until now the only way to run it was to build it yourself: clone the repo with its submodules, install uv, CMake and a CUDA toolkit, wait around 25 minutes while nvcc compiled kernels for six GPU architectures, then download the weights and figure out the right flags. None of that is hard ofc, but it is a lot of steps if you just want to try the server. There are now prebuilt images on GHCR, one for NVIDIA cards from the RTX 2080 Ti to the RTX 5090 and one for AMD starting with Strix Halo, so the whole thing becomes a pull, a mount and a docker run. Details below 🧵
4
10
2
53
5,564
100% this. I'm generally of the opinion that you shouldn't use open source software in a product without being willing to vendor it in -- prepackaged builds are a temporary convenience. It would help if common packaging tools were more vendor friendly, most are downright hostile,
I really believed a whole generation of developers, who only know open source from npm and pypi, miss how open source actually used to work. When Debian or a Linux distribution ships a dependency they take responsibility of it. If there is a security issue and it’s not fixed by the developer upstream, they fix it for their users. Debian and others basically vendor every thing they distribute. They honor the license and they maintain patches. Most of the stuff that you get from your Linux distribution is basically a (small) fork. The same is true for Apple, Microsoft and others. The open source software they ship, they carry that responsibility. That doesn’t mean that security fixes are not upstreamed, but Apple or Debian or anyone else won’t jump in Twitter to shame a developer into compliance with their ways. They are not dependent on the health of a packaging infrastructure. They own their software including all the things it depends on. I want that thinking back. Because it fundamentally makes people feel more responsibility and it shares the burden of issues. It also does not put so much focus and attention on the one overworked developer who just happened to have too much of the world depend on their library. Remember: they carry a responsibility they never signed up to and they never got compensated for.
1
52
erik retweeted
alright all of you that maintain a cli oauth flow i hope it's obvious to you now doing the whole browser link callback to localhost thing is dumb and annoying af in ssh please implement the code flow that polls - try gh cli login flow to see it
77
42
11
1,666
187,234
100% this. Little chunks of reusable content you can use to steer your friendly clanker make a big difference.
Writing ADR's for agents has been such a good decision Capturing all the non-obvious decisions in a codebase makes every agent in your stack that touches the stack smarter It's the thinnest layer of docs that captures the stuff code can't
1
31
Your AWS bill once you put a tokenmaxxing leaderboard up for the engineering team:
2
9
1
120
10,509
Every time we engage with an influencer on X dot com, Dell sends them an XPS. Anyone want a free Dell XPS?
1,845
185
75
9,928
559,575
I've been using gastown. This may not be the final iteration, but it is the way.
It's been 12 days since I dropped Gas Town. The response has been off the charts. I've been working hard to keep up. Thanks to all the early adopters. I wrote up this survival guide. steve-yegge.medium.com/gas-t…
2
127
Managers have been vibe coding forever by @thekitze :D
148
784
117
9,378
494,591
On the ground at SFO. I’ll be here all week attending #inbound2025. If you want to talk email and AI hit me up!
2
78
pgvector is insane. i don't understand why vector databases exist.
99
64
25
2,001
344,828
Had to stack up 8 Mac Minis to get it running. ~5 tok/sec for now. First time running inference on 8 Mac Minis - performance can be improved a lot (theoretical limit is >10 tok/sec on this setup).
Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.
113
179
63
2,310
698,346
When SaaS products grow and the architecture starts to break down, two types of devs emerge: 1. Those who believe the system is beyond repair and needs to be totally rebuilt 2. Those who put their heads down and fix it one piece at a time I've only seen group #2 be successful.
8
5
1
50
5,064