erik retweeted
Scrum made sense at companies/teams that shipped a new version of their product every 2-3 months (or less frequent)
As soon as a team got to shipping daily or had CD: they only held teams back
Most startups + Big Tech moved on a decade+ ago, legacy companies remained only
The inference stack is becoming more important.
Turns out controlling Qwen 3.6 reasoning tokens takes token counting and injecting a magic phrase. Most engines don't.
Gory details at entropy-exchange.synaptiq.ai…
erik retweeted
While we are doing lobbying for AI laws, I propose this. All providers of closed source models are 100% liable for their outputs. Copyright, libel, conspiracy, fraud, etc... If you want safe harbor from this liability, release the weights. This is real AI safety legislation.
erik retweeted
Very proud to share that we just release Luce KVFlash. Run your preferred model inside Lucebox at 256k context, without thinking about KVCache and OOM, up to 2.9x faster decoding at long context.
Taking inspiration from OS paging and using our speculative prefill method (Luce PFlash), we managed to make KV vram usage almost constant. Offloading what is not needed dynamically.
Opensource must win now more than ever.
erik retweeted
You can now run @luceboxai engine in a container, with one image for every supported GPU.
Until now the only way to run it was to build it yourself: clone the repo with its submodules, install uv, CMake and a CUDA toolkit, wait around 25 minutes while nvcc compiled kernels for six GPU architectures, then download the weights and figure out the right flags.
None of that is hard ofc, but it is a lot of steps if you just want to try the server. There are now prebuilt images on GHCR, one for NVIDIA cards from the RTX 2080 Ti to the RTX 5090 and one for AMD starting with Strix Halo, so the whole thing becomes a pull, a mount and a docker run.
Details below 🧵
100% this. I'm generally of the opinion that you shouldn't use open source software in a product without being willing to vendor it in -- prepackaged builds are a temporary convenience.
It would help if common packaging tools were more vendor friendly, most are downright hostile,
I really believed a whole generation of developers, who only know open source from npm and pypi, miss how open source actually used to work.
When Debian or a Linux distribution ships a dependency they take responsibility of it. If there is a security issue and it’s not fixed by the developer upstream, they fix it for their users.
Debian and others basically vendor every thing they distribute. They honor the license and they maintain patches. Most of the stuff that you get from your Linux distribution is basically a (small) fork.
The same is true for Apple, Microsoft and others. The open source software they ship, they carry that responsibility.
That doesn’t mean that security fixes are not upstreamed, but Apple or Debian or anyone else won’t jump in Twitter to shame a developer into compliance with their ways. They are not dependent on the health of a packaging infrastructure. They own their software including all the things it depends on.
I want that thinking back. Because it fundamentally makes people feel more responsibility and it shares the burden of issues. It also does not put so much focus and attention on the one overworked developer who just happened to have too much of the world depend on their library. Remember: they carry a responsibility they never signed up to and they never got compensated for.
100% this. Little chunks of reusable content you can use to steer your friendly clanker make a big difference.
erik retweeted
Every time we engage with an influencer on X dot com, Dell sends them an XPS. Anyone want a free Dell XPS?
I've been using gastown. This may not be the final iteration, but it is the way.
It's been 12 days since I dropped Gas Town. The response has been off the charts. I've been working hard to keep up. Thanks to all the early adopters. I wrote up this survival guide. steve-yegge.medium.com/gas-t…
erik retweeted
Managers have been vibe coding forever by @thekitze :D
On the ground at SFO. I’ll be here all week attending #inbound2025. If you want to talk email and AI hit me up!
erik retweeted
Had to stack up 8 Mac Minis to get it running.
~5 tok/sec for now.
First time running inference on 8 Mac Minis - performance can be improved a lot (theoretical limit is >10 tok/sec on this setup).
erik retweeted
When SaaS products grow and the architecture starts to break down, two types of devs emerge:
1. Those who believe the system is beyond repair and needs to be totally rebuilt
2. Those who put their heads down and fix it one piece at a time
I've only seen group #2 be successful.


























