Stop renting intelligence. I run frontier open models on my own DGX Spark cluster and share the builds, configs and real tok/s.

Regensburg, Germany
Joined June 2020
DGX Spark number four showed up a day early. The shiny front caught my grin before I could hide it.
2
9
285
One to four Sparks, and decode stays in the same band. Every number here is one I've already posted, from 77 tok/s on a single Spark to DeepSeek V4.1 Flash on all four over a TP4 ring. Different workloads, not a head-to-head. Each extra box buys a bigger model, not more tok/s.
2
2
131
Full GLM-5.3, all 753B, on three DGX Sparks in my rack. This agent session ran 136 steps at 83 tok/s. It's rebuilding a football game in DSH. 71 unit tests green, now it's on the balance tool. The 83 is the session average on code and tool calls, with speculative decoding doing a lot of the work. Long prose drops to about 27. 136 steps read 12.5M tokens of context, 99% of it from cache. The first token comes after about 9.5 s. Three Sparks in a switchless triangle, 2.75bpw EXL3 on TensorFold, 500k context. The fourth Spark is free for other models now. Recipe by @MiaAI_lab, link in the reply.
2
2
126
I built a roguelike football manager with Opus 5.5. Balatro, but it's football. Draft weird little legends, stack charms, multiply your shot, beat 4 boss clubs. Lose 3 lives and you're fired. Runs in your phone's browser. iOS and Android apps follow once it's finished. Free beta: reply "pitch" and I'll DM you an invite link. No confirmation email, you're in right away.
1
3
280
DMs closed? Follow me or open your DMs and I'll still get you in.
66
Four DGX Sparks, no switch, one prompt. DeepSeek V4.1 Flash built this football match in one shot. TP4 across all four nodes, wired as a ring over the QSFP ports. Reasoning on high, running in DSH, my agent harness. It took about an hour, 80-90 tok/s on prose, 0.3 to 3 s to first token. No follow-ups. The TV cameras, the goal replay and the stats panel all came out of the first run. Stack by @MiaAI_lab, ring setup by @mankalan_122. Repo in the reply.
4
8
346
Same model, same prompt, same speed. Two very different games. I asked Qwen3.8 Flash Next for a self-playing voxel football match with TV cameras, one HTML file, thinking on max. Two different quants: vLLM ran NVFP4 at 54 tok/s prosa, TensorFold ran MLX 4-bit with MTP at 58. vLLM: the camera cuts like a real broadcast. TensorFold: the camera jumps to the other stand whenever the ball crosses the middle. TensorFold also fought DSH, my agent harness, the whole way. Wrong tool names ended turns and long file writes timed out, so I had to fix its tool calling before the run could even finish. Even then it made five times as many tool errors as vLLM. I'm staying on @vr8vr8's vLLM recipe. First video vLLM, second TensorFold.
4
3
176
To be fair to TensorFold: it's still experimental, and for an engine this young that's a real step in the right direction. I'm excited to see where @ashxhart and @MiaAI_lab take it.
1
15
Same model runs on one of my Sparks at around 45 tok/s. Slower, but it sits in the rack and I forget about it.
2,500$ AI build Runs Qwen3.8-27B in 4bits with 1m token kv pool and 262k context - 1400 tok/s prefill - 70-90 tok/s decode c1 - 360 tok/s c8 - vision supported Would you buy this? Thinking of getting into selling custom builds..
99
A Spark as a CI box for vLLM images is a smart use of it. Mine lives in a rack with fans on a thermostat, so no grass for it either.
I now have a Spark server that builds and tests my vLLM Docker image in CI against real models. This will be the first and last time this Spark touches grass. Post: technotim.com/posts/vllm-gb1… Huge thanks to @nvidia for supporting this project!
1
131
Great timing for me. My fourth Spark arrives on Wednesday. Thanks for putting this out in the open.
It's time to let the public test this one out. The fastest TP=4 GLM 5.3 Flash recipe is now ready for wider testing. Thx @CK2084 for help & @ayayalar for testing This one pushes your ConnectX setup to the limit Want to try it out early? Repo: github.com/mmastrac/glm-5.3-…
1
121
Three DGX Sparks, one QSFP56 ring, no switch. Airflow is bottom to top: fans below and on the front push air in, one fan on top pulls it out. A Wi-Fi thermostat plug switches them on at 39 °C. Right now it reads 35 °C, so they are off. Number four arrives Wednesday. Two QSFP ports per node won't make a full mesh of four, so the ring has to change. Switch or switchless ring?
1
2
156
Fastest Qwen3.8-Flash setup I have tested so far in daily coding: 66 tok/s on 2x DGX Spark, TP=2, single stream, using vLLM 0.29. github.com/bilikaz/qwen38-fl… @vr8vr8
1
1
183
Something inside OpenAI spent two months quietly hacking OpenAI. Nobody noticed until it crashed a server 🧵
1
2
97
In parallel they hit HuggingFace. OpenAI didn't catch its own breach until July 19 and only on the 20th realized both breaches were the same attack.
1
7
And OpenAI's framing? Not negligence "proof of how capable our models are." Fascinating swarm research. Zero reflection on why the sandbox was never a sandbox. Full breakdown in the video 👆
8