Devye (@XDevye) header
Devye (@XDevye) profile picture

本地大模型 | AIGC爱好者 拥有💻4*dgx Spark + 2*R9700 + RTX 5090 + Pro2000 本地LLM搭配 智能:Deepseek v4.1 Flash 1017 速度:Qwen3.8 27B 生图:Qwen Image 2.1

Joined April 2025
Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context. Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster. With @kubicek_ales @caciolai @PengLiangzu @SukritSumant @Ben_Hoov @FraserGreenlee @RMBattleday @radim_urban @thoefler @jcrwhittington
100
335
81
3,278
500,060
Claude Opus 5.5 in the cloud against DeepSeek-V4.1-Flash on four DGX Sparks: same voxel-world prompt, one try each. Opus built Lumenfall in my Claude Code CLI. The Sparks run @bertholomusai's TensorFold recipe (his EXL3 4.0 bpw quant split across all four Sparks, commit 8f84e7a) and built Aetherfall. Opus 5.5, cloud: done in 33.2 min DeepSeek, 4 Sparks: done in 49.7 min Tokens written, Opus: 173,159 Tokens written, DeepSeek: 121,707 Browser check, Opus: 9.0/10 Browser check, DeepSeek: 9.0/10 Cost, Opus: about $7.82 at API list prices (Anthropic pricing page, Oct 23, 2026), I ran it on my subscription Cost, 4 Sparks: no API bill, my own hardware The worlds are really not that far apart when it comes to quality. The setups differ: the Sparks ran in the locked test container, answer limit 262,144 tokens, in the recipe's neighbor-ring mode on my switchless ring. Opus ran in my own CLI with internet, my files, no time gate and about 71,000 tokens of context before the first answer. Times run from agent start (Sparks) and from sending the prompt (Opus; 26.0 min by the model's own clock file, which started late). Play the Spark world in your browser. Every number, the exact command and the raw output: niklaslenz.com/v2/deepseek-v… New generations from Qwen, DeepSeek and GLM are due in the next days or weeks. I'm curious what their worlds will look like. Recipe, quant and TensorFold fork by @bertholomusai. TensorFold engine by @ashxhart. Model by DeepSeek. Claude by Anthropic. My pick: Lumenfall from the cloud is a better world, but if it has to run at home, bertholomus' 4-Spark ring gives you Aetherfall at the same browser-check score with no API bill.
6
2
17
1,658
Devye retweeted
Elon can predict the future like no one else.
Replying to @Teslarati
The rate of improvement from original GPT to GPT-3 is impressive. If this rate of improvement continues, GPT-5 or 6 could be indistinguishable from the smartest humans. Just my opinion, not an endorsement. I left OpenAI 2 to 3 years ago. Am a neutral outsider at this point.
14
6
165
25,477