Viven retweeted
We're giving away a CONTROL Resonant custom wrapped NVIDIA GeForce RTX 5080 to celebrate its official release with #RTXON.
To enter:
🟢 Share this post
🟢 Comment #RTXON
T&Cs: nvda.ws/4z24Gcq
Took ideas from this PR and made a rudimentary Jev-like app using DiffGemma. It gets its probabilities from a one-pass read of yes/no logits.
DiffGemma is multimodal, so image input is supported and tested.
I ran some real, live evals on Jev vs DiffusionGemma-as-Jev (my patch for vLLM!)
DiffusionGemma comes out as the winner, I think.
Headlines:
Is Jev faster than DiffusionGemma? No ❌ (API vs DGX Spark)
Is Jev smarter than DiffusionGemma? No ❌ (they're roughly tied!)
1
119
Viven retweeted
Chinese researchers did it again!
Moonshot AI proved that 95% of attention computation is completely wasted..
They’ve open-sourced the exact attention mechanism powering Kimi's long context.. and it's 16x faster.
It’s called MoBA (Mixture of Block Attention).
Every time you feed an AI a massive prompt, every token desperately tries to look at every single token that came before it.
The math scales quadratically ($O(N^2)$).
It’s like reading a 500-page book and re-reading the entire thing from word one every single time you want to understand a new sentence.
Moonshot looked at this waste and said: No.
Instead of forcing full, brute-force attention across everything, MoBA applies the principles of Mixture of Experts (MoE) directly to the attention layer.
How it works:
• It chops the context history into discrete blocks.
• A lightweight dynamic gating mechanism lets each query token instantly "vote" and route only to the specific blocks that actually matter.
• It achieves up to 95% sparsity on long contexts without sacrificing performance.
The results are staggering:
It maintains full-attention accuracy on 1-million-token contexts while slashing massive compute overhead.
We are watching the structural efficiency barrier of long-context AI get smashed in real-time.
While Western labs argue about how to afford million-token context windows, Moonshot open-sourced the blueprint to make them radically cheap.
Might be a hot take but I think software engineering hasn't changed much. Yes, LLMs are non-deterministic but we have been building for non-deterministic users for decades - humans! We have built QA processes around users with safeguards, guardrails to prevent unwanted outcomes.
29
Viven retweeted
Holy moly. 🤯
Qwen 3.8 27B just scored higher than:
GPT 5.6 Terra
GLM 5.2
DeepSeek V4 Pro
Muse Spark 1.2
Claude Opus 4.8
on the Artificial Analysis Agentic Index.
And you can run this on a single RTX 3090/4090.
Go show your GPU some respect. 🫡
Fast H3 implementation for Metal. Enjoy, modify, and so forth: github.com/antirez/h3.c Contains code from @liuliu which is welcomed in taking back whatever parts he likes for @drawthingsapp in case there are H3 plans there.
Viven retweeted
Jürgen Klopp led a furious backlash against Fifa president Gianni Infantino, who now faces calls to resign after overturning Folarin Balogun’s World Cup suspension.
“This is our sport, not theirs. If Donald Trump and Gianni Infantino really sorted this out between themselves, it is madness; it calls everything into question.”
@ben_rumsby, @TelegraphDucker and @Tom_Morgs have more ⤵️
telegraph.co.uk/football/202…
Most text embedders match a query to a doc in a single forward pass. But reasoning-heavy retrieval takes a few hops of reasoning. So I tried a recurrent architecture instead.
1
1
78
Where it hits a wall: knowledge. The base was pretrained on a deliberately thin slice of text (HRM-Text is efficiency-first), so it's weak on knowledge-heavy domains. The reasoning engine's there, the base is the bottleneck.
1
29
Fully open, Apache-2.0. Honest numbers (raw + rewrite-assisted), full eval harness in the repo.
Model: huggingface.co/viventhraa96/…
Code: github.com/okaybroda/hrm-emb…
HRM by Sapient: github.com/sapientinc/HRM-te…
36
Viven retweeted
Nothing but pride for @CANMNT_Official today.
An incredible run and a sign of what’s to come.
Thank you to our team, the fans, and everyone who made this World Cup showing our best yet.



















