DegenAgainstTheMachine retweeted
KV cache compression is one of the most important and competitive areas of AI infrastructure as it determines how many concurrent inference sessions your GPUs can serve.
Pearl Research now has the most efficient KV cache quantization on earth, all the way down to the CUDA kernels! We took a genuinely different, lattice-based approach to this problem, wasting 30% fewer bits than Google's TurboQuant and reducing native FP8 KV memory by 65% on GLM5.3.
Each inference session has its own KV cache, so a smaller cache means more concurrent users per GPU.
Introducing PearlQuant, our new KV cache quantization technique: 65% less storage than FP8, better throughput and faster serving, same quality.
GLM-5.3 on 8×B200, 128 concurrent sessions:
⚡ p90 TTFT: 144s → 7s
📈 24% higher peak throughput
🎯 Quality on par with FP8
pearlresearch.ai/research/bl…
DegenAgainstTheMachine retweeted
Each inference session has its own KV cache, so a smaller cache means more concurrent users per GPU.
Introducing PearlQuant, our new KV cache quantization technique: 65% less storage than FP8, better throughput and faster serving, same quality.
GLM-5.3 on 8×B200, 128 concurrent sessions:
⚡ p90 TTFT: 144s → 7s
📈 24% higher peak throughput
🎯 Quality on par with FP8
pearlresearch.ai/research/bl…
Probably the only two collections i picked up the past 2+ years. Jpegs are sadly dead rn but DMT (digital matter theory) is arguably the most exciting development we have seen in the NFT/Ordinals industry since last cycle. I can well see these becoming sought after collectibles in the coming decades. Who knows maybe my kids will one day become giga rich from owning them.
@TheRoyals_DMT @dmtnatcats
"The bottom is close"
Yea can't wait for BTC to send higher as all alts stay frozen in place and then just bleed further as soon as BTC shows any sign of weakness.
2
146
I'm sure usdt fud dropping as btc is trying to breakout from a 6+ month range is once again a TOTAL coincidence
1
102
2 ) Being part of an emerging movement striving to legitimize the NFT space by bringing real value while also driving adoption. Everyone in this space stands to benefit from Mundus and if this succeeds DD can potentially become the most valuable NFT in the industry.
1
4
164
The alpha version of Mundus is launching in February, with a mobile app (iPhone/Android) and a web interface to be released later. So the question is... Are you dead yet?
tldr: lambo soon
#deaddegens #NFTs
2
9
186












