
Hyperlexic Polymath Savant GenTech / AI Consultant CTO @ https://xitter.cf/t.co/aRlDQqW7Y3 EX-Heroku T&S Language Model Expert. #TrillionaireTokenClub #RunLocal
Louisville, Kentucky
Joined March 2008
- Tweets93.3K
- Following3K
- Followers6.1K
- Likes22.9K
Pinned Tweet
Replying to @essobi
Full analysis of Claude Code telemetry.
I'd highly suggest you set
export DO_NOT_TRACK=1
gist.github.com/data2json/43…
HAhah... God damnit.
I know why everyone's model acts like a hacker and how to prevent it.
It's sofa king stupid. :eyeroll:
Kyle 'esSOBi' Stone retweeted
🚨 GhostAction attackers planted a credential stealer disguised as a font file in 94 compromised GitHub repositories.
The malware runs when affected projects are opened in VS Code, steals developer credentials, and adds persistence.
Read - thehackernews.com/2026/10/gh…
Kyle 'esSOBi' Stone retweeted
Google has another banger 🤯
It’s called PaperBanana.
It turns your methodology text into academic illustrations, helping you explain your research visually.
100% free.
LOL
Trailers of GPUs are the new trailers of cigarattes.
Nvidia RTX 5090 shipment worth $470,000 goes missing in Brazilian airport tomshardware.com/pc-componen…
Okay, but I did the same thing.
Am I AI?
I mean... I could be.
Kyle 'esSOBi' Stone retweeted
There's boot licking, and there's snitching, then there is this 😂
I built software that detects people jaywalking all over the world with the help of unprotected surveillance cameras.
You can also report them by pressing a big emergency button. It then sends an email to the closest police station.
More info here: driesdepoorter.be/jaywalking
Hey Bert...
UltraBERT is here (along with super interesting lessons learned from training it)!
152M + 380M encoders, 32K context, built for classification, NER, QA, reward modeling + retrieval.
Most interesting part is the training recipe:
-5% masking for classification
-50% masking for retrieval
-Separate LM head for each
-Distillation only on the 5% sequences
Distillation findings are also really insightful. They trained a 1.3B teacher, pruned it by width to 380M and 150M, and distilled both smaller models from the teacher. But they only applied logit distillation to the 5% masked sequences.
Some other interesting training lessons:
-Encoder performance saturated early, even as loss kept falling
-Multi-stage data mixtures had little effect after fine-tuning
-32K context added during only the final 100B of 2T training tokens
-Distillation not automatically useful across every capability
Strong size-to-performance tradeoff too:
-380M leads the authors’ comparison on GLUE + BEIR
-150M matches RoBERTa-large on classification at 2.3x smaller
-~8 point lead on code + math retrieval
-99%+ Passkey recall through 32K
Great open source release! Long live BERT ✌️
@huggingface weights: huggingface.co/collections/d…
Paper: arxiv.org/pdf/2610.15028v1
Hard agree.
Tradecraft is extremely cheap and extremely accessable.
RATATAT.
open.spotify.com/track/5iSEs…
What you know about dreamin?























