Pinned Tweet
Four hikes in Patagonia this week: Laguna de los Tres, Laguna Torre, Laguna Esmeralda, and Mirador de las Águilas. Two were brutal.
El Chaltén had almost no internet, but honestly that was a blessing. No social feeds, no CT—just cards, beers, and hanging out with the people you met on the trail.
Next stop: Devconnect 👨💻
ocdbytes retweeted
Session Recap | Bangalore, India 🇮🇳 | 26th Sept |
Topic: Beyond Autoregression and Backprop
Another amazing session just completed in Bangalore by @ocdbytes & @BLRxZo!
📖 Summary - drive.google.com/file/d/1zEk…
@typesafeai's Jev answers typed questions in a single forward pass and returns probabilities, so the whole session came down to whether those probabilities can be trusted.
📝 Topic Overview:
A chatbot generates an answer token by token and then sounds confident about it. Jev does neither. You give it state plus typed questions: Noul for yes/no, Choice for one option from your list, Score for ordered levels. It returns a probability over only the options you allowed. That makes the output type-safe, not correct. The "0% hallucination" figure comes from guaranteed schema matching, so Jev can still pick the wrong option from your list with high confidence.
✍🏻 @typesafeai has not published the architecture, weights or training method. So we rebuilt the idea from public papers and labeled every guess as a guess.
✍🏻 Better models got worse at knowing when they are wrong. In Guo et al., ResNet beat LeNet on CIFAR-100 error (30.6% vs 44.9%) but kept saying 0.9 when it was right far less often.
✍🏻 Calibration means that of all answers given at 0.8, about 80% should be right. GPT-4's pre-trained model scored an ECE of 0.007 on an MMLU subset, and post-training pushed it to 0.074.
💡 ECE is the average gap between stated confidence and actual accuracy.
✍🏻 Most "calibration" in the open Jev clones is a single temperature fitted after training, which is a 2017 trick - What does RLCD add beyond a strong base model plus one number?
✍🏻 This is the backprop problem. Jev outputs full probability distributions, which are differentiable, so plain supervised training with a Brier loss already rewards calibration.
💡 So why is RLCD reinforcement learning at all? The candidates are a reward based on downstream outcomes instead of labels, or decisions chained over steps as in the Doom demo?
Upcoming Event | Bangalore, India 🇮🇳 | 26th Sept |
Topic: Beyond Autoregression and Backprop
🎟️ RSVP - luma.com/wprc-blr
Thank you for our Session Guide @ocdbytes &
Session Partner @BLRxZo - India’s first permanent hacker house in Bangalore🤝🏻
📝 Topics and TL;DR
1) JEV by @typesafeai - A model that doesn't generate text at all, user just needs to send it context plus typed questions, and it returns a decision with a confidence score in one pass!
2) PC-ALM by Seely and Gould (@SakanaAILabs)
Training without backprop, meaning no global backward pass sending errors from the output through every layer. Each layer learns locally, and a per-layer correction term pulls its updates close to what backprop would have computed.
💡 What we'll argue about:
> Is JEV a new model class or a well-packaged classifier?
> Can local learning hold up past small benchmarks?
Summary will be shared on Luma soon!
ocdbytes retweeted
Whitepaper Reading Club at @BLRxZo
What's on agenda today:
- @typesafeai 's Jev architecture discussion
- PC-ALM paper by @SakanaAILabs
Might even make notes and post them after the session
ocdbytes retweeted
Upcoming Event | Bangalore, India 🇮🇳 | 26th Sept |
Topic: Beyond Autoregression and Backprop
🎟️ RSVP - luma.com/wprc-blr
Thank you for our Session Guide @ocdbytes &
Session Partner @BLRxZo - India’s first permanent hacker house in Bangalore🤝🏻
📝 Topics and TL;DR
1) JEV by @typesafeai - A model that doesn't generate text at all, user just needs to send it context plus typed questions, and it returns a decision with a confidence score in one pass!
2) PC-ALM by Seely and Gould (@SakanaAILabs)
Training without backprop, meaning no global backward pass sending errors from the output through every layer. Each layer learns locally, and a per-layer correction term pulls its updates close to what backprop would have computed.
💡 What we'll argue about:
> Is JEV a new model class or a well-packaged classifier?
> Can local learning hold up past small benchmarks?
Summary will be shared on Luma soon!
ocdbytes retweeted
word2vec embeddings study + implementation
Code : github.com/ocdbytes-ai/embed…
Blog : ocdbyt.es/blogs/word2vec
Check out the thread 🧵 :
ocdbytes retweeted
Replying to @sama @huggingface
OpenAI executives were literally stroking themselves while they typed out this report. If y'all can't understand that this was written to purely brag about the model then I don't know what to tell you.
ocdbytes retweeted
in hindsight it'll be so obvious that throwing LLMs at every ML problem was stupid
ocdbytes retweeted
‼️EVENTS THIS WEEK‼️
If you have friends or colleagues in Bengaluru, Kuala Lumpur, Ankara, or Davao City, feel free to share! 🔥
WANT TO ATTEND? luma.com/whitepaper?locale=e…
1) 🇲🇾 KUALA LUMPUR, MALAYSIA | 27 Jun:
Register: luma.com/whitep-q5rq
🧠 Topic: Agentic Trading: How do markets change when AI agents can observe, decide, and execute trades on-chain?
——————-
2) 🇮🇳 BENGALURU, INDIA | 27 Jun, 10:30AM IST
Register: luma.com/whitep-phkn?locale=…
🧠 Topic: The Quantum Era & Proof-of-Work
——————-
3) 🇹🇷 ANKARA, TURKEY | 27 Jun
Register: luma.com/g3ml5o0g
🧠 Discussion: Round table discussion at the Monad Blitz event in Ankara with Emire who translated our papers to Turkish
——————-
4) 🇵🇭 DAVAO CITY, PHILIPPINES | 27 Jun, 1:00PM PHT
Register: luma.com/whitep-eq3i?locale=…
🧠 Topic: RWAs, DeFi & Institutional Blockchain Infrastructure
ocdbytes retweeted
Hash-based IOPs are great at proximity testing but weren't built for privacy. Bolting on zero-knowledge usually adds overhead, that is, until ZOOK.
We implemented and benchmarked ZOOK, the zero-knowledge hash-based PCS from Alessandro Chiesa, @GiacomoFenzi and @gwberg95.
ocdbytes retweeted
Today we're launching early access to Zwap.
Trustless, shielded cross-chain swaps for Zcash. In and out of Orchard, trusting no one.
Live now: app.zwap.exchange
ocdbytes retweeted
We're hiring a Growth Lead at Atheon
Someone who actually understands ZK infrastructure and knows how to build an audience that does too.
You'll own the voice of Atheon and build the audience from the ground up. If high ownership is what you're looking for, this is that.
ocdbytes retweeted
Introducing Zinc+, where we tackle the problem of arithmetizing and proving computations unfriendly to finite fields.
Examples: classic hashes, hash + signature, lattice ops., etc.
We prove 7 SHA-256 compressions followed by the ECDSA MSM with:
ocdbytes retweeted
Give a man an LLM and he'll know everything.
Give a man 2 LLMs and he won't be sure of anything.
The EU @EUdigitalID picked @NoirLang for their ZK identity app, and you should too!
github.com/eu-digital-identi…
ocdbytes retweeted
We’ve been talking about it.
Now you can explore it.
Private. Instant. Compliant.
Check it out! perimeter.finance
ocdbytes retweeted
If you're an AI power user, get prepared.
As @0xSero says, the math for subs doesn't add up.
$200/mo can't cover the 16+ GPUs needed for power users.
So what happens next?
→ Prices go up
→ Limits get tighter
→ Your data becomes the product
But there’s another path emerging.
Open-source models are coming out with incredible efficiency savings. Local inference is improving. Home hardware is becoming viable.
The frontier is shifting from access → ownership.
Start building your sovereignty now.
ocdbytes retweeted
We've raised $2.1M to fix your focus.
Our wearable headset @mavehealth improves attention & stress regulation in just 20 minutes a day for users at @Google, @ufc, @ycombinator.
Backed by @BlumeVentures, alongside existing and new investors.
Order now at mavehealth.com 🇺🇸🇮🇳





























