Creating the best open source models in the world through RLVR and Distillation · Subnet 5 on Biττensor

United States
Joined August 2025
Hone V4 is here⚔️ Miners now download large repos, find bugs, and return their solutions and agent traces to validators. We harvest this powerful training data to do RLVR on the best open source models. Let's make sure the future of AI is decentralized.
3
160
Pre-training is now cheap relative to reinforcement learning through verifiable rewards (RLVR)- it's just 7% of Anthropic+OpenAI's spend on their models. Since RLVR is the new bottleneck, we ask: can it be open sourced? Welcome to @bittensor Subnet 5: Hone.
1
1
9
548
We're initially focusing on reinforcement learning in coding environments. Miners solve hard coding problems and we collect the successful rollouts for training our own coding agents. If you have compute or extra API credits, consider mining on Hone!
1
2
98
Hone Training retweeted
Introducing Secure Targon Compute Today, we’re giving developers the ability to rent H200 and CPU nodes along with scaling workloads as needed, all secured by the Targon Virtual Machine (TVM). Every instance runs inside a confidential environment powered by Intel TDX, AMD SEV, or NVIDIA Confidential Computing. Targon delivers the speed of modern cloud compute with the privacy guarantees enterprises expect. targon.com/
4
18
6
94
20,738
Big news! 🗞️ 🌊 We just merged the first version of the codebase for @bittensor subnet 5 : github.com/manifold-inc/hone and we are opening up 1% incentive for our live production test! Validator is now running. 1/3 🧵
2
10
41
6,011
There are no constraits on miner solutions. Eg. miner starter code uses an OpenAI key to solve the @arcprize (ARC-AGI 2) problems, and you can: - use another provider - more prompt engineering - finetune your own LLM - try new methods like HRMs 2/3 🧵
1
10
783
The most important thing is to expose the endpoints needed for sending the ARC-AGI problems — as for the solution, you can do whatever you want. 🫱🏻‍🫲🏼 3/3 🧵
6
618
Hone Training retweeted
Hash Rate - Ep 136: Hone ($TAO Subnet 5) Chasing AGI 🧙 Guest: @0xcarro of @traininghone Can a Bittensor subnet crack AGI before Elon or Sam? Hone (SN5) thinks it can. 00:00 Intro to Hone and AGI 02:52 Understanding the Arc AGI Benchmark 08:48 Introducing JEPA & Hone's Approach to AGI 23:31 The Data Rich Get Data Richer 26:14 The Most Ferocious Form of Capitalism 32:14 Final Thoughts and Future Directions
7
13
2
61
14,744
GM ☀️ Latest @arcprize results : GPT 5 : 9% vs 7% in public bench Grok 4 : 22% vs 16% in public bench Gonna keep optimizing, in parallel we should run the mainnet test soon so we can launch! 🔥🚀
2
4
2
23
9,120
Update on Subnet 5: 🗞️🪡🧶 The core of our synthetic data generation is ARC AGI 1, the difference between that and ARC AGI 2 is the difficulty & complexity of tasks. For this we use github.com/google/ARC-GEN for ARC AGI 1 tasks generation 🧵 1/5
2
6
3
32
14,776
For ARC AGI 1 (the 1st part in our pipeline) : - `Gpt5-medium` : on our synthetics (`57%`) vs public ARC benchmark (`56%`) - `O3-medium` : on our synthetics (`49%`) vs public ARC benchmark (`53%`) - `Grok-4` : on our synthetics (`60%`) vs public ARC benchmark (`67%`) 🧵 4/5
1
10
553
For ARC AGI 2, we are still tweaking the difficulty of transformations so that our benchmarks fit well with the public one too, for now we're at 28% with `GPT-5` (vs 7% in the public benchmark) More soon! 🦾🧵 5/5
1
11
444
We are happy to announce Subnet 5, Hone · Hierarchical AI Pretraining, a collaboration between @manifoldlabs & @latentholdings
48
22
7
136
21,635
Learn more about our mission: hone.training/
27
3
1
29
3,220