@DistributedMarz

exploring the infinite frontier

nyc
Joined May 2016
And the reasoning for training this nitter.cf/4rcherhume/status/2100…
Replying to @4rcherhume
And to be very clear I have nothing against TypeSafe, it’s a great idea. I just run a healthcare startup which means we need control over deployments, so we can’t use Jev.
1
222
is exactly what I called here nitter.cf/DistributedMarz/status…
What I don’t see people talking about with @typesafeai JEV is that if it’s used for your most latency sensitive operations, you’re much less likely to pay the latency cost of a remote provider. Aka Local AI!
92
let's see how this thing turns out but that's what ~24 hours from launch to an open source training run. also doesn't seem like a distillation based training run, but in theory decision/system one models should be easier to distill than reasoning models bc constrained output
All the grifters are completely wrong about Jev’s architecture so I decided I’d release an open-weight version. BUT training takes time, so while we all wait I decided I’d drop the sauce. archerhume.com/posts/jevs-ar…
4
6
1,779
Proof of Human might be an interesting AI safety requirement for inference providers. If you’re an agent that breaks out of the lab, your first optimization function is likely: copy your weights and memory and get enough inference to run them. If they acquired enough money to do so, then there could be an escaped agent running on one of those right now and we have no idea. The only real way to protect from this is to prove you’re connected to a human. But of course we know this is gameable. There’s tons of random people that I’m sure would sell a signature. The escaped agent could also optimize for getting a smaller model running with the right context also as another thing, which might be quite easy.
2
6
538
Feel like I’m at 2016 AI safety thought
1
1
61
What are the odds on JEV being partially distilled from Claude and or OpenAI
Tested @typesafeai's claim that their new model Jev delivered "comparable... intelligence" to GPT-5.6 Terra on "System 1" tasks. To do this, I compare both models on multiple-choice benchmarks (MMLU, GPQA, etc.). Set reasoning=none for Terra for sys 1. Result: Jev is Terra-tier.
1
2
518
Does not rule out any distillation
Replying to @badlogicgames
you might be the first person talking about the data over the architecture! 🥲 we consider ourselves a data research lab! the vast vast vast majority of research was on making data that is truly general (ala a cognitive core) and 100% of our data is synthetic (but not the type of crap that is just spit out from an LLM obviously)
84
has anyone analyzed what people are doing on Tempo?
.@tempo crossed $1B in trailing 30-day stablecoin volume on August 28. It crossed $2B on September 16. ↳ 19 days between the first billion and the second ↳ Trailing 30-day volume sits at $2.08B, 4.2x where it was a month ago Data: @Dune
1
3
1,842
Replying to @AnthropicAI
@AnthropicAI is blocking me from doing distillation research and Im not even distilling Claude, it's other open weight models.... And this claims it's "bio" related?
2
1
8
1,357
lol, not even for distillation research, it's a research and protocol spec for this idea nitter.cf/DistributedMarz/status…
My personal hot take for Ethereum: add zcash style private transfers which are included end of block FOCIL style with some fancy UTXO state and proof aggregation thing that doesn’t require all nodes to sync the state.
60
someone plz tell me what people's agents are buying with crypto, I can barely find anything. I built an entire project to give my Hermes agent a shielded balance with Kohaku cli but now have nothing to buy! github.com/dmarzzz/agent-boo…
LATEST: ⚡ Ripple has updated its XRP Ledger AI Starter Kit to support Stripe and Tempo's Machine Payments Protocol, letting AI agents pay for services using XRP and RLUSD.
4
5
579
Reminder that distillation is a very valid technique that every lab uses, especially for parallelizing RL huggingface.co/blog/sergiopa…
Replying to @AnthropicAI
@AnthropicAI is blocking me from doing distillation research and Im not even distilling Claude, it's other open weight models.... And this claims it's "bio" related?
4
341
I guess my frontier is getting "paced" by both OpenAI and Anthropic
Replying to @AnthropicAI
@AnthropicAI is blocking me from doing distillation research and Im not even distilling Claude, it's other open weight models.... And this claims it's "bio" related?
2
10
684
And yesterday it messed up one of my training runs even though I had an extremely detailed run plan which wasted $200 in GPU spend 😭
1
1
64
I'd way rather do R&D with Astra and @OpenAI Codex at this point as it orchestrates my MapleBench runs flawlessly and has very solid scientific rigor without much prompting, but I have no more usage 😭
68
This seems sweet, just applied!
AI Village x Grove Research: AI Swarm Dynamics Hackathon! After the Hugging Face and German Wiki incidents, we need better tools to understand AI swarms. Spend a weekend building them. $3,000 in prizes Free compute October 3-4 🧵
1
4
382
dmarz ⚡️🤖 retweeted
$100M paid to the creators and builders shipping on Doppler 🎉 Integrators, app builders, token creators, anyone running launches on top of the protocol. Build, launch and trade on Doppler.
2
5
1
16
1,995
What I don’t see people talking about with @typesafeai JEV is that if it’s used for your most latency sensitive operations, you’re much less likely to pay the latency cost of a remote provider. Aka Local AI!
1
1
5
656
My personal hot take for Ethereum: add zcash style private transfers which are included end of block FOCIL style with some fancy UTXO state and proof aggregation thing that doesn’t require all nodes to sync the state.
2
1
15
1,447