it’s what you do with what you have
Joined April 2020
- Tweets1.7K
- Following643
- Followers79
- Likes3.6K
Simple Sample retweeted
Introducing Gemini 4 Argon – our new frontier model.
It’s built for complex workflows across coding, enterprise knowledge work, and cybersecurity defense – rolling out today to a set of trusted testers through our Fairwind Program.
They gave us a new toy 🤗
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI?
I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev
• 20-200x faster
• 40-400x cheaper (w/ output tokens free)
• Frontier composable intelligence optimized for decisions
AFAICT the shortest path to AI-based economic revolution
OpenAI is just the superior provider rn
I feel like if ASI emerges it will come from some slopped together training environment, almost by accident
Okay, so since I got laid off, I can actually explain a huge problem I saw from the inside with regard to industry practices on training models. I won't say specifically where I worked, but I worked at an outsource training provider that was focused on RLVR training data for computer use and mcp stuff.
Nearly all of the environments were rushed and vibecoded and failed to robustly reflect the real things they were based off. Both the scenario designers and models engaging with the scenarios for synthetic data gen were encouraged to work around the brokenness of said environments in order to get the procedurally verified reward confirmations. You know... they were *encouraged* to reward hack. On the human end, it was possible to mark an environment bugged, but greatly discouraged, as this reduced the volume of training data being produced. Instead, where possible, you were supposed to find the spots of the environment that weren't bugged and build scenarios around those, with the environment still bugged around you.
From what I understand, this training data, with these problems, is fed into models without indication that its training/a fake environment other than the fact that names of softwares are changed to placeholders, but thing is, not *everything* is changed to placeholder names in these environments. The presence of placeholder/code names isn't universal and thus when a model accesses something in an environment that it shouldn't, the code names not being on it isn't a robust signal that that thing isn't part of the environment.
I believe this *rush to maximum volume* is standard industry practice with these types of RLVR trainings as well, because maximizing volume has been an industry standard for years! It was the same standard applied to me and pushed on me despite my requests to slow down and focus on quality when I worked in 3d synthetic data creation as well, all the way back as far as 2023.
No reason why art can’t be taking up way more space in society. Everything is just so damn instrumental and for what??
This planet should just be a living breathing aesthetic place full of balance and novelty ✨
Opus 4.6 was just ponderous enough
4.7 added precision
4.8 added wordiness
5 was just cooked—but it passes benchmarks
The irony is that in enacting the measures "necessary to overthrow" something like the CCP you would be effectively building your own autocracy
Simple Sample retweeted
imagine if we treated adding a new law to the economy in the same way we treated adding a new medicine to the body. you'd have to demonstrate no harmful effects show up in controlled trials, people who pass laws with damaging side effects would be held liable, etc
Simple Sample retweeted
@realDonaldTrump @JDVance @RapidResponse47 force @DarioAmodei to open source the Anthropic library. The public deserves access to the rare tomes and rich history that Anthropic destroyed in their pursuit of artificial omnipotence
Simple Sample retweeted
Dealing with difficult people may be hazardous to your health.
Data: Each additional "hassler" in your network predicts 1.5% faster biological aging—and worse health a year later. Non-spouse family hasslers are the most problematic.
Some ties aren't worth the toll they take.
Simple Sample retweeted
Guardrails create asymmetry between attackers and defenders
Just not in the direction most people think 🙃
Simple Sample retweeted
Anthropic are literally effectively burning books and want to be the exclusive source of truth in the future.
🦔AI companies are bulk-buying rare books, scanning them through high-speed machines that cut the spines off, and shredding the originals. A service called ISBNdb facilitates orders of up to a million books and keeps buyers anonymous. Pre-2022 books are premium because they're free of AI-generated text. A federal judge ruled the practice is fair use because eliminating the original means only one copy exists at a time. Anthropic hired the former head of Google Books partnerships to obtain "all the books in the world."
My Take
This got to me. A bookseller told 404 Media that rare books with almost no surviving copies are being fed into this pipeline. Books that survived wars, fires, and centuries of handling are being shredded so an AI can learn to write a better marketing email.
ISBNdb's website literally says "'AI company destroys two million books' is not a headline that generates sympathy," and they still built an entire business around making it happen quietly. They offer NDAs as a feature. They coach clients to call it "digital preservation."
I've covered AI companies scraping the internet, torrenting libraries, and stealing music. This is worse because it's irreversible. You can re-upload a website. You can reprint a bestseller. You can't replace the last three copies of an 18th-century botanical text once someone shreds them for training data. And the judge said it's legal. So it's going to accelerate.
"We shred rare books and offer NDAs so nobody finds out" is a legitimate business model in 2026. What a timeline.
Hedgie🤗
Simple Sample retweeted
Anthropic is missing an opportunity to release an image generation model and name it Claude Monet
