SAIL Media retweeted
This is a great way of thinking about how coding agents impact the process of software engineering and hence demand for software engineers.
SAIL Media retweeted
Crazy model! It actually uses the old Qwen2.5-Coder-3B stack and got really great performance with their post-training stack.
Need to use it in the next days to see if vibes of VibeCoder actually check out in practice. But impressive first impression!
Based on the tech report, some of the important pieces of their post-training stack:
1. High-signal synthetic data (math problems with credible solutions, code with tests)
2. Multiple reasoning paths for each answer
3. Filtering, filtering, filtering
4. 2-stage SFT (start with broad training, then train on hard long-reasoning samples)
5. Use target (pass@k) accuracy over validation loss for checkpoint selection
6. MGPO (MaxEnt-Guided Policy Optimization) for RLVR: basically a GRPO-style RL method with an extra weighting that favors examples that are neither too easy nor too hard for the current policy
7. Single 64k long-context RL (they found that the usual progressive context expansion hurt this model because early truncation damaged long-thinking behavior)
8. Training data order: they do Math RL, then Code RL, then STEM RL in this particular oder which they found helped overall
9. After optimizing for accuracy, they add a stage that rewards shorter correct trajectories; basically making the model more efficient without accuracy degradation
SAIL Media retweeted
New podcast with @finbarrtimbers! We survey the latest post-training recipes, from GLM 5.1, Kimi K2.6, DeepSeek V4, Xiaomi MiMo V2.5, Nemotron Ultra, etc. and discuss:
- Why the industry slowly shifted to multi-teacher on-policy distillation (MOPD).
- What an Olmo-style recipe would need improvements in
- How post-training works / suits larger organizational efforts
- Career advice in the foothills of the singularity
- and other topics
I heard y'all wanted me to start doing this, so making some time when I'm in funemployment!
Chapters:
00:00 Introduction & Olmo reflections
06:28 Post-train recipes review (history)
23:00 2026’s model recipes (MiMo Flash, DeepSeek V4, GLM 5, Kimi K2.6, etc.)
39:05 Open-ended post-training discussions
48:22 Career advice in the LLM race
Links below, please follow @interconnectsai and like and subscribe and buy my book?
SAIL Media retweeted
Lambda CCO @boborado on @theDeepView: why compute isn't a commodity, what the $40k robot experiment taught him, and where AI infrastructure is headed.
Watch: youtube.com/watch?v=BvnQb0la…
Are we measuring AI capability all wrong? 🧵
Back in December 2025 at NeurIPS, an essential distinction was laid out by @enfleisig that is even more critical today as we push past standard LLMs: Benchmarks vs. Evaluations.
Most of the industry treats them as the same thing. They aren't. And conflating them is holding back true AI alignment and deployment.
Here is why this 2025 insight predicts exactly where AI development is struggling right now... 👇
SAIL Media retweeted
live from Tokyo:
Anthropic's first talk on Fable 5
from Dianne Penn, Anthropic's first PM (can't find her twitter)
We are thrilled to announce that @natolambert is joining Arcee as a Research Advisor.
Nathan’s work and thought leadership have been instrumental to the open model ecosystem, and his guidance comes at a critical time as open builders face growing pressure.
This is a major addition for Arcee and the American OS movement.
Nathan brings the conviction, taste, and technical depth this moment calls for.
Generative AI captured the world’s imagination, but Physical AI is about to capture the real economy.
While everyone is looking at chatbots, another revolution is moving silently through our streets. @PonyAI_tech discusses how autonomous driving isn't just a future concept anymore—it's already being commercialized worldwide.
Here is why Physical AI is the next trillion-dollar frontier 👇
SAIL Media retweeted
We have another 65 page frontier model report from Nvidia to read @eliebakouch @stochasticchasm and gang
SAIL Media retweeted
China just isn't that AGI-pilled, no matter how much we want (or need) them to be to justify what we want (or need) to build for ourselves
(wrote this more than two years ago)
open.substack.com/pub/interc…
So interesting Xi does not have generative AI on “main thrust for the next 5 years” top six technologies list, instead: “quantum technology, biomanufacturing, hydrogen energy and nuclear fusion energy, brain-computer interfaces, embodied intelligence, [and 6g]”
H/t @niubi for translation
SAIL Media retweeted
It's been a while! 4 nice additions to the open-weight local-LLM-on-consumer-hardware ecosystem:
SAIL Media retweeted
Climbing with no distillation, like the Big Boys do, has been super fun! Read the tech report for a taste of our ̶s̶u̶f̶f̶e̶r̶i̶n̶g̶ journey
Super excited to announce seven new world-class MAI models today. They represent what we consider a new era in AI designed to keep you in control and on the frontier.
First is our text foundation model, MAI-Thinking-1, exceptionally strong on reasoning and SWE tasks.
- It’s a 35B active parameter MoE with a 256K context window. Independent human raters on Surge prefer it for overall quality in blind side-by-sides versus Sonnet 4.6, and it’s achieved 97% on AIME 2025, the key measure of its general-purpose reasoning abilities.
- It's at 53% on SWE Bench Pro, placing it right alongside Opus 4.6 on one of the toughest coding benchmarks.
- And since we co-designed our models with our own silicon, MAI-Thinking-1 is optimized on our MAIA 200 chip. Benchmarking head-to-head against the GB200, we see 30% better performance per dollar as well as a 1.4x performance-per-watt gain when running our MAI models on the MAIA 200 end-to-end.
Next is MAI-Image-2.5 and its Flash variant. Two super strong models now at #2 on the leaderboards, surpassing the score of Nano Banana 2 on image editing.
Last for now is MAI-Code-1-Flash, our new inference efficient coding model, especially tuned for VS Code and GitHub Copilot CLI.
- Code-1-Flash achieves 51% on SWE Bench Pro, despite having just 5B parameters, putting it closer to Haiku in size but cheaper in cost.
All of this is the foundation for Microsoft Frontier Tuning. It lets you customize our models to create custom, company-specific agents that only you control. You can make our model, your model. Your data. Your agents. Your moat.
Early adopters are already seeing a difference. When we tuned our models for McKinsey’s tasks, MAI delivered the highest win rate, outperforming GPT-5.5 on quality, while being 10x lower on cost.
Also really excited to be collaborating with the amazing team at Mayo Clinic to jointly train a new frontier AI model for healthcare.
Our announcements today mark another milestone on the road to humanist superintelligence. You can learn more and about our other new models in our latest blog: microsoft.ai/news/building-a…
SAIL Media retweeted
My full talk on the future of AI & media is up!
I used @alexolegimas's prompt of "What will be scarce?" to propose 4 ways that media is changing, and how writers can still win in the AI age:
1) Secrets > summaries
Reporting is the act of taking private knowledge and making it public: when you get a source to tell you about corporate malfeasance, or venture to a remote town that few people have been to, or sneak your way into an underground party, you are working in a space where there is no training data.
2) Live interaction > static content
We’re not far from a world where AI can replicate any prose style. But readers want to know there's a real person generating the text—not just the final presentation, but the proof of work behind it. For creators, doing live events, podcasts, and meetups reveal the life behind the voice. And if I care about my ideas, I want people to know about them, no matter the format.
3) Founders > bureaucracies
AI is already allowing startups to run leaner by helping founders act as their own marketer, data scientist, engineer, etc. It's the same in media — AI is a boon to jacks-of-all-trades. There’s a lot of stuff AI does that I don't want to: verifying cites, reading contracts, negotiating speaking fees. It's an amazing time for independent creatives who want to direct their own vision.
4) Personal style > polish
The house style in most newsrooms is extremely LLMable. What stands out (besides reporting) is a distinct and authentic first-person voice, even if that means the occasional typo / provocation / admitting "I'm not really sure." After all, trust isn't about the perfect sentence: it’s about the track record of who says it. And the stronger your brand, the more trusted you’ll be.
I spend a lot of time covering the real disruptions AI brings. But I also believe, for those with the gumption to seize the opportunity, there's never been a better time to be a writer 🧡
How AI will change media: “The value of polish is going to go down and the value of personal charisma, style, and weirdness is going to go up,” says @jasminewsun
AI factories are on track to break the global power grid. ⚡️
In this clip from GTC, @vsiv explains how @EmeraldAi_ is solving the energy crisis by turning data centers into "flexible power users."
By dynamically scaling power consumption on demand, they are pulling off a massive triple-win:
- Allowing AI factories to scale faster
- Keeping local community energy bills low
- Keeping the electric grid stable
The future of AI isn't just about faster chips—it's about smarter energy.👇 Find the full conversation in the replies!
SAIL Media retweeted
My time at Ai2 / @allen_ai has come to an end.
Ai2 is a wonderful place. The last 2.5+ years building Olmo, Tulu, and other projects will be one of the peaks of my entire career. I'm extremely thankful for my teammates and the open community who made this work possible.
For me, it's time to try something different. I will still be working in the open model & open science spaces (more news on that soon). In the meantime I'll be spending a few months learning, chatting with a broader network, getting married (!!) and most importantly recharging from pouring my soul into this place.
I've attached the note I shared with the team and some fun photos from our time together. I'll keep cheering for Ai2 and am excited to see what you build next.
SAIL Media retweeted
🆕Grok Imagine’s Video Agent Moment: Cosmos, xAI, World Models, Generative UI, & the Codex Phase for Video!
latent.space/p/video-agents
@EthanHe_42, former @xai world model lead and @nvidia Cosmos researcher, explains why AI video may follow the same path as coding agents, how Grok Imagine went from zero to one, why text-to-video is only the autocomplete phase, how world models become real-time and interactive, why language models may become the control layer for video, and why the future of AI video may look less like a prompt box and more like an agent with a camera, editor, timeline, and tool belt.





































