Sainbayar Sukhbaatar retweeted
Muse Wonder is out, with strong performance. My team contributed to memory (& MemoryBench, listed), legal, financial, and various other agentic tasks @shehzaadzd @tesatory Jack Lanchantin @swarnaNLP & others!
Sainbayar Sukhbaatar retweeted
Claim: we've solved the AI slop problem (!) 💩🧹✨
Blog post: facebookresearch.github.io/R…
🧵1/5
Key idea: take *expert* human writing and learn rubrics that find the gap between experts and models. Train with those rubrics.
We train with RL-XAR (RL with eXpert Aligned Rubrics) & see large performance gains on writing scientific paper sections, Pulitzer prize novel continuations and high quality Wikipedia pages.
Sainbayar Sukhbaatar retweeted
Muse Spark 1.3 is out, with strong performance. My team contributed to its long context & IF abilities (@tesatory, @shehzaadzd, Jack Lanchantin) & coding ability (@ping_iris_yu, @EasonNie) amongst other things!
Sainbayar Sukhbaatar retweeted
💎Autodata: an agentic data scientist to create high quality data✨
We introduce a method for building agents that create high-quality training & evaluation data.
Key idea: agentic data creation provides a way to *convert increased inference compute into higher quality model training*.
We show how to train (meta-optimize) such a data scientist agent, so that it can create even stronger data.
Our initial study with a specific practical implementation, Agentic Self-Instruct, shows strong gains on scientific reasoning problems compared to classical synthetic dataset creation methods.
Overall, we believe this direction has the potential to change how we build AI data!
Read more in the blog post: facebookresearch.github.io/R…
Sainbayar Sukhbaatar retweeted
DeepSeek-V4 uses our Hash routing approach developed back in 2021 -- see screenshot of their tech report! (Looks like a great model, congrats!)
Bonus note: our same blogpost (& paper) back in 2021 also introduced 'looped transformers', but we called that staircase & ladder (see screenshot): parl.ai/projects/params_vs_c…
huggingface.co/deepseek-ai/D…
Sainbayar Sukhbaatar retweeted
Self-Improving Pretraining
We've updated our results given feedback:
- larger 8B baseline to match reward model size
- cross-task evals given different RM objectives
Overall, we see clear wins
We also have a postdoc position if that's what you are looking for
Our team in FAIR at Meta is hiring a postdoc researcher!
We work on the topics of Reasoning, Alignment and Memory/architectures (RAM).
Apply here: metacareers.com/profile/job_…
Location: NY, Seattle or Menlo Park.
Some of our recent work to give flavor:
Co-Improvement (position): arxiv.org/abs/2512.05356
SPICE (Self-Play in Corpus Environments): arxiv.org/abs/2510.24684
Self-Challenging Agents: arxiv.org/abs/2506.01716
RL from Human Interaction: arxiv.org/abs/2509.25137
AggLM (parallel aggregation): arxiv.org/abs/2509.06870
StepWiser (CoT-PRM RL): arxiv.org/abs/2508.19229
DARLING (diversity-trained RL): arxiv.org/abs/2509.02534
J1 (RL-trained LLM-as-Judge): arxiv.org/abs/2505.10320
CoT-Self-Instruct: arxiv.org/abs/2507.23751
Multi-Token Attention: arxiv.org/abs/2504.00927
Our team is hiring! If you like to work on cool research projects, please apply :)
Our team in FAIR at Meta is hiring a (full-time) researcher!
We work on the topics of Reasoning, Alignment and Memory/architectures (RAM) for self-improvement & co-improvement.
Apply here:
metacareers.com/profile/job_…
Location: NY, Seattle or Menlo Park.
Some of our recent work to give flavor:
Co-Improvement (position): arxiv.org/abs/2512.05356
SPICE (Self-Play in Corpus Environments): arxiv.org/abs/2510.24684
Self-Challenging Agents: arxiv.org/abs/2506.01716
RL from Human Interaction: arxiv.org/abs/2509.25137
AggLM (parallel aggregation): arxiv.org/abs/2509.06870
StepWiser (CoT-PRM RL): arxiv.org/abs/2508.19229
DARLING (diversity-trained RL): arxiv.org/abs/2509.02534
J1 (RL-trained LLM-as-Judge): arxiv.org/abs/2505.10320
CoT-Self-Instruct: arxiv.org/abs/2507.23751
Multi-Token Attention: arxiv.org/abs/2504.00927
Sainbayar Sukhbaatar retweeted
Our team in FAIR at Meta is hiring a postdoc researcher!
We work on the topics of Reasoning, Alignment and Memory/architectures (RAM).
Apply here: metacareers.com/profile/job_…
Location: NY, Seattle or Menlo Park.
Some of our recent work to give flavor:
Co-Improvement (position): arxiv.org/abs/2512.05356
SPICE (Self-Play in Corpus Environments): arxiv.org/abs/2510.24684
Self-Challenging Agents: arxiv.org/abs/2506.01716
RL from Human Interaction: arxiv.org/abs/2509.25137
AggLM (parallel aggregation): arxiv.org/abs/2509.06870
StepWiser (CoT-PRM RL): arxiv.org/abs/2508.19229
DARLING (diversity-trained RL): arxiv.org/abs/2509.02534
J1 (RL-trained LLM-as-Judge): arxiv.org/abs/2505.10320
CoT-Self-Instruct: arxiv.org/abs/2507.23751
Multi-Token Attention: arxiv.org/abs/2504.00927
If you are a PhD student in Berkeley or one of these universities, you can apply to our mentorship program and do research with us! The deadline is this Friday though linkedin.com/posts/adinawill…
Sainbayar Sukhbaatar retweeted
Our co-improvement position paper is now on arXiv!
(We've updated it, covering more existing work.)
📝: arxiv.org/abs/2512.05356
After >27 years of research, my first position paper!
Short 🧵 (1/5) follows 👇
Synopsis: it's about building AI that collaborates on AI research *with us* to solve AI faster, and to help fix the alignment problem together.
How? Build the AI with those collab skills (i.e., we create benchmarks! training data! methods! etc. for that).
I've been personally inspired by @Yoshua_Bengio's recent talks on safety & AI research, and also from seeing Nicholas Carlini's COLM keynote where he said we researchers can all do our bit to help (paraphrased). So – hope this helps! 🙏
Sainbayar Sukhbaatar retweeted
Holy shit… Meta might’ve just solved self-improving AI 🤯
Their new paper SPICE (Self-Play in Corpus Environments) basically turns a language model into its own teacher no humans, no labels, no datasets just the internet as its training ground.
Here’s the twist: one copy of the model becomes a Challenger that digs through real documents to create hard, fact-grounded reasoning problems. Another copy becomes the Reasoner, trying to solve them without access to the source.
They compete, learn, and evolve together an automatic curriculum with real-world grounding so it never collapses into hallucinations.
The results are nuts:
+9.1% on reasoning benchmarks with Qwen3-4B
+11.9% with OctoThinker-8B
and it beats every prior self-play method like R-Zero and Absolute Zero.
This flips the script on AI self-improvement.
Instead of looping on synthetic junk, SPICE grows by mining real knowledge a closed-loop system with open-world intelligence.
If this scales, we might be staring at the blueprint for autonomous, self-evolving reasoning models.
Sainbayar Sukhbaatar retweeted
🤝 New Position Paper !!👤🔄🤖
@j_foerst and I wrote a position piece on what we think is the path to safer superintelligence: co-improvement.
Everyone is focused on self-improving AI, but (1) we don't know how to do it yet, and (2) it might be misaligned with humans.
Co-improvement: instead, build AI that collaborates *with us* to solve AI faster, and to help fix the alignment problem together. More details in the paper!
Read it here:
📝:github.com/facebookresearch/…
Yes I remember this from 10 years ago. My answers were not that great because I didn't get any sleep from the excitement. But it's interesting there was a question about scaling attention in a sub-linear way, which still is an important question and not fully answered.
Sainbayar Sukhbaatar retweeted
🌶️SPICE: Self-Play in Corpus Environments🌶️
📝: arxiv.org/abs/2510.24684
- Challenger creates tasks based on *corpora*
- Reasoner solves them
- Both trained together ⚔️ -> automatic curriculum!
🔥 Outperforms standard (ungrounded) self-play
Grounding fixes hallucination & lack of diversity
🧵1/6
Sainbayar Sukhbaatar retweeted
Was super fun to organize this workshop!! Thanks everyone: speakers, panelists, audience.
facebookresearch.github.io/R…
Heading to COLM! Presenting two papers: Multi-Token Attention for augmenting softmax attention for more precision, and COCONUT 🥥 for continuous CoT reasoning. Oh also speaking at RAM2 🐏 workshop about memory 🧠
Sainbayar Sukhbaatar retweeted
🌀New Self-Driven RL Method: RESTRAIN 🌀
📝: arxiv.org/abs/2510.02172
- RESTRAIN turns spurious votes → self-Improving signals. No labels needed
- Does this through self-penalizing unreliable reasoning paths:
✔️ Uses all rollouts, not just the majority,
✔️ Offsets low-consistency rollout advantage,
✔️ Down-weights low-consensus prompts
📈 Results:
🔥 Beats existing techniques on both training-time (label-free) and test-time scaling — all without labels.
🔥 Nearly matches (and sometimes surpasses) gold-label RL
🧵(1/5)




















