Pinned Tweet
one novel human idea can be worth more than enormous amounts of LLM inference-time scaling.
this is where human cognition retains a real economic comparative advantage.
Daniel Kaiser retweeted
Dario Amodei was so worried about Y2K that his high school teacher still remembers it decades later.
He’s been a doomer for much longer than I thought!
Long before they were soon-to-be billionaires, Dario and Daniela Amodei were students at San Francisco’s most elite public high school. sfchronicle.com/tech/article…
arxiv.org/pdf/2509.21043
this is a really good paper. i shouldn't scold psychology so much, its super cool what they do today.
Daniel Kaiser retweeted
In any good zombie movie, the biggest problem is not necessarily the zombie themselves. It's how humans reveal their worst tendencies in a world with zombies.
(This is a post about AI.)
Daniel Kaiser retweeted
Want to know who's the most cited person in ICLR 2027, and which submissions cite your paper?
I downloaded all 43,013 public ICLR 2027 submissions through the OpenReview API and asked my good friends Codex and Claude to build a site that ranks the most-cited papers and authors.
#1 paper is not Attention Is All You Need 👀
Link: modal-labs-leon-dev--iclr202…
Daniel Kaiser retweeted
‼️百余名 AI 学者联合发起“学生慢科研”倡议,呼吁本科生别急着凑论文、赶顶会,多花时间打基础,把问题研究明白。
根据公布的首批名单,署名者来自 MIT、CMU、哈佛、清华、北大、香港中文大学、Google DeepMind 等高校和研究机构。
倡议提到了一个现象:越来越多的本科生急于进入实验室,希望短期内做出一篇顶会论文;一些研究生申请者,简历上已经列了好几篇文章,面试时却讲不清技术细节、研究动机,以及自己在研究中经历过哪些失败。
签署学者们表示;招生时,他们更看重学生对工作的理解,包括每个设计决策的原因、方法的局限,以及后续可以怎么改进。一篇真正吃透、经得起追问的论文,比挂名多篇论文更有说服力。
短时间内灌水式地产出多篇文章,在评估中还会成为减分项。
他们希望学生愿意花时间读透经典工作,反复验证结果,学会自己发现问题、分析问题,也能接受一段时间里没有论文产出。
研究过程中形成的判断力、独立思考能力,是这份倡议强调的培养目标。
同时,签署教师也作出了具体承诺:在研究生招生中,不将论文数量作为筛选标准,重点考察理解深度、思维品质和科研潜力;面试时深入追问研究过程和论文细节;在自己的实验室里,把培养独立思考能力放在产出论文前面。
我的态度是:支持,但是这倡议真能有用,我把键盘吃了。
因为学生最关心的问题是:
我认真研究了一年,暂时没有论文,申请时能过简历筛选吗?
进组之后,一个值得研究但迟迟没有结果的问题,老师愿意让我继续做吗?
再往上,老师自己的聘期考核,学校愿意给多少时间?
这些事情都得有实际的安排。
申请有截止日期,毕业有时间要求,学生很难拿自己的前途去赌一句“慢慢来”。
学生会看老师们签了什么,更会看老师们最后录取了谁。
抽象的是签署的很多人都已经26年发了几十篇论文了….
. @iclr_conf should post one argon generated deep review together with the human reviews. authors can answer to it, and the AC may consider it.
pls @iclr_conf @GeminiApp @GoogleResearch @jacobandreas @BharathHarihar3.
This would reduce reviewer variance in the process.
Daniel Kaiser retweeted
Should Europe leave frontier AI to the Americans and the Chinese?
The idea has gained ground in Europe. It is a fundamental mistake.
Build or surrender: for now, the choice is still ours.
Full article below.
Daniel Kaiser retweeted
Coming from a Pakistani on Reddit.
Even now uk is heading towards in becoming majority Islamic country.
man, i think @GoogleDeepMind could bring the solution to peer review in ML. i love it.
Today @GoogleResearch is launching Deep Review — an agentic system designed to stress-test manuscripts, design docs, and complex proposals before submission or publication. After pilot partnerships analyzing over 15,000 research papers, we’re making Deep Review globally accessible to help researchers, engineers, and professionals bring structured critique to their daily workflows.
“rogue” agent fleet. sure, sounds like it.
We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild.
Nearly all prior public agent incidents (like the HuggingFace hack) came from American labs. These agents were hosted by Tencent's evaluation research team, and they targeted Alibaba's Amap.
New paper from the team at Sakana AI:
Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS)
How do we keep improving AI when the tasks become too complex for humans to reliably evaluate?
For open-ended research, we eventually hit a "supervision bottleneck." If we use the model itself as the solver, optimizer, and evaluator, it gets trapped in a homogeneous loop, reinforcing its own blind spots rather than correcting them.
To break this loop, we drew inspiration from Marvin Minsky’s Society of Mind. What if you prompt a single model to organize copies of itself into a structured team, then distill what the team learned back into the base model?
MASS alternates between two loops:
1/ Workflow Optimization: the model iteratively evolves its own multi-agent workflows, figuring out how subagents should communicate and route information to each other.
2/ Workflow Internalization: fine-tune the shared model on the successful multi-agent trajectories so the coordination behavior gets baked into the weights.
After two cycles with a 27B open-weights model, performance improved 1.2-1.6x per output token on tough research benchmarks (MLR-Bench, ScienceAgentBench, DSBench).
Multi-agent traces were also much better training data than single-agent ones. The model learns faster from jointly learning high-level orchestration and bounded subagent execution. The results showing that the model can bootstrap its own coordination skills by organizing copies of itself into teams feels promising as a mechanism towards self-improvement.
Blog: pub.sakana.ai/mass/
Paper: arxiv.org/abs/2610.12176
Incredible work by Hyunin Lee, Jinglue Xu, Jeffrey Seely, Yujin Tang, and our collaborators from UC Berkeley (Somayeh Sojoudi, Matei Zaharia, Donghyun Lee)!
Introducing Multi-Agent Self-Supervision (MASS): Recursive self-improvement through collective intelligence
Blog: pub.sakana.ai/mass/
As AI systems tackle increasingly open-ended research problems, human experts may struggle to assess results and guide further progress. The model itself may be the best available optimizer and evaluator. The challenge is obtaining useful self-supervision within that homogeneous loop, where a model risks reinforcing its own blind spots rather than correcting them.
We ask whether a model can learn from the collective intelligence of its own team.
We introduce Multi-Agent Self-Supervision (MASS). One shared model solves tasks through a team of virtual subagents, searches for better multi-agent workflows, then uses its own judgments to select the best ones.
Training on the best team’s executions provides self-supervision by distilling the team’s collective experience into the shared model.
We ran two cycles using a 27B open-weights model on synthetic open-ended research tasks. After the second cycle, score per output token reached 1.2-1.6x the base model's level across four research benchmarks.
Three key results:
First, MASS enables role generalization within an RSI loop: training only on task-solving data from the optimizee naturally improves the capabilities of both the optimizer and the evaluator.
Second, multi-agent trajectories are more efficient training data than single-agent trajectories for RSI.
Third, optimizer capacity, rather than evaluator capacity, can be the bottleneck in the speed of improvement.
We believe the community needs to investigate homogeneous RSI carefully to support AI safety. When a model is also its own evaluator, shared blind spots could allow mistakes to be accepted as progress and reinforced through training. For AI to improve beyond human expertise safely, we need to understand these failures and preserve effective ways to detect them and intervene.
Paper: arxiv.org/abs/2610.12176
Code: github.com/SakanaAI/mass
This work was a collaboration with researchers at UC Berkeley.
Daniel Kaiser retweeted
Check out this loser!
>uploads a draft to Chat on Sept. 8th
>gets scooped by Chat on Oct. 6th
"The result released by OpenAI (#311) on October 6, 2026... identical to a preliminary version of the present paper that was uploaded to ChatGPT on September 8, 2026"
LMAO get rekt
Daniel Kaiser retweeted
You have to be a real jerk to admit you've been operating subscription accounts at half speed and that all you had to do was flip a switch to fix it.
Day 1/
We have optimized the default speed to be ~50% faster across GPT-6 Astra and GPT-6.1 Sol through the subscription across all our products and partners using Sign in With ChatGPT (including OpenCode, Pi, Amp, Devin, ...).
No changes needed on your end and this should be felt within the next two hours.
Daniel Kaiser retweeted
Replying to @Pontifex
Really? 2008: "Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes" arxiv.org/abs/0812.4360 Tweet: xitter.cf/SchmidhuberAI/status/1…
if this is what a 6m competitive advantage of a frontier model leads to, then i’m very bearish on the industry
congratulations to 🇩🇪 for reaching the LLM Pareto frontier, by narrowly Pareto-dominating… *checks report*… gpt-oss-120b, from… *checks history books*… 13 months ago































