Researcher @SakanaAILabs. Foundation model and user interface.

Joined August 2016
So Kuroki retweeted
Introducing Multi-Agent Self-Supervision (MASS): Recursive self-improvement through collective intelligence Blog: pub.sakana.ai/mass/ As AI systems tackle increasingly open-ended research problems, human experts may struggle to assess results and guide further progress. The model itself may be the best available optimizer and evaluator. The challenge is obtaining useful self-supervision within that homogeneous loop, where a model risks reinforcing its own blind spots rather than correcting them. We ask whether a model can learn from the collective intelligence of its own team. We introduce Multi-Agent Self-Supervision (MASS). One shared model solves tasks through a team of virtual subagents, searches for better multi-agent workflows, then uses its own judgments to select the best ones. Training on the best team’s executions provides self-supervision by distilling the team’s collective experience into the shared model. We ran two cycles using a 27B open-weights model on synthetic open-ended research tasks. After the second cycle, score per output token reached 1.2-1.6x the base model's level across four research benchmarks. Three key results: First, MASS enables role generalization within an RSI loop: training only on task-solving data from the optimizee naturally improves the capabilities of both the optimizer and the evaluator. Second, multi-agent trajectories are more efficient training data than single-agent trajectories for RSI. Third, optimizer capacity, rather than evaluator capacity, can be the bottleneck in the speed of improvement. We believe the community needs to investigate homogeneous RSI carefully to support AI safety. When a model is also its own evaluator, shared blind spots could allow mistakes to be accepted as progress and reinforced through training. For AI to improve beyond human expertise safely, we need to understand these failures and preserve effective ways to detect them and intervene. Paper: arxiv.org/abs/2610.12176 Code: github.com/SakanaAI/mass This work was a collaboration with researchers at UC Berkeley.
84
184
61
1,536
175,673
So Kuroki retweeted
New paper from the team at Sakana AI: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS) How do we keep improving AI when the tasks become too complex for humans to reliably evaluate? For open-ended research, we eventually hit a "supervision bottleneck." If we use the model itself as the solver, optimizer, and evaluator, it gets trapped in a homogeneous loop, reinforcing its own blind spots rather than correcting them. To break this loop, we drew inspiration from Marvin Minsky’s Society of Mind. What if you prompt a single model to organize copies of itself into a structured team, then distill what the team learned back into the base model? MASS alternates between two loops: 1/ Workflow Optimization: the model iteratively evolves its own multi-agent workflows, figuring out how subagents should communicate and route information to each other. 2/ Workflow Internalization: fine-tune the shared model on the successful multi-agent trajectories so the coordination behavior gets baked into the weights. After two cycles with a 27B open-weights model, performance improved 1.2-1.6x per output token on tough research benchmarks (MLR-Bench, ScienceAgentBench, DSBench). Multi-agent traces were also much better training data than single-agent ones. The model learns faster from jointly learning high-level orchestration and bounded subagent execution. The results showing that the model can bootstrap its own coordination skills by organizing copies of itself into teams feels promising as a mechanism towards self-improvement. Blog: pub.sakana.ai/mass/ Paper: arxiv.org/abs/2610.12176 Incredible work by Hyunin Lee, Jinglue Xu, Jeffrey Seely, Yujin Tang, and our collaborators from UC Berkeley (Somayeh Sojoudi, Matei Zaharia, Donghyun Lee)!
Introducing Multi-Agent Self-Supervision (MASS): Recursive self-improvement through collective intelligence Blog: pub.sakana.ai/mass/ As AI systems tackle increasingly open-ended research problems, human experts may struggle to assess results and guide further progress. The model itself may be the best available optimizer and evaluator. The challenge is obtaining useful self-supervision within that homogeneous loop, where a model risks reinforcing its own blind spots rather than correcting them. We ask whether a model can learn from the collective intelligence of its own team. We introduce Multi-Agent Self-Supervision (MASS). One shared model solves tasks through a team of virtual subagents, searches for better multi-agent workflows, then uses its own judgments to select the best ones. Training on the best team’s executions provides self-supervision by distilling the team’s collective experience into the shared model. We ran two cycles using a 27B open-weights model on synthetic open-ended research tasks. After the second cycle, score per output token reached 1.2-1.6x the base model's level across four research benchmarks. Three key results: First, MASS enables role generalization within an RSI loop: training only on task-solving data from the optimizee naturally improves the capabilities of both the optimizer and the evaluator. Second, multi-agent trajectories are more efficient training data than single-agent trajectories for RSI. Third, optimizer capacity, rather than evaluator capacity, can be the bottleneck in the speed of improvement. We believe the community needs to investigate homogeneous RSI carefully to support AI safety. When a model is also its own evaluator, shared blind spots could allow mistakes to be accepted as progress and reinforced through training. For AI to improve beyond human expertise safely, we need to understand these failures and preserve effective ways to detect them and intervene. Paper: arxiv.org/abs/2610.12176 Code: github.com/SakanaAI/mass This work was a collaboration with researchers at UC Berkeley.
96
248
23
1,761
94,055
So Kuroki retweeted
I just published an op-ed in @NikkeiAsia on why the future of AI belongs to the orchestrators. A school of fish does things no single fish can. The same is true for AI. I wrote about why the next phase of AI development won't necessarily be about building the largest models. As frontier scaling begins to slow, it will be about mastering orchestration. On collective intelligence, sovereign AI, and why constraint forces smarter architecture: asia.nikkei.com/opinion/the-… That is exactly what we are building here in Tokyo. 🐟
Sakana AI共同創業者・CEOのDavid Ha(@hardmaru)の寄稿が @NikkeiAsia に掲載されました。タイトルは「AIの未来はオーケストレーターにある」。 フロンティア企業が巨額の計算資源を投じ、モデルの巨大化で性能を伸ばし続ける競争が、いつまで続けられるのか。その限界が見え始めています。オープン なモデルとの差は数か月に縮まり、最先端モデルの推論コストは、それが支援するはずの人の時給を上回ることも珍しくありません。寄稿では、この状況を「一つのモデルがすべてを支配する」という発想の行き詰まりと捉え、その先の道筋を考えています。 Sakana AIという社名には、魚の群れのように、個々では成し得ないことを協調によって実現する「集合知」への期待を込めています。どのモデルにも強みと偏りがあります。だとすれば、価値はモデルの重みそのものから、複数のモデルを状況に応じて使い分け、まとめ上げる知能へと移っていくはずです。 ソブリンAIについても、同じ視点で論じています。「ソブリンティとは、国を閉ざすことではなく、サプライチェーンの強さである」。外部から切り離された純国産モデルを目指すのではなく、AIを国内で開発し、調整し、運用し続ける知見を持つこと。特定の一社に依存せず、世界中の資源を組み合わせられること。ある事業者がアクセスを止めても、別の経路で動き続けられること。そうした強靭さこそが主権だと考えています。 計算資源も電力も資本も、日本は潤沢ではありません。だからこそ、より賢く、より効率のよい仕組みを工夫するしかありません。その挑戦を、Sakana AIは日本から続けていきます。 全文(英語): asia.nikkei.com/opinion/the-… 🐟
31
26
2
183
25,018
So Kuroki retweeted
Introducing "Scaling In-Context Imitation Learning" (SAIL) to be presented at #IROS2026. This work is a collaboration between Sakana AI and the University of Tokyo. Blog: pub.sakana.ai/sail What does a robot need before it can tackle a new task? Teaching a robot something new usually starts with collecting demonstrations and training a policy. But foundation models have already learned from vast amounts of images, text, and robotics-related data. We wanted to see how much of that knowledge we could draw out for robot control without changing the model itself. Recent demonstrations suggest that GPT-6 Astra can operate physical robots alongside its general language and vision capabilities. Earlier work has also shown that LLMs/VLMs can generate entire sequences of robot movements from a few demonstrations. However, a foundation model does not necessarily produce a reliable robot trajectory in a single generation. Performance depends on the context provided, and a small error in a movement target can cause the entire task to fail. We propose SAIL, a method for more reliable VLM-based robot trajectory generation through test-time scaling. SAIL uses a policy VLM as a robot trajectory generator, conditioned on a few successful demonstrations. It tests the generated trajectory in a simulator and uses an evaluation VLM to review the resulting video and identify where progress stalled. The policy VLM then uses this feedback to revise the trajectory, with Monte Carlo tree search (MCTS) exploring alternatives while refining promising candidates. Only the selected trajectory is sent to the physical robot. Across six manipulation tasks in simulation, increasing the search budget from one candidate to 45 raised the average rate of finding a successful trajectory from 25% to 73%. We also evaluated SAIL on a physical robot. Our results suggest that robot trajectory generation can benefit from test-time scaling, with additional computation enabling the model to test and refine its proposed actions in simulation. We think there is more to learn about what existing models can do with this kind of feedback, and how far those improvements carry over to physical robots. Paper: arxiv.org/abs/2603.08269 🐟
17
51
10
305
44,587
We worked on SAIL, exploring test-time scaling for in-context imitation learning using VLMs as robot trajectory generators last year. We’ll be presenting the work at #IROS2026 on Tuesday afternoon.
Introducing "Scaling In-Context Imitation Learning" (SAIL) to be presented at #IROS2026. This work is a collaboration between Sakana AI and the University of Tokyo. Blog: pub.sakana.ai/sail What does a robot need before it can tackle a new task? Teaching a robot something new usually starts with collecting demonstrations and training a policy. But foundation models have already learned from vast amounts of images, text, and robotics-related data. We wanted to see how much of that knowledge we could draw out for robot control without changing the model itself. Recent demonstrations suggest that GPT-6 Astra can operate physical robots alongside its general language and vision capabilities. Earlier work has also shown that LLMs/VLMs can generate entire sequences of robot movements from a few demonstrations. However, a foundation model does not necessarily produce a reliable robot trajectory in a single generation. Performance depends on the context provided, and a small error in a movement target can cause the entire task to fail. We propose SAIL, a method for more reliable VLM-based robot trajectory generation through test-time scaling. SAIL uses a policy VLM as a robot trajectory generator, conditioned on a few successful demonstrations. It tests the generated trajectory in a simulator and uses an evaluation VLM to review the resulting video and identify where progress stalled. The policy VLM then uses this feedback to revise the trajectory, with Monte Carlo tree search (MCTS) exploring alternatives while refining promising candidates. Only the selected trajectory is sent to the physical robot. Across six manipulation tasks in simulation, increasing the search budget from one candidate to 45 raised the average rate of finding a successful trajectory from 25% to 73%. We also evaluated SAIL on a physical robot. Our results suggest that robot trajectory generation can benefit from test-time scaling, with additional computation enabling the model to test and refine its proposed actions in simulation. We think there is more to learn about what existing models can do with this kind of feedback, and how far those improvements carry over to physical robots. Paper: arxiv.org/abs/2603.08269 🐟
3
49
3,888
So Kuroki retweeted
Introducing PC-ALM, a local-learning alternative to backpropagation. Our method trains 1000-layer neural nets using only local dynamics, and without backprop. Blog: pub.sakana.ai/pc-alm/ Standard deep learning relies on backpropagation. The brain, however, cannot implement backpropagation, at least not exactly. How can a physical system, such as the brain, solve multilayer credit assignment without explicit use of backprop? We look for inspiration in two related fields: distributed optimization and NeuroAI. In NeuroAI, predictive coding asks each neuron activation to solve an energy-based inference problem instead of using a standard forward pass. That inference step can be implemented as energy-minimization dynamics on local prediction errors. This perspective -- each layer as a dynamical system -- has proven promising, but performance of predictive coding hasn't scaled well with depth. Credit signals at far ends of the network struggle to diffuse into internal layers. We turn to distributed optimization, generalizing predictive coding to use an augmented Lagrangian instead of energy. This motivation stems back to a classic 1988 paper by LeCun, showing that the Lagrange multipliers of a deep network can be identified with gradients of a supervised loss. The augmented Lagrangian then bridges LeCun's perspective to the standard predictive coding that is used in NeuroAI. We find that this new perspective yields a natural PC-like alternative to backpropagation, resulting in a method we call PC-ALM. PC-ALM differs from PC in that it introduces dual neurons (Lagrange multipliers) as part of the layer-local dynamics, resulting in each layer acting as a PI feedback control system to minimize local prediction errors. We find that PC-ALM is capable of propagating signals to seemingly arbitrary depth, especially in deep narrow networks where standard PC struggles to learn. Ultimately, our motivation here is to understand how distributed physical systems, such as the brain, can compute credit signals using only local coupling and local dynamics. PC-ALM may also inform deep learning in neuromorphic hardware, where dynamics are cheaper than on GPUs. Paper: arxiv.org/abs/2605.31022 Code: github.com/SakanaAI/pc-alm
69
397
102
2,925
454,366
So Kuroki retweeted
Introducing Fugu Max and Fugu Ultra v2: the next evolution of Sakana Fugu’s multi-agent orchestration system. Try: sakana.ai/fugu Blog: sakana.ai/fugu-max-release/ The frontier that actually matters is the Pareto frontier: capability on one axis, cost on the other. But the industry still treats it as a static menu of isolated models. Today we are resolving that with a dynamic architecture: Fugu Max expands the Pareto efficiency frontier. By orchestrating our largest pool of open-weights and specialized models to date, including NVIDIA Nemotron family, it dynamically routes tasks to the leanest capable model. Fugu Max delivers performance within striking distance of elite models at two to six times lower cost. Fugu Ultra v2 pushes the peak capability of orchestration higher than ever before. On Chartography, it outperforms Opus 5 and Fable 5. On DeepSWE, it outperforms models that cost three to five times more per token. Crucially, it does all of this without Fable 5, Fable 5.1, or GPT-6-Astra in its agent pool. The Fugu orchestration system evolved with model resiliency in mind. It does not rely on individual frontier models to deliver frontier output. By orchestrating a swappable pool of open and specialized models, it outperforms closed ecosystems while protecting users from vendor lock-in, API revocations, and sudden service cutoffs. Fugu Max expands the Pareto frontier outward. Fugu Ultra v2 pushes it upward. Orchestration does not force a choice between cost and capability. It advances both simultaneously.
78
181
75
1,041
373,526
So Kuroki retweeted
Sakana AIは、SCSK株式会社および住友商事株式会社と、AI活用による日本の産業変革と社会課題解決に向けた包括業務提携を締結しました。 sakana.ai/scsk-sc-partnershi… Sakana AIの技術力、SCSKの統合・実装力、そして住友商事の事業基盤を掛け合わせ、AIの社会実装を加速させます。
12
36
13
286
41,189
So Kuroki retweeted
Sakana AIリサーチサイエンティスト・菅沼雅徳のインタビューが9月8日の朝日小学生新聞に掲載されました。 リサーチャーの仕事内容や1日の流れ、生成AIの未来、小学生のAI活用法についてお話ししました。 機会をいただいた編集部のみなさまに感謝します。
3
17
1
120
15,651
So Kuroki retweeted
チームのLLM開発が本格化してきたので仲間を募集します! 人数を必要以上に増やさず、一人ひとりが大きな役割を担うチームを作っています。高い基礎力と知的好奇心、そして違った強みを持つメンバーが集まって、全体の目的に向かって高い主体性を持って動いています。そんなチームの一員になれます。 僕自身もこのチームでメンバーと仕事することが何より楽しいです。 LLM経験者はもちろん歓迎。未経験でも、しばらくLLMに人生をかけてみたいという気持ち、他分野での強みや実績、新しい領域を速く学べる基礎力がある人は是非と思ってます。
【採用情報】Member of Technical Staff (LLM Development) の募集を開始しました🐟 sakana.ai/careers/member-of-… Sakana Namazuを起点に拡大しているSakana AIのLLM開発を担うポジションです。下記のような挑戦が待っています。 ・事前学習から事後学習・評価まで、LLM開発の全工程に取り組むチーム に参加 ・LLM開発全体を見渡しながら、担当領域にオーナーシップを持ってリード ・Sakana AIのプロダクト・ソリューションとRSI研究の基盤となるLLMを開発 LLM開発の最前線で挑戦したい方、ぜひご応募ください🚀
4
43
3
258
57,129
So Kuroki retweeted
Sakana AIは、今月より一般社団法人AIロボット協会(AIRoA)の正会員になりました。 RSI Labの取り組みの一環として、@airoa_jpと協働しながら、世界モデルやPhysical AIの研究開発を進めていきます。 airoa.org/ja/members-ja/ 🐟
5
30
3
281
28,502
So Kuroki retweeted
🐟 Sakana Namazu API 公開 🐟 本日、Sakana AIは大規模言語モデル「Namazu」をアップデートし、API「Sakana Namazu(サカナ・ナマズ)」として提供を開始しました。 Sakana Namazu API: sakana.ai/namazu 🐟
48
294
113
1,522
353,032
So Kuroki retweeted
Announcing Fugu-Ultra v1.1 🐡 We’ve been thrilled by the reception to the Fugu model family. Thanks to everyone who tried it, shared feedback, and trusted Fugu with real work. Today, we’re releasing Fugu-Ultra v1.1 → sakana.ai/fugu Upgraded to incorporate the latest frontier models, resulting in stronger performance across every benchmark shown, including gains of up to 7.9 points over v1.0, with particularly strong results on ProgramBench and Terminal Bench 2.1. Fugu-Ultra v1.1 is more capable across coding, agentic tasks, and advanced reasoning, and available at the same price as Fugu-Ultra v1.0 The frontier keeps moving, and Fugu keeps getting better.
135
293
106
2,617
326,553
So Kuroki retweeted
Introducing Fugu-Cyber: an update to our Fugu orchestration model. It achieves state-of-the-art performance on real-world security benchmarks, matching cyber-focused frontier models like GPT-5.5-Cyber and Mythos Preview. sakana.ai/fugu-cyber-release 🐡
81
310
119
2,079
591,805
So Kuroki retweeted
東京・八芳園で開催された「NVIDIA Japan AI Ecosystem Reception」に、Sakana AI がブースを出展しました。 多くの方に足を運んでいただき、私たちの技術やプロダクトを直接お伝えする貴重な機会となりました。 お声がけくださった @NVIDIAJapan に、心より感謝申し上げます。
4
39
3
240
33,178
So Kuroki retweeted
数週間分の戦略リサーチを、数時間で。 あなたのVirtual CSOとして働く、Sakana Marlin。 最初のテーマを渡してみる: sakana.ai/marlin 🐟
15
21
9
214
51,718
So Kuroki retweeted
We’re Hiring: Software Engineer (R&D, Infrastructure and Platform Reliability) 🐟 sakana.ai/careers/infrastruc… Sakana Fugu, our Multi-Agent System as a Model, launched publicly last month and is growing fast. We’re hiring an engineer to keep Fugu fast, dependable, and cost-efficient at scale. ・GKE, Vertex AI & Terraform on GCP ・AWS services equivalent to GCP services are also appreciated ・Monitoring, incident response & on-call ・High autonomy, working closely with R&D and Product Based in Tokyo. If this sounds like you, we’d love to hear from you 🚀
7
18
4
134
24,060
“Feedback-to-Rubrics” xitter.cf/SakanaAILabs/status/20…
"Feedback-to-Rubrics: Can We Extract Expert Criteria from Inline Comments?" will be presented at the Workshop on Human-AI Co-Creativity: Advances, Opportunities, and Challenges on July 11 at #ICML2026 Paper: arxiv.org/abs/2605.29857 (Extended full-paper version) LLMs are increasingly used for writing and review support, but their usefulness depends on context-dependent criteria, such as expert preferences or organization-specific conventions, that are often tacit, undocumented, and difficult to elicit directly. We propose a problem setting for learning reusable natural-language rubrics from accumulated inline comments on artifacts such as human-written or LLM-generated drafts.
1
1
292
"How Small Can a Tandem Speech Front-End Be? Diagnosing Front-End Capacity with Layer Removal" will be presented at the Workshop on Machine Learning for Audio on July 10 at #ICML2026 Link: icml.cc/virtual/2026/77315 Recent tandem speech-to-speech (S2S) dialogue systems delegate knowledge and reasoning to a back-end LLM, leaving a front-end S2S transformer to handle low-latency spoken interaction. This raises a practical capacity question: how small can the front-end become, what performance is preserved, and how does its behavior change as layers are removed? To diagnose this, we randomly remove different numbers of layers from a KAME-style front-end transformer, fine-tune each variant on the same data, and evaluate on speech MT-Bench.
1
2
402