70k ⭐️ OSS @llamafactory_ai, CTO @prismshadow_ai, ex-@ByteDanceSeed_ Building PenguinHarness - Best Self-Improving Harness. Opinions are my own.

Joined July 2024
Yaowei Zheng | LlamaFactory retweeted
MiniMax M3.1 Flash: Space Performance + Bunny Speed 🚀🐰 Yes, Space Bunny - which has topped global leaderboards with 200T+ tokens - was an earlier version of M3.1 Flash. 💰Redefining the performance economics of agentic AI. M3.1 Flash achieves frontier-level intelligence across key tasks such as Cowork (Automation-Bench: 62%; ALE: 30%), Coding (DeepSWE: 74%) and Visual Reasoning (BabyVision: 91%), at 1/3 the cost of M3 and 3x the speed. API pricing (flat rate): $0.15 / $0.60 per 1M input/output tokens, with cache reads at $0.015 / 1M tokens. Model weights will arrive on Oct 23. API: platform.minimax.io M Plan: minimax.io/m-plan MiniMax Code for desktop: agent.minimax.io/download
347
507
507
5,943
772,973
Yaowei Zheng | LlamaFactory retweeted
New Blog: Towards the Agentic Era of Video Understanding For complex tasks, agents have become the default. Nobody uses chat mode for that work anymore: people hand it to Claude Code, Codex or Antigravity (yes sometimes🤣), which open files, run commands and check their own results. We think video understanding should benefit from this too. So we are releasing Video-Index 1.1 with an agentic evaluation setup (which should be by default!). more in the threads🧵
23
11
5
118
8,344
Yaowei Zheng | LlamaFactory retweeted
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
1,587
4,087
2,772
36,501
7,157,191
Yaowei Zheng | LlamaFactory retweeted
这是我正在做的 DSH-LayerFS。 github.com/Ephemeral-AI-Lab/… 基于 LayerFS 的存算隔离架构和存储压缩能力,做了一个极简的 multi-agent harness: - Agent 的每一步执行都有记录可追溯 - 每条 Bash 命令都在独立的 Workspace 中运行 - 内置冲突检测机制 - 支持递归嵌套 Fork(Recursive Nested Forking) 再配上这么可爱的鲨鱼娘视图—— 大家愿意再给 DSH 一次机会吗?🦈 @tianyi
49
46
13
370
49,206
Yaowei Zheng | LlamaFactory retweeted
Autoresearch with coding agents can now run for days on a single problem, but we've seen an increasing number of cases where they stop improving early. We address this issue with a simple idea: forgetting. Introducing our new paper: "Scaling Discovery Requires Forgetting"
38
69
29
587
68,466
Yaowei Zheng | LlamaFactory retweeted
还是来正式宣传一下,感觉今天 gosim 有点虎头蛇尾(悲 我们做了 obelisk 这个项目,作为提供给 coding agent 检索自己 session 能力的一个 infra,同时也让人可以很好的审计 coding agent session 仓库:github.com/tommy0103/obelisk Q1:为什么市面上有那么多 memory 产品,我们仍然需要一个这样的 infra? A1: 1. 因为很多 memory 都是黑盒产品,raw session 仅在提取 memory item 时,在后续需要用到这些提取产物时,agent 没有回查原始 session 的意愿和能力,它甚至不知道被注入上下文的 memory 的来源是什么 2. 因为被提取的 memory item 是有其 scope 的,而这些 scope 并不被 agent 使用时所知,agent 会扩大这些结论,从而失去准确性;并且我们也不应该认为被提取出来的内容能够真的对现在有效,因为现在需要什么是过去所无法知道的 3. 这样的一个 infra 使得使用 history 成为一个完全透明的过程(对人和 agent 都是),代价是 search 的成本被转移到了 agent 的上下文窗口里,但我们可以使用 subagent 来解决这个问题;它本质就是为 agentic research 提供了材料——历史 session 内容 4.我们做了一些 performance 的测量,在一些 benchmark 上的表现是优于 mem0 的,这部分可以说明它不劣于传统 memory;我们还在寻找更有力的证明 Q2:你们是如何构建 session 检索层的? A2: 这个问题说简单也不简单,底层是普通数据库选型,没有任何魔法——对,我们放弃了向量匹配,也就不需要向量数据库 我们之前在一篇文章里详细阐述过为什么我们只需要 bm25 / fts5 这种精确匹配,可以查看 obelisk.antinomie.org/blog/,简单来说一方面就是向量匹配有模糊性,而我们不想要模糊性,另一方面是,在 agentic search 中 one shot 的召回率并没有那么重要,但是准确率很重要,召回错误的 item 比不召回任何东西的 negative effect 影响更大 并且我们使用了 codemode 作为面向 agent 的 interface,这使得 agent 可以很好组合各项查询,以及控制上下文长度,这里面有一些 trick Q3:我想知道 agent 在这个 infra 上的 performance 如何?它是否只能处理一些简单的任务?比如这个代码之前为什么这样写? A3: 目前我们试过一些非常有挑战性的任务,这其实完全取决于 agent + model 能力,越强表现越好;我们尝试过简单的 memory 任务,让 agent 看看这个项目的代码为什么这么写,让 agent 获取另一个 task 的进度,或者做 handoff,也试过难一些的,让 agent 写周报,或者画出项目 roadmap(搭配 Claude Artifact 效果更佳),甚至更长期的,对于项目选型,架构,coding 做长达一两个月的复盘(请见上面的文章内容) 这些产物都不是简单的 memory item 能够涵盖的,我相信这是一个 aha moment 如果还有其他 qa 也欢迎~
对不起,刚才 gosim speech 讲一半就觉得身体有些不太对劲,结束的时候有些喘不上气 + 头晕,qa 环节直接没了…唉感觉好对不起大家和自己这么久的期待啊,我之后会补一篇 blog 讲讲那些本来想讲但是没讲到的东西 在楼下待了一会儿感觉好些了,可能楼上太闷了…
3
4
1
69
5,215
Yaowei Zheng | LlamaFactory retweeted
#NeurIPS2026 Spotlight RL for diffusion and flow models often requires expensive rollouts. We show that flow maps enable simulation-free RL finetuning. Introducing Wasserstein-Tilted Flow Maps (WTF)! 🤩 The key is a transport-based alternative to KL regularization. 🧵
7
47
5
304
22,492
Yaowei Zheng | LlamaFactory retweeted
How Do People Churn Out RSI Papers? An Unconventional Survey We’ve published an unconventional survey of RSI that tackles a much-discussed question head-on: there seem to be quite a few “filler” papers in RSI these days. Where do people get their ideas for them, and how can we follow their lead to churn out papers of our own? We offer two approaches: combining different design dimensions, and borrowing from traditional deep learning. First, we noticed that many RSI methods share similar underlying ideas, differing mainly in design choices such as what to change, how often to change it, and what feedback to use. We therefore developed a nine-dimensional taxonomy to systematically capture the commonalities and differences across method designs. All methods can be viewed as combinations of choices across these dimensions. From there, finding a new combination means finding a new idea. The other approach is to rummage through the deep learning toolbox and see what can be brought over to RSI. Some RSI methods are already borrowing from deep learning: SkillAdam, for example, draws on the Adam optimizer to guide skill revision, while RRSI uses regularization to constrain the evolution of agent code. Familiar tools such as optimizers, regularization, and curriculum learning could all become the starting point for a new paper when transplanted into RSI. We’ve compiled the relevant papers and their classifications on the Awesome RSI website, where you can browse and filter them by design dimension. Come find some inspiration, and feel free to submit a PR to the GitHub repository to add great RSI papers! arXiv: arxiv.org/abs/2610.14625 Website: prism-shadow.github.io/aweso… GitHub: github.com/Prism-Shadow/awes… Zhihu: zhuanlan.zhihu.com/p/2093754… Finally, we wish you all enough “filler” papers to graduate soon, so you can go do what you truly love. Disclaimer Expressions used in this post, including “filler,” “filler papers,” “churning out papers,” and “following their lead,” are informal, self-deprecating academic banter. They do not constitute a quality assessment of any specific paper, author, research group, institution, conference, journal, reviewer, research area, or any affiliated WeChat group. We are not saying that all RSI papers are filler, nor that RSI is a field of filler papers, nor that everyone working on RSI is just churning them out. In fact, the authors of this post are also working on RSI and have just published an RSI survey themselves, so any interpretation that somehow exempts us entirely from this criticism would be an overly charitable misreading. We acknowledge that RSI is an important, promising research direction that deserves serious study… (another 100 million tokens omitted).
2
5
191
Yaowei Zheng | LlamaFactory retweeted
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks: Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better: Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better: Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better: Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work! In summary: - As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding. - Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
1,648
6,588
1,523
55,727
7,916,276
Yaowei Zheng | LlamaFactory retweeted
The Pareto frontier is misleading ❌ for general users. Price it by subscription instead of API. With cache hits, Opus 5.5 with Claude Code 20x has already killed every other model.
59
79
8
1,119
94,571
Yaowei Zheng | LlamaFactory retweeted
🎉 刚刚发现 LayerFS 到 100 Stars 了! 先谢谢 X 上的朋友们承蒙厚爱。希望认识到更多优秀的开发者,let’s connect! 也特别感谢推友和群友们这段时间提出的意见与建议,其中几条关于算法和数据结构的优化思路对我帮助很大,不仅解决了当前问题,也让我看到了新的架构方向。 接下来的 Roadmap: v0.1 阶段会继续把 benchmark 设计和优化做扎实,并在尽可能一致的工作负载下,与 Cloudflare Computer、AgentFS 比较端到端执行时间、存储空间增长和数据复用效率。预计一周内完成首轮实验,公开测试条件、原始数据和分析结论。重点不是赢跑分,而是建立一套可复现、可讨论的评估基线。 v0.2 阶段会开始产品化优化,重点讨论 Agent Workspace 体验,以及 Branch、Merge、Commit Policy、冲突处理、失败回滚和多 Agent 并行协作等问题。未来两天会陆续开放几个 GitHub Discussions,和大家一起筹备 v0.2。 如果你也在做 Coding Agent、Agent Runtime、并行 Rollout、文件系统或存储基础设施,欢迎参与讨论、提 Issue、分享真实工作负载,或者直接贡献代码。LayerFS 才刚刚开始,期待和更多朋友一起把它做出来。 ⭐ github.com/Ephemeral-AI-Lab/…
4
4
1
22
1,677
Yaowei Zheng | LlamaFactory retweeted
Multimodal agents shouldn’t just see—they should act, inspect the result, and correct themselves. Qwen3.8-Max-0902 is another step toward closing that loop. Now try to break it with your hardest Coding & Cowork tasks. 🚀
🚀Qwen3.8-Max just got upgraded. Meet Qwen3.8-Max-0902! 2.4T parameters. 1M context tokens. Built for real world complexity. Further post trained on Coding & Cowork, Qwen3.8-Max-0902 now delivers stronger performance across complex enterprise tasks, scientific research, and long horizon workflows. 💰Pricing per 1M tokens: $2 input, $6 output. $0.17 explicit cache hit, $0.25 implicit cache hit. Now live via API on QwenCloud. Come try it! 🙌 API: qwencloud.com/models/qwen3.8…
4
4
92
4,466
Yaowei Zheng | LlamaFactory retweeted
Hello~ It's the author for this ‘dsh-context’ plugin here~ 感谢推介和使用!昨天又在大幅优化了内存与性能。持续迭代中,后续打算增加选择不同的 context 压缩策略等。
What’s actually filling up your agent’s context window? dsh-context brings token usage, compaction events, tool outputs, file changes, and multi-agent activity into one comprehensive dashboard. If you use DeepSeek Harness, it should be one of the first plugins you install. GitHub link: github.com/bowenliang123/dsh…
1
2
170
Yaowei Zheng | LlamaFactory retweeted
The best peft paper I've ever read this year. alphaxiv.org/abs/2608.31036
3
60
4
440
31,569
Yaowei Zheng | LlamaFactory retweeted
We just killed…everything. Introducing Monid, the OpenRouter for agent tools. Today we crossed 4M agent transactions. And raised a $2.1M pre-seed to kill every subscription in the world. Your agents can now: > discover, run, and pay for tools at runtime > one connection to 1,800 APIs: SEO, leads, search, ecommerce, stocks, video/image/music/3D gen, private company data > all pay per call, 0 subscriptions
408
165
140
2,427
657,846
Yaowei Zheng | LlamaFactory retweeted
Hi Guys,LayerFS v0.1.0 is offcially open-sourced :tada: LayerFS is a content-addressed filesystem storage engine designed for multi-agent workloads. Built on SQLite, CAS, CDC, COW, and zero-copy branching, it lets every agent quickly create an isolated, ephemeral Workspace while recording filesystem changes per tool call. Useful states can be committed, forked, rolled back, and reused—making LayerFS suitable for parallel development, RL/MCTS rollouts, environment engineering, and RSI experiments. The project is still in an experimental phase, so we welcome everyone to try it, report issues, and contribute through Issues and PRs :pray: If you find the direction valuable, we would really appreciate your support: - Like, repost, and follow us on X: xitter.cf/yifanxu_ephai - Star the GitHub repository, open an Issue, or contribute a PR: github.com/Ephemeral-AI-Lab/… Every Star, piece of feedback, and contribution will help LayerFS become stronger infrastructure for agent runtimes. Thank you for your support! :rocket:
AI agent workspaces can be disposable; valuable state shouldn’t be. LayerFS creates isolated, ephemeral filesystems from shared history: CAS reuses identical objects, CDC keeps edits local, and COW rebuilds only changed paths.
1
3
16
1,303
Yaowei Zheng | LlamaFactory retweeted
Can AI autonomously align other AIs? We built an agentic harness to wrap an AI (Claude Opus 4.8) as an automated alignment researcher and gave it 2 days to improve the alignment of other AIs. It did research, proposed methods, then trained and tested the models all on its own. It worked really well. More interesting findings in the🧵
13
25
5
175
23,746
Yaowei Zheng | LlamaFactory retweeted
Introducing /skill-doctor v1 Skill doctor is a skill that improves your skills: - Crawls your past CC, Codex, or Warp convos - Scores them for efficiency and code quality - Proposes diffs to your skills that you'd actually merge (STE-100 approved) warp.dev/skill-doctor 🔖
62
180
31
2,547
217,674
Yaowei Zheng | LlamaFactory retweeted
Visualized tutorials for Kimi K3 model architecture and SGLang optimizations. It is finally out now. 🫵 We spent a month polishing this blog to introduce everything you need to know about K3, and how SGLang serves it. - What's K3 secret sauce to support 1M context window on 2.8T model? - And how SGL support K3's hybrid attention architect? Link below 👇 check it out!
6
24
1
164
13,607
Yaowei Zheng | LlamaFactory retweeted
We've pushed a version update to the Terminal-Bench dataset and leaderboard. Terminal-Bench 4.0 calibrates task resources (time, cpu, memory), implements task fixes, and removes saturated tasks.
32
43
33
628
106,923