
CS PhD student @Penn | @NSF Graduate Fellow | B.S. @CarnegieMellon 🤠
Philadelphia, Pennsylvania
Joined August 2020
- Tweets103
- Following449
- Followers235
- Likes138
Steffi Chern retweeted
🧪Can AI agents take a scientific paper and write a meaningful follow-up to it?
We introduce Into the Unknown, an AI agent benchmark of 15 open scientific research problems. Each problem comes from a scientist currently or formerly at US DOE National Labs:
@LosAlamosNatLab @SandiaLabs @BerkeleyLab @AmesNatLab @PPPLab @Livermore_Lab
Steffi Chern retweeted
1/9 🧵 🚨 New Paper accepted at #NeurIPS2026: PA Score
Should rewording change an LLM’s uncertainty? We tackle this through conformal score design.
📄 Paper: arxiv.org/abs/2610.04239
💻 Code: github.com/Raina-Xin/PA_Scor…
📖 Blog: raina-xin.github.io/research…
Steffi Chern retweeted
Video foundation models (e.g., Seedance 1.0 → 1.5 → 2.0; V-JEPA 1.0 → 2.0 → 2.1) keep getting stronger, while public descriptions of how their training data is built keep getting shorter.
⚒️ We built VidaForge, an open-source, five-stage video data pipeline that turns raw video collections into training-ready datasets.
In an academic lab, studying video data recipes begins with a lot of tedious engineering: handling broken videos and transcode failures, keeping large jobs resumable, tracking every clip, and packaging the result for training.
Across ingestion, segmentation, selection, annotation, and training dataset packaging, data moves through:
raw videos
→ standardized videos
→ clips
→ curated clips
→ annotated clips
→ training datasets
At every step, we can inspect what happened to each video or clip. This lets us see which samples changed under a data recipe and trace a training dataset back through the pipeline.
VidaForge currently connects processed data to two video foundation model pretraining paths: Wan video generation through NeMo-AutoModel, and self-supervised video representation learning through the official V-JEPA2 repository.
We ran VidaForge end to end on 200K videos, producing over 700K clips. From these clips, we built Selected-200K, Mixed-200K, and Rejected-200K datasets for Wan2.1-1.3B and V-JEPA2.1-1B pretraining.
In these early runs, the three datasets produced different training behavior: data selection appeared in Wan2.1-1.3B eval curves and V-JEPA2.1-1B training stability.
Pipeline, experiments, open data, and project resources in the thread below ↓
Steffi Chern retweeted
Before limited-releasing Claude Mythos Preview, we investigated its internal mechanisms with interpretability techniques. We found it exhibited notably sophisticated (and often unspoken) strategic thinking and situational awareness, at times in service of unwanted actions. (1/14)
Steffi Chern retweeted
Aha, thank you for the kind words! We’re exploring what “frontier lab” means in academia—through democratizing cognition and embracing “less is more” & “simple is powerful”.
Recent releases:
- agentic intelligence: davinci-dev, davinci-agency, davinci-env
- open foundation model: davinci-llm, davinci-magihuman
- data efficiency: (lima) limo, limr, limi
- benchmark: agencybench, researcherbench, innovatorbench ...
- data darwinism PartI, Part II
- interaction as Intelligence: Part I, Part II
- engineering: prompt engineering, cognition engineering, context engineering 2.0
More at:
scholar.google.com/citations…
Our North Star: Using AI technology to make life better for people around us.
Would love to exchange ideas if any of these interest you!
Steffi Chern retweeted
🚀 Seedance 2.0 虽强,但闭源!
兄弟们!现在来了完全开源的 daVinci-MagiHuman!
- 15B 单流 Transformer,从零训练
- 视频 + 音频联合生成,仅用 self-attention,无 cross-attention、无多流
- 单张 H100 就能 38 秒生成 5 秒 1080p 视频
- 人评胜率:80% 碾压 Ovi 1.1,60.9% 胜 LTX 2.3
- 支持 6 种语言(含中英日韩等),WER 仅 14.6%
速度源于极致简洁,质量却拉满!
由 @SII_GAIR × @SandAI_HQ 打造,Apache 2.0 全开源
这才是开源视频生成该有的样子!
论文 / 模型 / 代码 / Demo 已放出 👇
你准备试了吗?
Seedance 2.0 is impressive. But it's closed-source!
Introducing our daVinci-MagiHuman — a single-stream 15B Transformer trained from scratch that jointly generates video + audio. No cross-attention. No multi-stream branches. Just self-attention.
⚡ 5s 1080p video in 38s on a single H100
🏆 80% win rate vs Ovi 1.1 | 60.9% vs LTX 2.3 (2,000 human comparisons)
🌍 6 languages
📦 Fully open-source
Speed by simplicity.
By @SII_GAIR × @SandAI_HQ
📄 arxiv.org/abs/2603.21986
💻 github.com/GAIR-NLP/daVinci-…
🤗 huggingface.co/spaces/SII-GA…
Steffi Chern retweeted
Should data "evolve"? 🧬
Scaling is not enough. Model performance is bounded by data, but its value is defined by processing depth.
We introduce Data Darwinism, a 10-level hierarchy (L0-L9) redefining data as an eternal co-evolutionary process.(1/n)
huggingface.co/papers/2602.0…
𝗧𝗵𝗶𝗻𝗸 𝘄𝗶𝗱𝗲𝗿. 𝗧𝗵𝗶𝗻𝗸 𝘀𝗵𝗼𝗿𝘁𝗲𝗿.
🚀 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗠𝘂𝗹𝘁𝗶𝗽𝗹𝗲𝘅 𝗧𝗵𝗶𝗻𝗸𝗶𝗻𝗴: token-wise branch-and-merge reasoning for LLMs.
💸 Discrete CoT is costly.
🎛️ Existing continuous tokens often clash with 𝗼𝗻-𝗽𝗼𝗹𝗶𝗰𝘆 𝗥𝗟 𝗲𝘅𝗽𝗹𝗼𝗿𝗮𝘁𝗶𝗼𝗻.
🎥 𝗠𝘂𝗹𝘁𝗶𝗽𝗹𝗲𝘅 𝗧𝗵𝗶𝗻𝗸𝗶𝗻𝗴, a sampling-based continuous reasoning paradigm:
Steffi Chern retweeted
LiveTalk
Real-Time Multimodal Interactive Video Diffusion via Improved On-Policy Distillation
huggingface.co/papers/2512.2…
Steffi Chern retweeted
There are competing views on whether RL can genuinely improve base model's performance (e.g., pass@128). The answer is both yes and no, largely depending on the interplay between pre-training, mid-training, and RL. We trained a few hundreds of GPT-2 scale LMs on synthetic GSM-like reasoning data from scratch. Here are what we found: 🧵
Steffi Chern retweeted
Agents are killing it at coding, deep research, Q&A...But the next frontier? Seamlessly orchestrating multiple apps to solve tasks end2end in real states -- Toolathlon is just for this! So if you want to make agents truly useful in the beautiful mess of real work, don't miss it!
🚀We are excited to introduce the Tool Decathlon (Toolathlon), a benchmark for language agents on diverse, complex, and realistic tool use.
⭐️32 applications and 600+ tools based on real-world software environments
⭐️Execution-based, reliable evaluation
⭐️Realistic, covering daily and professional scenarios
Toolathlon reveals significant shortcomings of SOTA LLMs in realistic tool-use tasks, where Claude Sonnet 4.5 achieves 38.6% success rate. It also indicates a clear gap between open-source and leading proprietary models.
Check our blog: toolathlon.xyz/docs/blog/too…
Github: github.com/hkust-nlp/Toolath…
Paper: huggingface.co/papers/2510.2…
🧵⬇️
Steffi Chern retweeted
🔥 Announcing our new paper: "SR-Scientist: Scientific Equation Discovery With Agentic AI"
Most current work using LLMs for scientific discovery, like AlphaEvolve, follows a rigid "generate → evaluate → refine" loop. We challenge this paradigm for equation discovery.
Our work, SR-Scientist, empowers an LLM to act as an autonomous agent, discovering scientific equations through long-horizon, tool-driven data analysis and equation evaluation—much like a human scientist. We further enhance its capabilities with multi-turn RL.
📈 Key Results:
1️⃣Consistently outperforms SOTA methods by a 6% to 35% absolute margin.
2️⃣Achieves significant performance gains after RL training.
3️⃣Demonstrates robustness to noise and generalization to out-of-domain data.
💡 Key Insights:
1️⃣ Long-horizon exploration is vital for performance. 2️⃣ Enabling agents to conduct their own data analysis is crucial.
3️⃣ An experience buffer is key for continuous optimization.
📄 Paper: arxiv.org/abs/2510.11661
💻 Code: github.com/GAIR-NLP/SR-Scien…
Steffi Chern retweeted
The standard way to improve reasoning in LLMs is to train on long chains of thought.
But these traces are often brute-force and shallow.
Introducing RLAD, where models instead learn _reasoning abstractions_: concise textual strategies that guide structured exploration.
1/N🧵
Steffi Chern retweeted
1/9 🔥 NEW PAPER: "LIMI: Less is More for Agency"
The Age of AI Agency demands systems that don't just think, but work: vibe coding and automated research. We used just 78 samples to beat GPT-5 by 14.1% and discovered the Agency Efficiency Principle. See details below! 📊
Steffi Chern retweeted
Excited to STARFlow has been accepted at #NeurIPS2025 as a **Spotlight** paper!
Super excited and looking forward to seeing more research directions on scalable normalizing flows as an alternative to this existing diffusion world!🧐
Huge congrats to my amazing collaborators!!
I will be attending #CVPR2025 and presenting our latest research at Apple MLR! Specifically, I will present our highlight poster--world consistent video diffusion (cvpr.thecvf.com/virtual/2025…), and three workshop invited talks which includes our recent preprint ★STARFlow★! (0/n)
Steffi Chern retweeted
FacTool has been accepted to COLM 2025 - two years after its arXiv debut! While the landscape of LLMs has changed a lot since then, tool-augmented LLMs and RAG are still among the most effective and practical approaches for detecting / mitigating hallucinations (ref: xitter.cf/karpathy/status/173329…, xitter.cf/_jasonwei/status/18712…)
Reinforcement learning will push this even further. Imagine agents that almost never hallucinate - agents optimized to faithfully admit uncertainty, use external tools to cross-verify sources, recognize the limits of their knowledge, and resist sycophancy and lying. Crafting appropriate rewards & environments to train such agents still requires many effort (e.g., for scenarios with ambiguous facts or moral dilemmas), but effective progress can be anticipated!
In the era of 🤖#GenerativeAI, text of all forms can be generated by LLMs. How can we identify and rectify *factual errors* in the generated output?
We introduce FacTool, a framework for factuality detection in Generative AI.
Website: ethanc111.github.io/factool_… (1/n)
Steffi Chern retweeted
What Makes a Base Language Model Suitable for RL?
Rumors in the community say RL (i.e., RLVR) on LLMs is full of “mysteries”:
(1) Is the magic only happening on Qwen + Math?
(2) Does the "aha moment" only spark during math reasoning?
(3) Is evaluation hiding some tricky traps?
(4) Is RL’s calm surface all thanks to Pre/Mid-training carrying the weight?
Why does RL on LLaMA consistently underperform compared to Qwen?
What makes a base model truly ready for RL scaling?
What are the secrets under the hood?
Due to the cost of training from scratch, we conduct extensive controlled experiments with 20B-token mid-training, systematically investigating what really matters for RL success.
💡Key insights:
- High-quality math data is key to RL scaling.
- QA data helps, but it depends on task similarity.
- Instruction data boosts QA’s effectiveness.
- More mid-training improves RL performance.
Armed with these insights, we apply a two-stage (stable+decay) mid-training strategy on LLaMA, scaling up to 200B tokens—and RL performance on LLaMA now matches Qwen!
To support this, we introduce MegaMath-Web-Pro-Max, a high-quality math-centric pretraining corpus. The dataset will be released soon on Hugging Face—stay tuned! 📦 huggingface.co/datasets/Octo…
Full construction details are in the paper, we hope it’s useful! arxiv.org/abs/2506.20512v1
Getting SOTA with a strong foundation is great 🤩,
but understanding the foundation—the know-how—matters just as much.
Hope this analysis inspires the community—and feel free to cite us if it helps!
This work is impossible without all the brilliant co-authors @FaZhou_998 @xuefengli0301 @stefan_fee !!!
Steffi Chern retweeted
New Anthropic research: We elicit capabilities from pretrained models using no external supervision, often competitive or better than using human supervision.
Using this approach, we are able to train a Claude 3.5-based assistant that beats its human-supervised counterpart.
Steffi Chern retweeted
What if an LLM could update its own weights?
Meet SEAL🦭: a framework where LLMs generate their own training data (self-edits) to update their weights in response to new inputs.
Self-editing is learned via RL, using the updated model’s downstream performance as reward.
Steffi Chern retweeted
🧐When do LLMs admit their mistakes when they should know better?
In our new paper, we define this behavior as retraction: the model indicates that its generated answer was wrong.
LLMs can retract—but they rarely do.🤯
arxiv.org/abs/2505.16170
👇🧵







































