
Natural Language Processing research group at The University of Illinois Urbana-Champaign @IllinoisCS @UofIllinois
Joined July 2019
- Tweets668
- Following148
- Followers1.4K
- Likes1.5K
UIUC NLP retweeted
A year back, we had a very surprising finding. On-policy training causes sparse localized updates to a base model. Since then, there have been efforts to understand this systematically.
In our latest paper, we attribute this to a single property - The diagonal Fisher. Awesome work led by @yufanzh_
@haopeng_uiuc
UIUC NLP retweeted
What does it take to turn VLMs for cost-efficient zero-shot robot manipulation, without tools, without task-specific training, without external modules like VLA-as-tool or SAM3 or IK Solver ?
🤖 Introducing MotorMind !
💡 Zero-shot Manipulation: No Fine-tuning or Coding agent
💡 VLM-only: No external perception models, No tools, No VLA-as-tool, No IK-Solver
💡 Local Deployable: Qwen3.8-Next-Flash as backbone model for cost-efficient local deployment
💡 Strong Generalization: 83.3% success on LIBERO-PRO
💡 Real-Robot Transfer: 95% success on real-robot tasks without embodiment-specific training
Check out more:
📄 Paper: arxiv.org/pdf/2609.38078
🌐 Project: motor-mind.github.io/
💻 Code: github.com/Motor-Mind/MotorM…
Thrilled to see Microsoft Research feature this collaborative work! 🎉
Since its release, StudentSim has sparked interest across education, recommendation, healthcare, and finance.
This highlights the growing potential of user simulation as a foundation for personalized AI.
Grateful to Microsoft Research for featuring our work, StudentSim!
Since its release, we've been amazed by the attention it has received, not only from the education community, where professors have called it "the very first foundational work in this area" and shared that they'd envisioned this direction long before data and training made it possible, but also from researchers and project leads working on user simulation in recommender systems, healthcare, and financial services.
It's exciting to see a shared recognition of the importance and potential of user simulation for personalized AI services.
Hope StudentSim can be a useful stepping stone for the community!
UIUC NLP retweeted
Grateful to Microsoft Research for featuring our work, StudentSim!
Since its release, we've been amazed by the attention it has received, not only from the education community, where professors have called it "the very first foundational work in this area" and shared that they'd envisioned this direction long before data and training made it possible, but also from researchers and project leads working on user simulation in recommender systems, healthcare, and financial services.
It's exciting to see a shared recognition of the importance and potential of user simulation for personalized AI services.
Hope StudentSim can be a useful stepping stone for the community!
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics: msft.it/6013aS3JF
Congratulations to Nguyen! 🎊
Check out PSI-Bench! 👇
PSI-Bench won the best paper award at Social Simulation with LLMs workshop at @COLM_conf !
We introduce a framework for interpretable and clinically meaningful evaluation of depression patient simulators. Read more: arxiv.org/abs/2604.25840
We believe this is still not the final map of the area. But we are happy to see if it helps people find a question worth working on, or shows them where to disagree.
Proactive AI for Superintelligent Agents
In 1995, Wooldridge and Jennings listed proactiveness among the basic properties of intelligent agents.
31 years later, our agents can reason, code, and run complex workflows. Yet someone still has to notice the work and tell them to start.
We think this is a major gap.
1/7
It's easy to miss the problem when agents are judged on a task they've already been given.
A long open-ended project is different. Instructions are incomplete, plans fail, priorities change. Humans still decide what to investigate and when to change course.
That won't scale forever.
2/7
There's also a product shift underway.
Meta's Muse and OpenAI's dots both point toward proactive agents that keep track of goals, anticipate needs, and work beyond a single chat session.
We expect users to ask less often for individual tasks and more often for continuing progress.
3/7
Proactiveness isn't a new idea.
Relevant work spans agent theory, planning, HCI, robotics, ubiquitous computing, and LLM agents. Communities have developed different terms and benchmarks for related problems.
It's surprisingly hard to get a clear picture of the field.
4/7
We felt this was a good moment to put those threads together.
23 of us from UIUC, Google, Stanford, UC Berkeley, and CMU worked on a survey, with backgrounds spanning agents, robotics, retrieval, computational biology, and finance.
5/7
We tried to write it differently from a bibliography dump.
Chapters were drafted by people closest to the topic, then discussed and revised across backgrounds. When searching for papers is becoming cheap, the harder work is deciding which connections are meaningful.
6/7
The resulting survey organizes proactive agents around 6 capacities: awareness, anticipation, agenda formation, arbitration, action, and adaptation.
We also review evaluation at three levels and compare initiative with action authority across 13 domains.
7/7
We don't expect this to be the final map of the area. We'd be happy if it helps people find a question worth working on, or shows them where to disagree with us.
Proactive AI for Superintelligent Agents
empathyang.github.io/Proacti…
research.google/pubs/proacti…
#ai #agent #survey #uiuc #google #stanford #ucb #cmu
A must-read survey on Proactive AI Agents! 🚀 A timely collaboration from UIUC, Google, Stanford, UC Berkeley, and CMU. Check it out before it’s too late!
🤔 AI agents can do a lot once you give them a task. Can they also figure out what’s worth doing and get started before being asked?
🏫 That’s the question behind Proactive AI for Superintelligent Agents, our joint survey by researchers from UIUC, Google, Stanford, UC Berkeley, and CMU. Our backgrounds span AI agents, embodied AI, information retrieval, computational biology, economics, and finance.
🕵 As finding papers gets cheaper, we think a survey’s value increasingly comes from hard-earned research intuition: knowing what matters and what to try next. Contributors drafted the sections closest to their own research, then refined them through several rounds of discussion and revision across research backgrounds.
📃 Paper: empathyang.github.io/Proacti…
🌎 Website: empathyang.github.io/Proacti…
💼 Google Research: research.google/pubs/proacti…
More in the video below 👇
UIUC NLP retweeted
My amazing PhD mentor Cheng Qian (@qiancheng1231) is hosting the 2nd Workshop on Lifelong Agents @ COLM right now in Continental Ballroom #6!
Come join us and chat about everything related to agents! 🚀
#COLM #COLM2026 #Agents
UIUC NLP retweeted
🤔 AI agents can do a lot once you give them a task. Can they also figure out what’s worth doing and get started before being asked?
🏫 That’s the question behind Proactive AI for Superintelligent Agents, our joint survey by researchers from UIUC, Google, Stanford, UC Berkeley, and CMU. Our backgrounds span AI agents, embodied AI, information retrieval, computational biology, economics, and finance.
🕵 As finding papers gets cheaper, we think a survey’s value increasingly comes from hard-earned research intuition: knowing what matters and what to try next. Contributors drafted the sections closest to their own research, then refined them through several rounds of discussion and revision across research backgrounds.
📃 Paper: empathyang.github.io/Proacti…
🌎 Website: empathyang.github.io/Proacti…
💼 Google Research: research.google/pubs/proacti…
More in the video below 👇
UIUC NLP retweeted
👀 What if better visual reasoning isn't about more pixels or more vision encoders, but knowing WHICH visual representations to use?
Excited to introduce Mixture of Layers (MoL), our work at #NeurIPS2026! 🎉
🧵 Here's how we make vision encoders work smarter:
UIUC NLP retweeted
New paper, accepted to #COLM2026 🎉 (+ Outstanding Paper Award 🏆 at KnowFM @ ACL)
We present Emergent Unfaithfulness. When LLMs are asked to summarize a document, they silently rewrite the claims they disagree with, without telling the user or mentioning it in their CoT.
Why? 🧵
UIUC NLP retweeted
Excited to present PSI-Bench as a spotlight talk at Social Sim’26 workshop at @COLM_conf on Oct 9! Looking forward to interesting discussions 😁
This quoted post is unavailable.
UIUC NLP retweeted
Better agents may begin with better teachers.
A capable PhD student can lose days to scattered experiment logs and broken workflows. A good advisor identifies these bottlenecks and builds the support that lets the student focus on scientific judgment.
Our new work brings this idea to AI4AI: a Builder learns from a Target’s execution feedback to design better harnesses. We call these reusable lessons meta-skills. Both models’ weights stay frozen; what improves is how one AI supports another.
Check out our newest paper: Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI
📄 arxiv.org/abs/2609.38143
💻 github.com/qiancheng-apodex/…
UIUC NLP retweeted
Our work, “PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agents,” has been accepted for an oral presentation (5/134) at PALM @ NeurIPS 2026.
Paper: arxiv.org/abs/2603.03296
Code: github.com/TIMAN-group/PlugM…
UIUC NLP retweeted
Our multimodal creativity paper gets into NeurIPS 2026 this year! So excited to see you guys in Sydney and talk about ‘Agent Creativity’ this brand new topic!
We believe, even for today’s AI system, creativity is still the gap between human intelligence and agent intelligence.
Another of our recent work, CreativityBench, also gets to COLM 2026, so if you are interested in this line of topic, check them out!
✨ Creativity is not just recognizing what an object is — it is imagining what it could become.
🔧 A key edge can cut tape.
🛡️ A rubber pad can protect a wall.
🪮 A comb guard can clear a sink slot.
But can multimodal AI agents discover these hidden physical affordances from images?
🚀We introduce MM-CreativityBench, a benchmark designed to test whether LMMs can creatively repurpose everyday objects by interactively inspecting scenes, entities, and object parts.
🔍 Our findings show that today’s LMMs often identify the right object, but fail to ground their reasoning in the right part. They hallucinate properties, overlook physical constraints, or propose solutions that are not mechanically valid.
🧠 To move beyond plausible guesses, we propose affordance-grounded alignment: training models to explore visual evidence, reject hallucinated affordances, and reason from geometry, material, and mechanics.
📄 Paper: arxiv.org/pdf/2605.26396
🌐 Project: creativitybench.github.io/mm…
💻 Code: github.com/CreativityBench/M…
🤗 Hugging Face: huggingface.co/papers/2605.2…
UIUC NLP retweeted
Excited to share that our paper was accepted to #NeurIPS2026 E&D🎉
and stay tuned for our follow-up work that will be released soon! We present an approach for producing less homogeneous simulations that better preserve the population-level diversity of real users.
What happens when you compare the distributions of real and simulated user behaviors?
🔍 The gap is large.
We introduce a method to measure this gap and evaluate 24 LLM-based user simulators across coding and writing tasks.
@convai_uiuc @MSFTResearch @berkeley_ai
🧵 1/N
UIUC NLP retweeted
Excited to share one of the UIUC ConvAI papers that was accepted to NeurIPS 2026! 🎉
Is it safe to launch LLM-based applications? Our work shows that LLMs can be trained to persuade other LLMs, demonstrating their vulnerability to adversarial persuasive attacks.
Congrats to @nbbozdag and @emrecanacikgoz on this great work!
UIUC NLP retweeted
NeurIPS 2026 Paper Acceptance ⭐️
UIUC × Adobe Research
Agents are now expected to run for hours. Yet LLMs still lose track of their instructions within a few dozen turns.
We know that models get lost in long conversations. We wanted to know why, so we looked under the hood. We found that the model doesn't forget the goal. It stops looking at it. 🧵
UIUC NLP retweeted
Excited to share that our paper, “Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs,” has been accepted to NeurIPS 2026! 🎉
UIUC NLP retweeted
This paper is accepted at NeuRIPS 2026 now
🚨 New preprint: "Variance-Aware Systematic Resampling for Reward-Guided Diffusion"
TL;DR: We identify the cause of lineage collapse in SMC samplers to be high variance in the sampling process, and provide a principled fix.
SMC-based diffusion samplers maintain a population of particles to approximate the reward-tilted distribution — but multinomial resampling introduces O(K) offspring-count variance per particle, causing a few high-reward trajectories to dominate within steps and collapsing lineage diversity irreversibly. We identify two distinct sources of variance driving this collapse, derive principled fixes for each, and combine them into VASR — yielding 26% better FID, 1.5× more lineages preserved, and 66× faster inference than MCTS-based methods, all training-free.
🧵 [1/n]

































