Ph.D. Student @uwcse @uw_robotics

Washington, USA
Joined August 2022
Entong Su retweeted
Can we make dexterous robots compliant without sacrificing precise control? Excited to introduce FOMO-Dex: Force-Modulated Dexterity! 🖐️ FOMO-Dex brings force-aware compliance to dexterous teleoperation, enabling robots to pick up thin cards and chips 🃏, cut paper 🔪, turn nuts 🔩, and use screwdrivers 🪛. These force-aware demonstrations also train better autonomous policies! 🎥 Videos & paper: yingyuan0414.github.io/fomo-… 🧵👇 (1/8)
11
40
4
163
12,996
🤖 The RoboEval Diagnostic Bimanual Challenge is live! Track 2 at the #CoRL2026 workshop "From GPU-Accelerated Simulation to Scalable and Generalizable Real Robot Policy Learning". Scored on behavior, not just success. ⏰ Deadline: Nov 1 (AoE) robo-eval.github.io/challeng…
3
8
3
43
7,382
What does RL learn from 10 assembly tasks in a row, with sparse reward only at the very end of all 10 tasks? Traditionally, absolutely nothing! That’s 1,125 actions over 45 seconds. Even if a random policy somehow nails each task 1% of the time, chaining all 10 happens with probability 10⁻²⁰. Worse odds than winning Powerball twice in a row. Excited to share AlphaNIST, a single policy which achieves 98.2% success rate across all tasks, and is able to solve 10 assemblies in a row under sparse reward! Check out our website: alpha-nist.github.io. More details in @octi_zhang ‘s thread, and some extra comments of my own below! 🧵
(1/6) From @GoogleDeepmind’s AlphaGo to AlphaZero, we saw machines find moves that reached beyond what we’d imagined for them. No one taught them those strategies. They emerged from reinforcement learning: playing, failing, and trying again under a single binary task reward for success or failure. Inspired by them, we couldn’t help but wonder: what might a robot discover if we gave it that same freedom to learn? That question led us to AlphaNIST. Starting tabula rasa, with that same binary reward plus only a simple control cost, a single policy solves all 20 @NIST assembly tasks at a 98.2% success rate in simulation. More surprising still, AlphaNIST can complete 10 different tasks in a row, receiving that reward only once, after all 10 are done. Just as AlphaGo’s strategies surprised its creators, AlphaNIST discovered dexterous strategies we couldn’t have come up with ourselves. Paper: arxiv.org/abs/2610.13354 Website: alpha-nist.github.io
7
14
2
158
8,657
Can we scale robot learning without scaling human labor? 📈 Demonstrations, resets, failure recovery, constant supervision—collecting robot data still takes substantial human effort. 🔑 Three keys let agents take on more of the work: 1. Real2Sim2Real: Agents explore and learn in digital twins, where trial and error is safer and cheaper. 2. Autonomous Recovery: Robots learn to recover from unexpected failures instead of waiting for human resets. 3. Human-on-Demand Learning: Multiple robots run in parallel, and humans step in only when autonomous recovery falls short. 🥑 Recova brings these together to get more robot learning out of every hour of human effort. research.nvidia.com/labs/gea… Joint work with @anjjei, Johan Bjorck, @ZhidingYu, @yin_hongxu, @jankautz, @DrJimFan, @yukez, and @Sifei30488L. 👇 Here's how it works 🧵
5
31
10
157
16,093
Entong Su retweeted
This is the most impressive result I’ve seen in my PhD. One policy, trained from scratch, solves all 20 NIST assembly tasks. It can even complete 10 tasks in a row, with a single binary reward only after all 10 are done. @octi_zhang combined diverse resets from OmniReset, task sampling from SGS, and multi-task training to unlock finer dexterity and longer horizons. No extra GPUs needed: one run on the same hardware replaces 20 specialist runs. Videos and details: alpha-nist.github.io Proud to be part of this incredible work! More in his thread 👇
(1/6) From @GoogleDeepmind’s AlphaGo to AlphaZero, we saw machines find moves that reached beyond what we’d imagined for them. No one taught them those strategies. They emerged from reinforcement learning: playing, failing, and trying again under a single binary task reward for success or failure. Inspired by them, we couldn’t help but wonder: what might a robot discover if we gave it that same freedom to learn? That question led us to AlphaNIST. Starting tabula rasa, with that same binary reward plus only a simple control cost, a single policy solves all 20 @NIST assembly tasks at a 98.2% success rate in simulation. More surprising still, AlphaNIST can complete 10 different tasks in a row, receiving that reward only once, after all 10 are done. Just as AlphaGo’s strategies surprised its creators, AlphaNIST discovered dexterous strategies we couldn’t have come up with ourselves. Paper: arxiv.org/abs/2610.13354 Website: alpha-nist.github.io
18
59
4
888
42,786
Entong Su retweeted
GPT-6 Astra unlocks a whole new level of simulation scaling! It generates diverse environments, designs and solves tasks, and deploys seamlessly across embodiments. Below: 25 unique environments, 25 multi-step tasks, and 5 robot embodiments generated in under 24 hours with just 3 generic prompts! 🧵
6
14
5
120
9,819
Entong Su retweeted
(1/6) From @GoogleDeepmind’s AlphaGo to AlphaZero, we saw machines find moves that reached beyond what we’d imagined for them. No one taught them those strategies. They emerged from reinforcement learning: playing, failing, and trying again under a single binary task reward for success or failure. Inspired by them, we couldn’t help but wonder: what might a robot discover if we gave it that same freedom to learn? That question led us to AlphaNIST. Starting tabula rasa, with that same binary reward plus only a simple control cost, a single policy solves all 20 @NIST assembly tasks at a 98.2% success rate in simulation. More surprising still, AlphaNIST can complete 10 different tasks in a row, receiving that reward only once, after all 10 are done. Just as AlphaGo’s strategies surprised its creators, AlphaNIST discovered dexterous strategies we couldn’t have come up with ourselves. Paper: arxiv.org/abs/2610.13354 Website: alpha-nist.github.io
65
333
121
2,662
407,602
(1/N) Who says you can't do contact-rich, precise manipulation with sim-to-real RL? No demonstrations, no retargeting, no tactile sensors, no crazy reward tuning. Just 1x, reactive policies trained with scaled up RL. Excited to finally release Success-Guided Sampling (SGS)! More info in @octi_zhang's thread and more thoughts of my own below! 🧵 Website here: sgs-rl.github.io
(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before. The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices. Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL. No demonstrations, no per-task reward tuning. Just PPO at scale. Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈
12
40
12
320
33,903
Entong Su retweeted
Humanoid fighting looks easy. Humanoid catching is hard. You have ~1 second to perceive, predict, and move your whole body to act. Meet Reflex: our framework for catching human-thrown boxes on a @UnitreeRobotics G1 using onboard RGB-D. Thread 👇
17
27
18
230
43,197
Entong Su retweeted
(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before. The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices. Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL. No demonstrations, no per-task reward tuning. Just PPO at scale. Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈
43
184
69
1,072
202,833
Entong Su retweeted
VLAs? WAMs? Are language and video models the right foundations for robotics? Introducing Grounded Action Model (GAM): a new paradigm that builds robot foundation models on top of a pretrained 3D grounding model. Ground first. Then learn to act. 🧵👇
7
44
8
429
692,392
Entong Su retweeted
🚀 Looking for a reliable Franka controller with seamless sim-to-real transfer? Meet FrankaTwin: github.com/tsrobcvai/frankat… 🎮 Joint/Cartesian position & impedance + gripper 🎯 System ID: 3.6 mm EE / 28 mrad joint RMSE (sim vs. real)
2
7
2
57
13,106
Entong Su retweeted
Are you training your VLAs or WAMs correctly? Your action expert may be learning vision–action shortcuts that undermine generalization beyond the training distribution. Introducing Latent Interface Training (LIT 🔥): Learn to act first, then learn how to use vision. 🧵👇
7
21
3
211
18,646
Entong Su retweeted
🤖 World Action Models predict the future to act better. However, WAM research remains fragmented in code, ad hoc in design, and unprincipled at scale. 💡 Today, we release 𝗢𝗽𝗲𝗻𝗪𝗔𝗠: 𝗔𝗻 𝗢𝗽𝗲𝗻, 𝗠𝗼𝗱𝘂𝗹𝗮𝗿 𝗘𝘅𝗽𝗹𝗼𝗿𝗮𝘁𝗶𝗼𝗻 𝗧𝗼𝘄𝗮𝗿𝗱𝘀 𝗦𝘆𝘀𝘁𝗲𝗺𝗮𝘁𝗶𝗰 𝗪𝗼𝗿𝗹𝗱–𝗔𝗰𝘁𝗶𝗼𝗻 𝗠𝗼𝗱𝗲𝗹 𝗣𝗿𝗲𝘁𝗿𝗮𝗶𝗻𝗶𝗻𝗴 to change this. 🌐 openwam-official.github.io/ 🧵1/14
7
40
8
273
2,267,175
Entong Su retweeted
After coming back to Singapore, I’m convinced we have all the ingredients to become a global leader in Embodied AI: world-class talent, a growing industry, strong resources, strategic advantages, and most importantly, the ambition to make it happen. My group at NUS is looking for highly motivated students at all levels: magiclab-nus.github.io
16
34
4
483
37,143
Manipulation ultimately comes down to force, and human-to-robot motion retargeting could also be force-aware. We present ReForce, a force-aware retargeting method that can reproduce human-demonstrated forces. It enables interesting demos like controlling a spring 🌀 with different force levels, matching fingertip contacts 👉, and wiping a board with human-like force 🧽. Check out our paper to see more: wuyuhang-eai.github.io/refor…
Can robots reproduce contact force—not just human motion? Introducing ReForce: force-aware retargeting that turns dexterous human motion + force into robot actions with live tactile feedback. 🌐 website: wuyuhang-eai.github.io/refor… | 📄 paper: wuyuhang-eai.github.io/refor…
3
6
1
58
8,985
Robot WAMs typically predict future RGB latents trained for pixel reconstruction...but why stop there? We propose Flex-π, a WAM that jointly denoises multiple visual streams jointly, enabling the WAM to inherit strong 3D, object-centric, AND spatio-temporal priors for action generation. It's more demo-efficient than WAM and VLA baselines and can infer faster than π0.5. (1/3)
Are VLAs dead? No, and you don't have to choose between VLAs and WAMs. Introducing Flex-π: a multi-stream world-action model (WAM) that jointly predicts future RGB, 3D pointmaps and DINO semantics with actions in training, then deploys as a VLA, a full WAM, or anything in between — all from a single checkpoint. Website: flex-pi.github.io/
5
23
1
159
27,145
Entong Su retweeted
Are VLAs dead? No, and you don't have to choose between VLAs and WAMs. Introducing Flex-π: a multi-stream world-action model (WAM) that jointly predicts future RGB, 3D pointmaps and DINO semantics with actions in training, then deploys as a VLA, a full WAM, or anything in between — all from a single checkpoint. Website: flex-pi.github.io/
8
71
16
605
119,996
Children learn to walk by falling. Robots fail too—but we usually throw those failures away. Yet failed rollouts tell us something successful demonstrations cannot: what bad actions actually lead to. So, can robots learn from their failures too? Introducing FACT: Failure-Aware Causal Training for World-Action Models. 🔗website: fact-wam.github.io/ 📄arxiv: arxiv.org/abs/2608.10232 💻 code: github.com/Bariona/FACT
15
40
9
320
75,987
Entong Su retweeted
VLAs can do a lot zero-shot. But when one fails, there's no way to tell it what went wrong - you collect more demos and retrain. What if you could just say something? Introducing ARCHITECT 🤖👷: a robot coding agent that synthesizes policies from free-form language instructions. robo-architect.github.io/ 🧵1/N
10
31
3
128
16,714