@rosemhendrix

robotics research at @allen_ai

rosehendrix.com
Joined June 2024
  • Tweets17
  • Following42
  • Followers96
5Media
And that's a wrap on a fantastic ICRA 2026! 🎉 Incredible run for MolmoBot — clean sweep on workshops, winning Best Paper at all three we entered: Synthetic Data for Robot Learning, Beyond Teleoperation, and VLA Pipelines. 🤖
1
5
2
28
5,283
more replies
Thanks to all the organizers and everyone who stopped by the poster sessions; I had excellent conversations all week. Oh and the gala might be the best I've ever been to. The imperial apartments and Spanish Riding School at the Hofburg?? I am ruined for all future galas 😭✨
1
3
219
MolmoB0T: allenai.github.io/MolmoBot/ RING: one-ring-policy.allen.ai/

MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation

MolmoBot uses large-scale simulation to enable zero-shot robot manipulation — without real-world or task-specific robot data.

allenai.github.io
2
145
Our paper MolmoB0T won top honor at the SDRL workshop today! Congrats to my co-authors @ab_deshpande, Maya, Snehal, @RanjayKrishna, @shahdhruv_ (plus others, you know how it goes), and we'll see you as well at the VLA Pipelines and Beyond Teleoperation workshops on Friday 🚀
7
25
1,918
Rose Hendrix retweeted
Abhay Deshpande
@ab_deshpandeMar 28
I had an "oh shit" moment the first time I ran pi0 - we're now in an era where you can just download a manipulation policy, put it on your robot, and watch things happen. By releasing MolmoBot, now I hope I can help others have their own "oh shit" moments!
Ai2
@allen_aiMar 27
MolmoBot, our open robotic manipulation suite trained entirely in simulation, now has code, training data, a data generation pipeline, & evals all available. This puts our robotics models within reach of any research lab—no extensive real-world data collection required. 🧵
6
16
1
89
16,868
Delighted to be releasing our entire system today in support of open robotics research! Now anyone can use MolmoBot, train on our data, or generate their own data to do zero-shot sim-to-real transfer on any robot. Check it out! allenai.github.io/MolmoBot/

MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation

MolmoBot uses large-scale simulation to enable zero-shot robot manipulation — without real-world or task-specific robot data.

allenai.github.io
Ai2
@allen_aiMar 27
MolmoBot, our open robotic manipulation suite trained entirely in simulation, now has code, training data, a data generation pipeline, & evals all available. This puts our robotics models within reach of any research lab—no extensive real-world data collection required. 🧵
2
6
22
4,487
One thing I'm proud of: we release unedited agent-view videos for every rollout in our real-world evaluation set. Not the most riveting viewing! But this kind of transparency helps people understand what policies actually can and can't do. I'd love to see more projects do this.
1
59
So proud to share MolmoBot! We trained static and mobile manipulation policies entirely in simulation—no real-world teleoperation needed—and they outperform models trained on proprietary data. 🧵
Ai2
@allen_aiMar 11
Today, a step forward in open robotics - our results show that sim-to-real zero shot transfer for manipulation is possible. MolmoBot is our open model suite for robotics, trained entirely in simulation on MolmoSpaces.🧵
1
1
9
639
more replies
We use no task-specific fine-tuning or real data at all and were able to evaluate zero-shot in diverse settings, including an external eval from our collaborators.
1
2
48
Everything is open: code, data, the whole pipeline. Can't wait to see what this unlocks in robotics research and what people build. Check it out! General: allenai.org/blog/molmobot Technical: allenai.org/blog/molmobot-ro… Code and data coming soon.

Ai2 introduces open, simulation-first stack for physical AI, achieving zero-shot transfer to real...

Introducing MolmoBot and MolmoSpaces, an open foundation for training real-world robots to advance science.

allenai.org
2
41
So proud to finally share MolmoSpaces with the world! We built this to enable true zero-shot benchmarking for embodied AI—with massive-scale environments to push generalization. Stay tuned for what this unlocks for policy training 🚀 Check it out at allenai.org/blog/molmospaces

MolmoSpaces, an open ecosystem for embodied AI | Ai2

MolmoSpaces is our new open platform for embodied AI that provides physics-grounded scenes, objects, and grasp annotations to train and evaluate generalist robotic policies.

allenai.org
Ai2
@allen_aiFeb 11
Introducing MolmoSpaces, a large-scale, fully open platform + benchmark for embodied AI research. 🤖 230k+ indoor scenes, 130k+ object models, & 42M annotated robotic grasps—all in one ecosystem.
1
86
How should a robot hold a water bottle? 🤔 That depends: is it opening it, or passing it to you? I’m excited to introduce GraspMolmo, a VLM that predicts semantically appropriate grasps based on your command! Website: abhaybd.github.io/GraspMolmo… 🧵 Thread ↓
3
23
3
71
10,647
I'm not making it out to ICRA this year, but come check out Jiaheng's excellent work with Ai2!
Jiaheng Hu@JiahengHu118 May 2025
Excited to be in ATL for #ICRA2025 to present 🔥FLaRe: fine-tuning large transformer policies with #RL, 15:25 Tuesday @ room 410! I will also be attending the 📷Doctoral Consortium on Monday to talk about my research on self-improving robots. Happy to meet old and new friends!
1
4
277
Rose Hendrix retweeted
Prior @ AI2@Ai2Prior25 Nov 2024
📢Applications are open for summer'25 internships at the PRIOR (computer vision) team @allen_ai: Come join us in building large-scale models for: 📸 Open-source Vision-Language Models 💻 Multimodal Web Agents 🤖 Embodied AI + Robotics 🌎 Planet Monitoring Apply by December 11, 2024!
1
13
5
47
11,866
Poster ID 61 in the #CoRL2024 4pm poster session, come talk to us about on-policy RL with transformers at scale for sim-to-real visual navigation!
Kuo-Hao Zeng@KuoHaoZeng8 Nov 2024
🚀 Quick Update 🚀 🎉 @ZCCZHANG will present PoliFormer at CoRL Oral Session 5 (🕤 9:30-10:30, Fri, Nov 8, CET)! 🎉 Meet us at Poster Session 4 (🕓 16:00-17:30) to chat with @ZCCZHANG, @rosemhendrix, and Jordi! 💻 Our code & checkpoints are NOW public: github.com/allenai/poliforme…

GitHub - allenai/PoliFormer: PoliFormer: Scaling On-Policy RL with Transformers Results in Master...

PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators - allenai/PoliFormer

github.com
1
4
431
Load more