Joined May 2018
Yurong You retweeted
What if AI could improve not only its own policies, but also the judges that evaluate them? As AI policies improve, they encounter new challenges and develop new failure modes. The judges evaluating them need to evolve as well. Otherwise, they can become a bottleneck to further progress. This is particularly relevant for #Physical #AI, where good decisions require spatial grounding, causal reasoning, and safety awareness. In our new paper, we introduce VeriFine, an #agentic #harness for continuous self-improvement in Physical AI, where policies, training curricula, and judges evolve together. The idea is to build agentic systems that can identify policy failures, turn them into useful training signals, and improve the policy. When the judge itself becomes a bottleneck, the harness brings in targeted human feedback to refine its evaluations and guide the next round of improvement. We evaluate VeriFine on autonomous driving and robot navigation, demonstrating continued improvements in both policy and judge capabilities through reinforcement learning and supervised fine-tuning. Key takeaway: We're developing agentic harnesses that go beyond optimizing a policy in a fixed loop. They adapt the improvement process itself—including how failures are identified, how training data is selected, and how progress is evaluated. 📄 Paper: arxiv.org/pdf/2610.08761 🌐 Website: veri-fine.github.io/ Work led by Zewei Zhou, in collaboration with Rachel Luo Yulong Cao @ChaoweiX Chensheng Peng @Boyiliee @tianran_ Zheng Lian @yan_wang_9 Jiaqi Ma @iamborisi @wenhaoding95 #PhysicalAI #Robotics #AgenticAI #Alpamayo @NVIDIADRIVE @NVIDIAAI
4
11
71
3,053
Yurong You retweeted
New #NVIDIA paper: what if robots never had to wait for their own thoughts? TacitVLA learns to reason in chain-of-thought or subtasks, but its actions never read them. → Keeps the gains of reasoning at up to 3.4× lower latency on 4 benchmarks, and tops RoboMME and RMBench 🧵👇
11
30
5
110
5,265
Yurong You retweeted
We are hiring! The Autonomous Systems and Physical AI Research (ASPIRE: research.nvidia.com/labs/asp…) group at @nvidia is looking for talented PhD Research Interns to join us in advancing the frontiers of #autonomous #systems and #Physical #AI. We work across a broad range of research areas, including #reasoning models, generative simulation, #agentic AI workflows, and Physical AI #safety, with applications spanning autonomous vehicles and a broad range of Physical AI systems. Interested in pushing the limits of what’s possible? Apply now: nvidia.wd5.myworkdayjobs.com…
12
25
5
229
66,977
Yurong You retweeted
We have just released #Alpamayo 2 Super — @nvidia’s frontier open reasoning model for #autonomous #vehicles. NVIDIA Alpamayo 2 Super is an open 34-billion-parameter #reasoning vision-language-action (#VLA) model designed to accelerate autonomous vehicle (AV) development. It combines the 32-billion-parameter NVIDIA #Cosmos 3 Super Reasoner with a 2-billion-parameter diffusion-based Action Expert and is post-trained with #reinforcement #learning. Two aspects make Alpamayo 2 Super particularly exciting: 1. Open and commercially deployable: Alpamayo 2 Super is available on Hugging Face under OpenMDW-1.1, the Linux Foundation’s permissive license for open AI model distribution. The OpenMDW license is now being applied across the entire Alpamayo model family, enabling developers to deploy these models commercially without requiring additional permissions. 2. A multi-task foundation model for autonomous driving: Alpamayo 2 Super produces five tightly coupled outputs: - A trajectory describing the vehicle’s planned path. - A chain-of-causation (CoC) trace explaining the reasoning behind each driving decision, achieving benchmark-leading reasoning performance at frontier scale. - A meta-action (e.g., yield, lane change, stop) capturing the model’s intent. - Reasoning auto-labels that generate CoC annotations for training and validation data. - Visual question answering responses with 2D visual grounding, linking answers to specific regions in camera images. These multi-task capabilities enable developers to leverage a single foundation model across more of the development process, simplifying tooling and accelerating iteration. Resources: 🔹 Interview: youtube.com/watch?v=VeYZ-MrJ… 🔹 Video: youtube.com/watch?v=xySgVPLY… 🔹 Blog: blogs.nvidia.com/blog/alpama… 🔹 Technical blog: developer.nvidia.com/blog/ge… 🔹 Hugging Face blog: huggingface.co/blog/nvidia/n… 🔹 Model weights: huggingface.co/nvidia/Alpama… 🔹 Inference code: github.com/NVlabs/alpamayo2 As @JensenHuang has emphasized, open models help advance safety and security. We hope Alpamayo 2 Super will contribute to this vision by enabling researchers and developers around the world to build, experiment, and innovate in autonomous driving. We are excited to see what the community builds with Alpamayo 2 Super. @NVIDIADRIVE @NVIDIAAI
1
15
46
10,170
Thrilled to see Alpamayo 2 Super launched! So grateful to have worked alongside such an incredible team. More exciting updates to come!
Today, we’re launching Alpamayo 2 Super, our frontier open reasoning model for autonomous vehicles. Beyond seeing, Alpamayo understands and reasons through the complex world - thinks before it acts. It’s a powerful backbone for robotaxis, trucks, shuttles, delivery vans, tractors and the long tail of mobile robots—billions of autonomous machines someday. We’re releasing it for commercial use under OpenMDW-1.1 so teams can inspect it, fine-tune it and deploy it—open models advance safety and security. The next wave of AI is robotics—and it starts with autonomous vehicles. Great work, Alpamayo team! blogs.nvidia.com/blog/alpama…
2
68
Yurong You retweeted
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
15,985
29,290
10,949
171,545
66,488,285
Yurong You retweeted
Excited to share the latest expansion of the @nvidia #Alpamayo open platform for reasoning-based autonomous vehicles. Since its launch earlier this year, Alpamayo has seen rapid adoption across industry and academia, with its reasoning models surpassing 400,000 downloads and earning a #COMPUTEX 2026 Best Choice Award. As announced by Jensen Huang during his #COMPUTEX keynote, we are now introducing several major additions designed to accelerate the development of next-generation AV systems (more details here: huggingface.co/blog/drmapavo…): 🚗 Alpamayo 2 Super — a new 32B-parameter driving foundation model with: • Full 360° surround-view perception • Advanced reasoning capabilities and chain-of-causation outputs • Meta-actions such as lane changes, yielding, and stopping • Reasoning auto-labeling and visual grounding for scalable data annotation • State-of-the-art performance across reasoning, prediction, and alignment tasks 🔄 AlpaGym — an open-source framework for closed-loop reinforcement learning, enabling AV models to learn from the consequences of their actions in simulation and helping bridge the gap between training and real-world deployment. 📊 New Open Benchmarks — including challenges for closed-loop driving and long-tail reasoning to help the community measure progress and drive innovation. 🛠️ Alpamayo Recipes — a centralized repository of end-to-end workflows covering supervised fine-tuning, reinforcement learning, quantization, and model customization. Reasoning models and closed-loop training are becoming foundational technologies for autonomous systems. Our goal is to provide the open tools, models, infrastructure, and benchmarks needed to accelerate progress across the entire AV ecosystem. A huge thank you to the many researchers, engineers, and community members whose feedback helped shape this release. Resources: • Overview of the latest Alpamayo release (note: some components will be released over the coming weeks): huggingface.co/blog/drmapavo… • @nvidia announcement: nvidianews.nvidia.com/news/n… #AutonomousVehicles #PhysicalAI #Robotics #AI #MachineLearning #ReinforcementLearning #OpenSource #NVIDIA #Alpamayo @NVIDIADRIVE @NVIDIAAI
10
1
29
3,716
github.com/NVlabs/alpamayo1.… Just released! Feel free to try it out!
Jensen today announced Alpamayo 1.5 at #NVIDIAGTC! #Alpamayo 1.5 is a major update to Alpamayo 1—@nvidia’s open 10B-parameter chain-of-thought reasoning VLA model, first introduced at #CES. Built on the #Cosmos-Reason2 VLM backbone and post-trained with RL, it adds support for navigation guidance, flexible multi-camera setups, configurable camera parameters, and user question answering. The result is an interactive, steerable reasoning engine for the AV community. We’re also releasing post-training scripts to help researchers and developers adapt the model. Additionally, we’ve significantly expanded the Alpamayo open platform across data and simulation, including releasing highly requested reasoning labels for the PhysicalAI Autonomous Vehicles dataset (huggingface.co/datasets/nvid…), as well as our chain-of-causation auto-labeling pipeline. 🔎 Learn more about Alpamayo 1.5 and the latest extensions to the Alpamayo open platform: huggingface.co/blog/drmapavo… (please note that most of the links will become active in the next few days.) Happy building—and stay tuned for more in the coming months! @NVIDIADRIVE @NVIDIAAI
1
108
Yurong You retweeted
Jensen today announced Alpamayo 1.5 at #NVIDIAGTC! #Alpamayo 1.5 is a major update to Alpamayo 1—@nvidia’s open 10B-parameter chain-of-thought reasoning VLA model, first introduced at #CES. Built on the #Cosmos-Reason2 VLM backbone and post-trained with RL, it adds support for navigation guidance, flexible multi-camera setups, configurable camera parameters, and user question answering. The result is an interactive, steerable reasoning engine for the AV community. We’re also releasing post-training scripts to help researchers and developers adapt the model. Additionally, we’ve significantly expanded the Alpamayo open platform across data and simulation, including releasing highly requested reasoning labels for the PhysicalAI Autonomous Vehicles dataset (huggingface.co/datasets/nvid…), as well as our chain-of-causation auto-labeling pipeline. 🔎 Learn more about Alpamayo 1.5 and the latest extensions to the Alpamayo open platform: huggingface.co/blog/drmapavo… (please note that most of the links will become active in the next few days.) Happy building—and stay tuned for more in the coming months! @NVIDIADRIVE @NVIDIAAI
7
29
6
159
18,488
Yurong You retweeted
What does it take to build autonomous vehicles that can reason about the world they drive in? Tomorrow at #NVIDIAGTC, Patrick Liu and I will take a deep dive into the #Alpamayo #reasoning model family—a family of reasoning-based vision–language–action (#VLA) models that form a core component of the Alpamayo open platform (huggingface.co/blog/drmapavo…). We’ll cover three main topics: - How reasoning-based VLA models like Alpamayo 1 are designed and built - What it takes to bring Alpamayo 1 to production, including some of our latest results - Several exciting announcements about the expansion of the Alpamayo open platform If you're working on autonomous driving, robotics, or foundation models for physical AI, this session will offer a look at where the field is heading. Session details: 📅 Monday, Mar 16 | 3:00 PM PDT 📍 #NVIDIAGTC 2026 🔗 nvda.ws/4rze5oj Looking forward to seeing many of you there. @NVIDIADRIVE @NVIDIAAI
17
74
7,860
Yurong You retweeted
Simulation is essential for scaling the development of autonomous vehicles - from synthetic data generation to evaluation up to closed-loop training/reinforcement learning! We're organizing the Third Workshop on "Simulation for Autonomous Driving" (SAD) at #CVPR2026 in Denver, CO, USA, to bring together leading experts advancing simulation fidelity and simulation-based training. This half-day workshop features exciting keynotes from top researchers in the field, contributed papers, and a panel discussion - covering behavior modeling, sensor simulation, world models, reinforcement learning, and more. Invited Speakers: @drmapavone (Stanford / NVIDIA), @AnguelovDrago (Waymo), @francislee2020 (University of Hong Kong), Siva Manivasagam (Waabi), @wucathy (MIT). A big thank you to all speakers and organizers! Organizers: @yiyi_liao_, @MaxiIgl , Kashyap Chitta, @AzadehDinparast, Maximilian Naumann, @ZGojcic, @stan188249301, Kate Tolstaya, @wangjksjtu, @FidlerSanja, @shimon8282. 📝 Call for Papers is opening soon! Submission deadline: March 12, 2026. 🔗 agents4ad.github.io/
7
1
10
1,539
Yurong You retweeted
🚀 Exciting news from #CES2026! In his keynote today, Jensen announced @nvidia Alpamayo — a *fully open* ecosystem of models, simulation tools, and datasets designed to accelerate reasoning-based autonomous vehicle (AV) architectures and advance the path to Level 4 autonomous driving. Alpamayo brings together several technologies we’ve developed to enable reasoning-based vision–language–action (VLA) models for AVs. Our goal is to provide researchers and developers with a flexible, fast, and scalable platform for evaluating and training reasoning-based AV architectures in realistic closed-loop settings. Explore Alpamayo: -- Press Release: nvidianews.nvidia.com/news/a… -- Hugging Face Blog: huggingface.co/blog/drmapavo… -- Tech Blog: developer.nvidia.com/blog/bu… -- Alpamayo 1 reasoning model: research.nvidia.com/publicat… -- Physical AI AV Dataset: huggingface.co/datasets/nvid… -- AlpaSim simulator: github.com/NVlabs/alpasim I’m incredibly proud of the @nvidia AV Research team (research.nvidia.com/labs/avg…) and our many @nvidia collaborators whose contributions made this possible. More releases and features are coming soon — we can’t wait to see what the community builds with Alpamayo! 💡 Want to help grow the Alpamayo ecosystem? We’re hiring: [Sr.] Research Scientist: nvidia.wd5.myworkdayjobs.com… [Sr.] Research Engineer: nvidia.wd5.myworkdayjobs.com… #AutonomousVehicles #AutonomousDriving #AI #Simulation #ReasoningAI #OpenEcosystem #Alpamayo @NVIDIAAI @NVIDIADRIVE
4
9
5
64
114,784
🚗 Imitation learning is everywhere—but is it enough? So far, imitation learning—most commonly via behavior cloning (BC)—remains the go-to approach for training real-world autonomous vehicle (AV) driving policies. Yet BC operates in an open-loop (OL) fashion, overlooking the critical interdependence among inputs, outputs, and future states that comes with closed-loop (CL) operation. The result? The notorious—but often overlooked—OL–CL gap ⚠️ To address this challenge and encourage broader adoption of CL techniques, we’ve just published a survey (research.nvidia.com/publicat…) presenting a comprehensive taxonomy of closed-loop training methods for end-to-end driving. Our framework organizes approaches along three key axes: - Action generation - Environment response generation - Training objectives 💡 Bottom line: enabling technologies—like neural rendering, generative world models, and scalable RL—have now matured, making closed-loop AV training ready for wide-scale adoption. We’d love to hear your thoughts—drop a comment and join the discussion! 💬 And as a reminder, we are hiring for full-time research scientist and research engineer positions: 🔹 [Sr.] Research Scientist: nvidia.wd5.myworkdayjobs.com… 🔹 [Sr.] Research Engineer: nvidia.wd5.myworkdayjobs.com… @NVIDIADRIVE @NVIDIAAI @nvidia
1
16
94
9,305
We’ve just released @nvidia #DRIVE Alpamayo-R1 (AR1) — the world’s first industry-scale open #reasoning #VLA model for autonomous-vehicle (AV) research. AR1 integrates Chain-of-Causation reasoning with trajectory planning to improve decision-making in complex driving scenarios. Built on @nvidia #Cosmos #Reason, AR1 is designed as a customizable foundation for a broad range of AV applications — from instantiating an end-to-end backbone for autonomous driving to powering advanced, reasoning-based auto-labeling tools. Resources: Model: huggingface.co/nvidia/Alpama… Inference Code: github.com/NVlabs/alpamayo Paper: research.nvidia.com/publicat… Blog Post: blogs.nvidia.com/blog/neurip… A subset of the data used to train and evaluate AR1 is available in the @nvidia Physical AI Open Datasets: huggingface.co/datasets/nvid… AR1 can be evaluated using AlpaSim (github.com/NVlabs/alpasim), @nvidia's newly released open-source AV simulation framework built specifically for research and development. (Separate post on AlpaSim coming soon.) This release completes @nvidia’s trifecta — model, data, and simulator — to accelerate research and development in the autonomous-vehicle domain. Happy developing, and stay tuned for more! Huge thanks to the phenomenal team that made this possible @NVIDIAAI @nvidia.
4
29
3
172
22,652
So excited to see Alpamayo-R1 finally out! Working on this project felt like watching a baby grow up — and it’s still evolving fast :)
Excited to unveil @nvidia's latest work on #Reasoning Vision–Language–Action (#VLA) models — Alpamayo-R1! Alpamayo-R1 is a new #reasoning VLA architecture featuring a diffusion-based action expert built on top of the #Cosmos-#Reason backbone. It represents one of the core technologies driving NVIDIA’s push toward Level 4 autonomy and robotaxis (nvidianews.nvidia.com/news/n…), as announced by Jensen Huang at #gtc DC last week. 📄 Paper: Alpamayo-R1 research.nvidia.com/publicat… We present: - Architecture & Design: How to transform a VLM into a driving-ready Reasoning VLA - Chain of Causation Labeling: A new framework enabling reasoning-based learning - Training Strategy: From internet-scale pre-training → AV-specific SFT → RL-based post-training - Extensive Evaluation: From closed-loop simulation to real-world, on-vehicle testing 📈 Results: Alpamayo-R1 delivers significant performance gains over end-to-end baselines — especially in rare, safety-critical scenarios — all while maintaining real-time inference (99 ms end-to-end latency). Coming soon: releases of model variants and reasoning metadata built on top of the Physical AI Dataset (huggingface.co/datasets/nvid…)—with more updates on the way. Stay tuned! 🙌 Huge thanks to Wenjie Luo and @yan_wang_9 (project co-leads); the @nvidia AV Research team (@iamborisi, @YurongYou, @xinshuoweng, @tianran_, @wenhaoding95, and many others); collaborators across @nvidia Research (@liu_mingyu, @visualyang, @PavloMolchanov, and many others); and the @nvidia AV Product team (Sarah Tariq, Patrick Liu, Jack Huang, and many more). Full contributor list in the Appendix. @NVIDIADRIVE @NVIDIAAI
4
564
Simulation is one of the fastest-growing technologies in Physical AI. It’s now widely used for both testing and training—but can it also be applied to safety validation, where accurate estimates of safety metrics are critical? Join me and my @NVIDIAAI colleagues, @apoorva__sharma and Rachel Luo, for a live session where we will be discussing how to accelerate AV safety validation through simulation. 📅 Wednesday, Oct 22 | 9–10 AM PDT 🔔 Add to calendar: nvda.ws/3KHf99n
6
18
2,662
The Autonomous Vehicle (AV) Research Group @NVIDIAAI is looking for talented interns! Dive into cutting-edge work—from reasoning models and generative simulation to AI safety—and help shape the future of AV and embodied AI. Ready to push the limits? Apply now: nvidia.wd5.myworkdayjobs.com…
2
14
1
61
9,157
Are you a PhD student excited to build the future of Autonomous Vehicles? The @nvidia Autonomous Vehicles Research Group is now recruiting PhD research interns for 2026!! Apply here: nvidia.wd5.myworkdayjobs.com…
1
10
2
36
23,138
We’re now accepting applications for the 2026–2027 NVIDIA Graduate Fellowships! If you’re passionate about advancing cutting-edge reasoning models for Physical AI applications 🚗🤖, apply here: research.nvidia.com/graduate… — and be sure to select “Autonomous Vehicles.” @NVIDIAAI
1
26
1
104
12,379
Can we use simulation to validate Physical AI? Yes—with far fewer real-world tests. We propose a control variates–based estimation framework that pairs sim & real data to dramatically cut validation costs. #AI #Robotics #Sim2Real" Paper: arxiv.org/pdf/2506.20553 @NVIDIADRIVE
2
15
1
37
5,830