postdoc @berkeley_ai interested in modeling human behavior with computer vision
Joined August 2018
- Tweets275
- Following452
- Followers985
- Likes2.2K
Pinned Tweet
Introducing Gaze-LLE, a new model for gaze target estimation built on top of a frozen visual foundation model!
Gaze-LLE achieves SOTA results on multiple benchmarks while learning minimal parameters, and shows strong generalization
paper: arxiv.org/abs/2412.09586
Fiona Ryan retweeted
🚨 Call for participation: the Child–Robot Dexterity Challenge at the CoRL 2026 𝗦𝗣𝗜𝗡 𝗪𝗼𝗿𝗸𝘀𝗵𝗼𝗽! Bring your robot, or run on ours. Apply by Oct 5.
🧒🤖 Robots and a child will take on the same everyday tasks, side by side, live on stage. The demonstration offers a simple way to see what today’s robots can already do and where there’s still room to improve.
We make it easy to join:
- Bimanual YAM setup (MolmoAct 2 style) + a dexterous Sharpa hand setup, provided on stage.
- Bring your own hardware (subject to approval).
🌐 Website: spin-workshop.github.io/#con…
🗣️ Speakers & panel from Stanford, Columbia, TU Darmstadt, and AMI Labs.
📍 Nov 12 · Austin, TX
#CoRL2026
happy to be recognized as an outstanding reviewer for #CVPR2026! ☺️
We are grateful to all of the 17,491 reviewers who helped make #CVPR2026 possible. We are especially pleased to recognize the following Outstanding Reviewers, whose high-quality reviews (as judged by their Area Chairs) placed them among the top 5% of reviewers.
Fiona Ryan retweeted
Introducing EgoVerse: an ecosystem for robot learning from egocentric human data.
Built and tested by 4 research labs + 3 industry partners, EgoVerse enables both science and scaling
1300+ hrs, 240 scenes, 2000+ tasks, and growing
Dataset design, findings, and ecosystem 🧵
Fiona Ryan retweeted
If you’re interested in interactive physical AI, join our workshop at CVPR 2026, sponsored by Nvidia! We will host scientists to discuss socially-intelligent robots, interactive avatars, and on-device multimodal agents 🤖
Papers are due by Feb 28 🗓️
📢IPA 2026 (Interactive Physical AI) @CVPR 2026.
Announcing the 1st Interactive Physical AI workshop at CVPR 2026! This half-day workshop will bring together researchers to discuss AI systems that perceive humans and scenes, communicate via multimodal signals, and act safely in our shared physical world. 🧵
#CVPR2026
Fiona Ryan retweeted
🌟NEW PAPER🌟
Do you know that changing a visual marker from red to blue can completely reorder VLM leaderboards? In our most recent work, we explore the fragility of visually prompted benchmarks. lisadunlap.github.io/vpbench…
Fiona Ryan retweeted
🤔 SAGE started out of curiosity as to why agentic post training had not made a big impact for developing video models in mid 2025.
💡With entertainment videos as our testbed, we find that one can turn great "direct" models into awesome "any-horizon agents" with effortful RL!
Fiona Ryan retweeted
Some properties of LLMs only emerge with scale, one of which is the ability to effectively generalize from diverse data.
During my internship @physical_int, we uncovered an emergent property of VLAs: as we scale up pre-training, VLAs can naturally learn from human video data!
Fiona Ryan retweeted
We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data!
This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.
Fiona Ryan retweeted
🎥 Introducing Split-then-Merge: A new video composition framework!
This approach enables the composition of any foreground video with any background video.
Unlike conventional methods that rely on annotated datasets or handcrafted rules, Split-then-Merge (StM) splits a large unlabeled corpus of videos into dynamic foreground and background layers, then merges them to learn how dynamic subjects interact with diverse scenes.
Work done in collaboration with team members at @Google: Du Tran (@dutran) , Yujia Chen (@IssacCyj) , Prof. Ming-Hsuan Yang (@MingHsuanYang), Vincent Chu: and my advisor at UIUC (@siebelschool): Prof. James M. Rehg (@RehgJim).
I will be attending NeurIPS, San Diego and would be happy to chat more!
🔗Project Webpage: split-then-merge.github.io/
📄Paper: arxiv.org/abs/2511.20809
the Artificial Social Intelligence workshop at #ICCV2025 will be continuing this afternoon! Join us in room 317B at 1:30pm for oral presentations from our paper track, keynotes from Leila Takayama and Michael Black, posters, and a breakout discussion!
sites.google.com/andrew.cmu.…
The #ICCV2025 Artificial Social Intelligence Workshop will be a full-day event on Sunday, 10/19 in Room 317B
Join us to discuss social reasoning, multimodality, and embodiment in socially-intelligent AI agents!
see you tomorrow for ASI @ ICCV! full schedule here: sites.google.com/andrew.cmu.…
The #ICCV2025 Artificial Social Intelligence Workshop will be a full-day event on Sunday, 10/19 in Room 317B
Join us to discuss social reasoning, multimodality, and embodiment in socially-intelligent AI agents!
Fiona Ryan retweeted
The #ICCV2025 Artificial Social Intelligence Workshop will be a full-day event on Sunday, 10/19 in Room 317B
Join us to discuss social reasoning, multimodality, and embodiment in socially-intelligent AI agents!
Excited to announce the Artificial Social Intelligence Workshop @ ICCV 2025 @ICCVConference
Join us in October to discuss the science of social intelligence and algorithms to advance socially-intelligent AI! Discussion will focus on reasoning, multimodality, and embodiment.
Fiona Ryan retweeted
Great to see the Artificial Social Intelligence workshop happening at #ICCV2025 co-organized by my PhD student @fionakryan, Postdoc-alumni @sangminlee777 and our amazing collaborators.
Join us on Sunday 10/19 in Room 317B.
The #ICCV2025 Artificial Social Intelligence Workshop will be a full-day event on Sunday, 10/19 in Room 317B
Join us to discuss social reasoning, multimodality, and embodiment in socially-intelligent AI agents!
Fiona Ryan retweeted
Can we scale up mobile manipulation with egocentric human data?
Meet EMMA: Egocentric Mobile MAnipulation
EMMA learns from human mobile manipulation + static robot data — no mobile teleop needed!
EMMA generalizes to new scenes and scales strongly with added human data.
1/9
Fiona Ryan retweeted
Robots struggle to learn new skills from human videos.
Why? We found that naive co-training produces disjoint distributions.
Our EgoBridge (NeurIPS’25) extends Optimal Transport to align human-robot latents, improving success by 44% and generalization to human-only tasks!🧵
Fiona Ryan retweeted
#ICCV2025 3D VQA from multi-view RGBs? Hold my Gaussian 🎨
We present a generalizable 3DGS-Language framework for 3D visual QA, trained in a self-supervised manner, no 3D-language labels needed during training.
Project: splat-talk.github.io/
Fiona Ryan retweeted
August 1 is the deadline for non-archival papers for the #ICCV2025 artificial social intelligence workshop!
Papers in this track will be presented as posters at ICCV. We welcome any submissions of ongoing work, recently published work, or #ICCV papers in areas related to socially-intelligent AI!
OpenReview submission here:
openreview.net/group?id=thec…
Excited to announce the Artificial Social Intelligence Workshop @ ICCV 2025 @ICCVConference
Join us in October to discuss the science of social intelligence and algorithms to advance socially-intelligent AI! Discussion will focus on reasoning, multimodality, and embodiment.
There is 1 more week to submit non-archival extended abstracts to present at the Artificial Social Intelligence workshop @ICCVConference! We welcome work recently published in other venues (including the main ICCV conference) as well as works in progress!
Excited to announce the Artificial Social Intelligence Workshop @ ICCV 2025 @ICCVConference
Join us in October to discuss the science of social intelligence and algorithms to advance socially-intelligent AI! Discussion will focus on reasoning, multimodality, and embodiment.
Fiona Ryan retweeted
📣 the deadline for archival papers in the #ICCV2025 artificial social intelligence workshop is tomorrow!
archival papers will be published in #ICCV workshop proceedings and presented
we welcome any papers on social signal processing, social scene understanding, social behavior prediction, modeling communicative dynamics, inferring intent, and more!
Excited to announce the Artificial Social Intelligence Workshop @ ICCV 2025 @ICCVConference
Join us in October to discuss the science of social intelligence and algorithms to advance socially-intelligent AI! Discussion will focus on reasoning, multimodality, and embodiment.