Principal Research Scientist at Meta Reality Labs
Zurich
Joined June 2020
- Tweets65
- Following15
- Followers5.8K
- Likes11
Paper accepted to #ECCV2026 workshop on Interactive Social Avatars!
InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control
Paper: arxiv.org/abs/2608.25734
With our intern Ekkasit Pinyoanuntapong and several other metamates
Check out the video recording of my keynote talk at the Computing 2026 conference (Foundation Models for Avatar Generation)!
The conference was very interesting, spanning a much broader range of topics than usual for a single event. Thanks, organizers!
youtube.com/watch?v=xT5jY8Ch…
Paper accepted to #ICLR2026!
MaskInversion: Localized Embeddings via Optimization of Explainability Maps
Paper: arxiv.org/abs/2407.20034
Project: walidbousselham.com/MaskInve…
Code: github.com/WalBouss/MaskInve…
With @BousselhamWalid, @HildeKuehne, @chrirupp
Last week I attended #ICIAP2025 in Rome, where I delivered a keynote talk. The conference was great, with exciting talks, delicious food, and lively social events. Plus, the auditorium had a grand painting in the background! I thank the organizers for inviting me! Grazie Roma
My favourite project from my time at Synthesia is now ready!
Avatars now move their hands matching the meaning and intonation of the words they are saying. This body language makes the videos even more engaging!
synthesiaresearch.github.io/…
I am happy to announce that I have joined Meta Reality Labs as a Principal Research Scientist, working on Spatial AI to power AR/MR experiences on Meta's wearable devices. It's the start of another adventure, and I thank all my new colleagues for making me feel welcome!
Paper accepted to the “Multimodal Algorithmic Reasoning” NeurIPS workshop!
HAMMR: Hierarchical multimodal agents for handing many diverse VQA tasks in a single system
arxiv.org/abs/2404.05465
@LluisCastrejon @tejmensink @howardzzh @andrefaraujo @JRRU
Come to poster 354 at #CVPR2024's to see our work! 10:30am today, Arch 4A-E
"Grounding Everything: Emerging Localization Properties in Vision-Language Transformers"
Paper: arxiv.org/abs/2312.00878
Demo:huggingface.co/spaces/WalidB…
Code: github.com/WalBouss/GEM
Our EXPRESS-1 AI model enables @Synthesiaio avatars to understand and adjust to the script automatically 💥
This is a big milestone, so tune in tomorrow for a pre-launch chat with @MattNiessner, @jnstrck, @vriparbelli and @AlexVoica
X Spaces event link: xitter.cf/i/spaces/1YpJkwEpgjXJj
Vittorio Ferrari retweeted
AI Avatars have learned to interpret text now. 😬
Our soon-to-be-public EXPRESS-1 AI model enables Synthesia avatars to understand and adjust to the script automatically. 🤯
Join the pre-launch tech chat with: @vriparbelli, @MattNiessner & @jnstrck 👀
xitter.cf/i/spaces/1YpJkwEpgjXJj
Introducing HAMMR: hierarchical multimodal agents that handle a broad range of VQA tasks within a single system (counting, spatial reasoning, OCR, visual pointing, external knowledge, and more).
arxiv.org/abs/2404.05465
@LluisCastrejon @tejmensink @howardzzh @andrefaraujo @JRRU
Paper accepted to #CVPR2024!
Grounding Everything: Emerging Localization Properties in Vision-Language Transformers
Paper: arxiv.org/abs/2312.00878
Demo:huggingface.co/spaces/WalidB…
Code: github.com/WalBouss/GEM
With @BousselhamWalid, @FHKPetersen, @HildeKuehne
We are running the Vision and Sports Summer school again this year! Prague, July 22-27.
We offer a broad-range of lectures on state-of-the-art Computer Vision techniques, as well as exciting sport activities, such as Volleyball, Frisbee and Table Tennis.
cmp.felk.cvut.cz/summerschoo…
Happy to share this filmed interview - if you want to join @SynthesiaIO, now is the perfect time!
Will AI ever take over humanity? 🤔
We’ve got a theory about this in our Social Media team, but let’s double check with an actual expert. Introducing our Director of Science, @VittoFerrariCV, who recently joined Synthesia!
And btw, he’s already looking for new hires, here: synthesia.io/careers
Three papers accepted to #NeurIPS
3/3
NAVI: a dataset of image collections of objects, along with high-quality 3D object scans, near-perfect 2D-3D alignments, and accurate camera parameters.
arxiv.org/abs/2306.09109
navidataset.github.io/
With @jampani_varun, @kmaninis, others
Three papers accepted to #NeurIPS
2/3
"Estimating Generic 3D Room Structures from 2D Annotations"
3D room layouts annotations for 2246 videos (part of CAD-Estate dataset).
arxiv.org/abs/2306.09077
github.com/google-research/c…
With @DRozumnyi,@StefanPopovCV, @kmaninis, @MattNiessner
Three papers accepted to #NeurIPS
1/3
StoryBench: a new benchmark for text-to-video generation of stories to guide progress in assistive technology for filmmaking 🧑🎨
arxiv.org/abs/2308.11606
github.com/google/storybench
xitter.cf/ebugliarello/status/16…
With @ebugliarello, @hhm, many others
Wouldn’t it be cool if AI could help us generate movies?🎬
We built a new benchmark to measure progress in this direction🍿
“StoryBench: A Multifaceted Benchmark for Continuous Story Visualization”
📄 arxiv.org/abs/2308.11606
👩💻 github.com/google/storybench
📈 paperswithcode.com/dataset/s…
I am happy to share that I have joined Synthesia as Director of Science. Excited to start this new adventure!
xitter.cf/synthesiaIO/status/170…
Our R&D team just got a major boost - please welcome @VittoFerrariCV, our new Director of Science! 👋
He joins us from Google, where he was a Principal Scientist leading research in computer vision and machine learning. Before that, he built and led teams at ETH Zurich and the University of Edinburgh.
Get a glimpse into Vittorio's extraordinary work, his role at Synthesia, and his vision for AI video here: synthesia.io/post/vittorio-f…
Check out CAD-Estate: a large dataset with 3D object and room layout annotations on RGB videos of complex multi-object scenes (101k objects in total!).
github.com/google-research/c…
arxiv.org/abs/2306.09011
arxiv.org/abs/2306.09077
With @StefanPopovCV, @kmaninis, @MattNiessner
Vittorio Ferrari retweeted
Wouldn’t it be cool if AI could help us generate movies?🎬
We built a new benchmark to measure progress in this direction🍿
“StoryBench: A Multifaceted Benchmark for Continuous Story Visualization”
📄 arxiv.org/abs/2308.11606
👩💻 github.com/google/storybench
📈 paperswithcode.com/dataset/s…