The computer vision and reasoning lab in the Allen School at the University of Washington, led by Ali Farhadi and Ranjay Krishna.

Seattle, WA
Joined April 2020
UW RAIVN Lab retweeted
Last year Molmo set SOTA on image benchmarks + pioneered image pointing. Millions of downloads later, Molmo 2 brings Molmo’s grounded multimodal capabilities to video 🎥—and leads many open models on challenging industry video benchmarks. 🧵
6
64
29
321
128,870
UW RAIVN Lab retweeted
📢Applications are open for summer'25 internships at the PRIOR (computer vision) team @allen_ai: Come join us in building large-scale models for: 📸 Open-source Vision-Language Models 💻 Multimodal Web Agents 🤖 Embodied AI + Robotics 🌎 Planet Monitoring Apply by December 11, 2024!
1
13
5
47
11,865
🎉 Very Excited to present our recent work on “Selective🔍 Visual Representations for Embodied-AI🤖” next week at ICLR in Vienna🇦🇹!! 📣📣Important update! Our code and pretrained models are now available through our project website 🌐: embodied-codebook.github.io/🚀 👋Come to my poster, say hi, and learn more about our findings! (Poster #111, Session 8, on Friday, May 10th at 4:30 PM)
Embodied-AI 🤖 models employ general-purpose vision backbones such as CLIP to encode the observation. How can we have a more task-driven visual perception for embodied-AI? We introduce a parameter-efficient approach that selectively filters visual representations for Embodied-AI tasks. Project page: embodied-codebook.github.io 🧵👇
1
8
1
53
9,080
CLIP models have become a lot better since 2021
9
80
13
622
163,208
Introducing💃AdANNS: A Framework for Adaptive Semantic Search🕺 TL;DR: Up to 90× faster nearest neighbor retrieval and 2× lower memory cost for web-scale search. Applies to vector search at scale & improves all "retrieval" augmented models! arxiv.org/abs/2305.19435 [1/8]
5
87
7
469
91,114
1/9 I am excited to announce that our workshop "Towards the Next Generation of Computer Vision Datasets" will be happening at ICCV 2023 in Paris. We will feature DataComp submissions, other data-centric papers, and invited talks by experts. datacomp.ai/workshop
3
18
2
52
22,686
Introducing DataComp, a new benchmark for multimodal datasets! We release 12.8B image-text pairs, 300+ experiments and a 1.4B subset that outcompetes compute-matched CLIP runs from OpenAI & LAION 📜 arxiv.org/abs/2304.14108 🖥️ github.com/mlfoundations/dat… 🌐 datacomp.ai
7
176
32
743
208,605
Instead of prompting CLIP w/ "A photo of a {class}", why not ask GPT-3 to describe {class} instead? The result is customized prompts for each {class}! Less human effort, higher zero-shot accuracy Work w/ Rosanne Liu (@savvyRL) + Ali Farhadi arxiv.org/abs/2209.03320 (1/4)
9
65
11
412
Introducting🪆Matryoshka Representations for Adaptive Deployment🪆 TL;DR: up to 14× lower real-world classification & retrival costs at web-scale at no loss in accuracy & w/o any overhead across setups. Paper: arxiv.org/abs/2205.13147 Code: github.com/RAIVNLab/MRL [1/11]
6
93
19
477
UW RAIVN Lab retweeted
Matryoshka Representations for Adaptive Deployment abs: arxiv.org/abs/2205.13147 flexibility within the learned Matryoshka Representations offer: (a) up to 14× smaller embedding size for ImageNet-1K classification at the same level of accuracy
1
14
1
67
Our latest work!! I will share a tweet thread soon🪆 Work co-led w/ @BhattGantavya @wregss Collab between @uwcse/@RAIVNLab & @GoogleAI Co-authors: Matt Wallingford, @adityaasinha,@RamanujanVivek, William, Kaifeng, @ShamKakade6, @jainprateek_ and Ali Farhadi.
Matryoshka Representations for Adaptive Deployment abs: arxiv.org/abs/2205.13147 flexibility within the learned Matryoshka Representations offer: (a) up to 14× smaller embedding size for ImageNet-1K classification at the same level of accuracy
5
3
46
A bit of outdated news: I am spending more time at AI2 @allen_ai now, co-leading @ai2_allennlp with @nlpnoah At @ai2_allennlp, we are hiring postdocs and research scientists with strong foundation in NLP. Links to apply: boards.greenhouse.io/thealle… boards.greenhouse.io/thealle…
3
37
3
233
UW RAIVN Lab retweeted
On #GivingTuesday, we’re excited to share the story behind a new professorship honoring #UWAllen’s own “force of nature” (and resident steamroller) @lazowska—a fierce champion for our school, @UW, and expanding access to computing education & careers: news.cs.washington.edu/2021/… 1/3
1
2
2
30
UW RAIVN Lab retweeted
‼️Announcement‼️I'm on the academic job market! I focus on building grounded AI models🤖, capable of understanding humans and the complex world we live in🌍. I combine #NLProc & vision, with insights from developmental psych. Reach out if your university might be a good fit😀
3
32
2
206
UW RAIVN Lab retweeted
I feel awful working on the CVPR deadline and having first-world problems (like OMG my learning curves are ugly!), while my parents, who are both healthcare workers in Iran, keep getting re-infected and getting hospitalized over and over again!
6
2
221
Excited to share our new method, "Learning Compressible Subspaces (LCS)", for adaptive model compression in real-time: (arxiv.org/abs/2110.04252).
2
8
1
64
Multi-class classification of *L* classes traditionally need *L* classifiers. 1st thought in 2016: Can we do this w/ *log L* bits? I finally acted on it, we propose LLC that solves 1000 class ImageNet classification with **20-bits**. A thread🧵(1/8) arxiv.org/abs/2106.01487
3
20
3
144
Amazing collaborators (@RAIVNLab & @uw_wail): Matt, @RamanujanVivek, @SomaniRaghav, @jae_sung_park96 & Krishna My advisors (@uwcse & @GoogleAI) Ali Farhadi, @ShamKakade6 & @jainprateek_. They were the best with all that's going on around & supported all my crazy thoughts. 8/8
1
1
6
Exciting life update: I'll be joining Carnegie Mellon University's LTI department as an assistant prof 👨🏼‍🏫 in Fall '22, before which I'll spend a year as a postdoc at AI2 Mosaic 👨🏼‍🔬... That is, once I finish and defend my thesis first👨🏼‍🎓 @SCSatCMU @LTIatCMU @ai2_mosaic @allen_ai
68
19
9
639