
AI ICPC world final Gold medal 🏅. Multimodality thinking, reasoning and coding for Gemini. Core contributor of Veo. @GoogleDeepMind. PhD @mldcmu.
Joined June 2009
- Tweets80
- Following490
- Followers1.1K
- Likes64
Adams Wei Yu retweeted
Amazing progress in reasoning! 🚀 Gemini 2.5 Pro Deep Think hitting 49.4% on USAMO – a feat I'd have considered impossible just a couple of years ago – & Gemini 2.5 Flash achieving 1424 Elo are huge leaps. So proud our team's research ideas contributed to this moment!
blog.google/technology/googl…
Adams Wei Yu retweeted
Today we’re sharing an early look at our latest Gemini update for I/O!
Introducing the updated Gemini 2.5 Pro (I/O edition), which ranks #1 on WebDev Arena and surpasses our previous 2.5 Pro model by +147 Elo points. 🏆
blog.google/products/gemini/…
Adams Wei Yu retweeted
We’ve been thrilled by the positive reception to Gemini 2.0 Flash Thinking we discussed in December.
Today we’re sharing an experimental update (gemini-2.0-flash-thinking-exp-01-21) with improved performance on math, science, and multimodal reasoning benchmarks 📈:
• AIME: 73.3%
• GPQA: 74.2%
• MMMU: 75.4%
Adams Wei Yu retweeted
Congratulations to Ilya Sutskever, Oriol Vinyals and Quoc V. Le for their paper “Sequence to Sequence Learning with Neural Networks", for winning the #NeurIPS2024 Test of Time award!
Award announcement: blog.neurips.cc/2024/11/27/a…
Read the paper: research.google/pubs/sequenc…
Adams Wei Yu retweeted
Introducing #HaloQuest, our latest effort towards improving hallucination in multimodal foundation models! We hope that HaloQuest, as both a challenging benchmark and an open-sourced dataset, will enable the field's progress in advanced reasoning! Also glad that HaloQuest played a small part in the great news yesterday that #Gemini is now #1 on lmsys & accepted at #ECCV2024.
Project page: haloquest.github.io/
Paper: arxiv.org/abs/2407.15680
Github: github.com/google/haloquest/
Adams Wei Yu retweeted

Arena.ai@arena28 May 2024
United States!
United StatesConnected via WebLocation may be affected by a proxy or VPN.Account-level information, not a live location or per-post device.
Big news – Gemini 1.5 Flash, Pro and Advanced results are out!🔥
- Gemini 1.5 Pro/Advanced at #2, closing in on GPT-4o
- Gemini 1.5 Flash at #9, outperforming Llama-3-70b and nearly reaching GPT-4-0125 (!)
Pro is significantly stronger than its April version. Flash’s cost, capabilities, and unmatched context length make it a market game-changer!
Huge congrats to @GoogleDeepMind on the incredible
Gemini launches! Can't wait to see what new applications Gemini unlocks!
More breakdown analysis below👇
Adams Wei Yu retweeted

Arena.ai@arena26 Jan 2024
United States!
United StatesConnected via WebLocation may be affected by a proxy or VPN.Account-level information, not a live location or per-post device.
🔥Breaking News from Arena
Google's Bard has just made a stunning leap, surpassing GPT-4 to the SECOND SPOT on the leaderboard! Big congrats to @Google for the remarkable achievement!
The race is heating up like never before! Super excited to see what's next for Bard + Gemini Ultra release.
Adams Wei Yu retweeted
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks, including 10 of 12 popular text and reasoning benchmarks, 9 of 9 image understanding benchmarks, 6 of 6 video understanding benchmarks, and 5 of 5 speech recognition and speech translation benchmarks. Gemini Ultra is the first model to achieve human-expert performance on MMLU across 57 subjects with a score above 90%. It also achieves a new state-of-the-art score of 62.4% on the new MMMU multimodal reasoning benchmark, outperforming the previous best model by more than 5 percentage points.
Gemini was built by an awesome team of people from @GoogleDeepMind, @GoogleResearch, and elsewhere at @Google, and is one of the largest science and engineering efforts we’ve ever undertaken. As one of the two overall technical leads of the Gemini effort, along with my colleague @OriolVinyalsML, I am incredibly proud of the whole team, and we’re so excited to be sharing our work with you today!
There’s quite a lot of different material about Gemini available, starting with:
Main blog post: blog.google/technology/ai/go…
60-page technical report authored by th Gemini Team: deepmind.google/gemini/gemin…
In this thread, I’ll walk you through some of the highlights.
Adams Wei Yu retweeted
New preprint: Universal Self-Consistency for Large Language Model Generation arxiv.org/abs/2311.17311
We propose Universal Self-Consistency (USC) to aggregate free-form responses, such as code generation and summarization, where the original SC is not applicable.
Adams Wei Yu retweeted
Introducing 🔥 ‘Step back prompting’ 🔥 fueled by the power of abstraction. Joint work with the awesome collaborators at @GoogleDeepMind : @HuaixiuZheng , @xinyun_chen_ , @HengTze , @edchi , @quocleix , @denny_zhou.
LLMs struggle to answer specific questions such as: “Estella Leopold went to which school between Aug 1954 and Nov 1954?”
We find that prompting LLMs to first step back and answer a high-level less specific question such as “What was Estella Lepold’s education history?” before answering the specific question significantly improve their performance.
Paper: arxiv.org/abs/2310.06117 [1/3]
Adams Wei Yu retweeted
Can LLMs Self-Correct Their Reasoning?
Recent studies (self-refine, self-critique, etc.) suggest LLMs possess a great ability to self-correct their responses. However, our research indicates LLMs cannot self-correct their reasoning intrinsically.
arxiv.org/abs/2310.01798
[1/n]
Adams Wei Yu retweeted
New preprint: Large Language Models as Optimizers (arxiv.org/abs/2309.03409)
(1/5)
Adams Wei Yu retweeted
New open source Flan-UL2 20B checkpoints :)
- Truly open source 😎 No forms! 🤭 Apache license 🔥
- Best OS model on MMLU/Big-Bench hard 🤩
- Better than Flan-T5 XXL & competitive to Flan-PaLM 62B.
- Size ceiling of Flan family just got higher!
Blog: yitay.net/blog/flan-ul2-20b
Adams Wei Yu retweeted
We discovered an optimizer, "Lion", with symbolic program search. In our experiments, it works well for some cases. Please check out arxiv.org/abs/2302.06675 for results and limitations.
Adams Wei Yu retweeted
1/ In 2021, we shared next-gen language + conversation capabilities powered by our Language Model for Dialogue Applications (LaMDA). Coming soon: Bard, a new experimental conversational #GoogleAI service powered by LaMDA.
blog.google/technology/ai/ba…
Adams Wei Yu retweeted
Honored that our 2012 paper "Building High-level Features Using Large Scale Unsupervised Learning" received an @icmlconf Test of Time Award honorable mention!
Joint work with @quocleix, @MarcRanzato, @RajatMonga, Matthieu Devin, Kai Chen, @greg_corrado, myself, & @AndrewYNg.
Adams Wei Yu retweeted
Tomorrow (Friday) morning, we will be presenting our
@CVPR work 𝐃𝐞𝐞𝐩𝐅𝐮𝐬𝐢𝐨𝐧: 𝐋𝐢𝐝𝐚𝐫-𝐂𝐚𝐦𝐞𝐫𝐚 𝐃𝐞𝐞𝐩 𝐅𝐮𝐬𝐢𝐨𝐧 𝐟𝐨𝐫 𝐌𝐮𝐥𝐭𝐢-𝐌𝐨𝐝𝐚𝐥 𝟑𝐃 𝐎𝐛𝐣𝐞𝐜𝐭 𝐃𝐞𝐭𝐞𝐜𝐭𝐢𝐨𝐧 at 115a.
Come visit! Code is just released here shorturl.at/lKU16
Learn how DeepFusion, a fully end-to-end multi-modal 3D detection framework, applies a simple yet effective feature fusion strategy to unify the signals from two sensing modalities and achieve state-of-the-art performance. goo.gle/3M2UgRI
Adams Wei Yu retweeted
CoCa: a new image-text foundation model subsuming single-encoder, dual-encoder and encoder-decoder.
SOTA results on 19 unimodal/multimodal/alignment tasks including 86.3% zero-shot top-1 ImageNet, 90.6% with a frozen encoder, 91.0% when finetuned.
Link: arxiv.org/abs/2205.01917
Adams Wei Yu retweeted
FLAN is an oral at #ICLR2022!
Come hang out at the poster tomorrow! I will answer any question about anything, FLAN or otherwise :)
iclr.cc/virtual/2022/oral/62…
Poster: Tues 4/26 10:30am-12:30pm Pacific Time (PT)
Oral: Thurs 4/28 1:30-1:45am PT
paper: openreview.net/forum?id=gEZr…
Adams Wei Yu retweeted
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
1.2T weight model that has better average zero and one-shot results than GPT-3 while using only ⅓ of compute for training.
Arxiv: arxiv.org/abs/2112.06905
Blog: goo.gle/3dBNLWQ



























