AI ICPC world final Gold medal 🏅. Multimodality thinking, reasoning and coding for Gemini. Core contributor of Veo. @GoogleDeepMind. PhD @mldcmu.

Joined June 2009
Adams Wei Yu retweeted
Amazing progress in reasoning! 🚀 Gemini 2.5 Pro Deep Think hitting 49.4% on USAMO – a feat I'd have considered impossible just a couple of years ago – & Gemini 2.5 Flash achieving 1424 Elo are huge leaps. So proud our team's research ideas contributed to this moment! blog.google/technology/googl…
24
39
2
523
42,977
Adams Wei Yu retweeted
Today we’re sharing an early look at our latest Gemini update for I/O! Introducing the updated Gemini 2.5 Pro (I/O edition), which ranks #1 on WebDev Arena and surpasses our previous 2.5 Pro model by +147 Elo points. 🏆 blog.google/products/gemini/…
41
120
20
1,260
99,963
Adams Wei Yu retweeted
We’ve been thrilled by the positive reception to Gemini 2.0 Flash Thinking we discussed in December. Today we’re sharing an experimental update (gemini-2.0-flash-thinking-exp-01-21) with improved performance on math, science, and multimodal reasoning benchmarks 📈: • AIME: 73.3% • GPQA: 74.2% • MMMU: 75.4%
52
128
30
1,318
430,267
Adams Wei Yu retweeted
Congratulations to Ilya Sutskever, Oriol Vinyals and Quoc V. Le for their paper “Sequence to Sequence Learning with Neural Networks", for winning the #NeurIPS2024 Test of Time award! Award announcement: blog.neurips.cc/2024/11/27/a… Read the paper: research.google/pubs/sequenc…
22
153
14
984
210,677
Adams Wei Yu retweeted
Introducing #HaloQuest, our latest effort towards improving hallucination in multimodal foundation models! We hope that HaloQuest, as both a challenging benchmark and an open-sourced dataset, will enable the field's progress in advanced reasoning! Also glad that HaloQuest played a small part in the great news yesterday that #Gemini is now #1 on lmsys & accepted at #ECCV2024. Project page: haloquest.github.io/ Paper: arxiv.org/abs/2407.15680 Github: github.com/google/haloquest/
2
13
2
56
12,921
Adams Wei Yu retweeted
Arena.ai
@arena28 May 2024
Big news – Gemini 1.5 Flash, Pro and Advanced results are out!🔥 - Gemini 1.5 Pro/Advanced at #2, closing in on GPT-4o - Gemini 1.5 Flash at #9, outperforming Llama-3-70b and nearly reaching GPT-4-0125 (!) Pro is significantly stronger than its April version. Flash’s cost, capabilities, and unmatched context length make it a market game-changer! Huge congrats to @GoogleDeepMind on the incredible Gemini launches! Can't wait to see what new applications Gemini unlocks! More breakdown analysis below👇
35
242
113
1,127
394,390
Adams Wei Yu retweeted
Arena.ai
@arena26 Jan 2024
🔥Breaking News from Arena Google's Bard has just made a stunning leap, surpassing GPT-4 to the SECOND SPOT on the leaderboard! Big congrats to @Google for the remarkable achievement! The race is heating up like never before! Super excited to see what's next for Bard + Gemini Ultra release.
138
570
370
2,770
2,584,916
Adams Wei Yu retweeted
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks, including 10 of 12 popular text and reasoning benchmarks, 9 of 9 image understanding benchmarks, 6 of 6 video understanding benchmarks, and 5 of 5 speech recognition and speech translation benchmarks. Gemini Ultra is the first model to achieve human-expert performance on MMLU across 57 subjects with a score above 90%. It also achieves a new state-of-the-art score of 62.4% on the new MMMU multimodal reasoning benchmark, outperforming the previous best model by more than 5 percentage points. Gemini was built by an awesome team of people from @GoogleDeepMind, @GoogleResearch, and elsewhere at @Google, and is one of the largest science and engineering efforts we’ve ever undertaken. As one of the two overall technical leads of the Gemini effort, along with my colleague @OriolVinyalsML, I am incredibly proud of the whole team, and we’re so excited to be sharing our work with you today! There’s quite a lot of different material about Gemini available, starting with: Main blog post: blog.google/technology/ai/go… 60-page technical report authored by th Gemini Team: deepmind.google/gemini/gemin… In this thread, I’ll walk you through some of the highlights.
237
2,341
633
12,498
3,905,763
New preprint: Universal Self-Consistency for Large Language Model Generation arxiv.org/abs/2311.17311 We propose Universal Self-Consistency (USC) to aggregate free-form responses, such as code generation and summarization, where the original SC is not applicable.
4
62
4
292
51,708
Introducing 🔥 ‘Step back prompting’ 🔥 fueled by the power of abstraction. Joint work with the awesome collaborators at @GoogleDeepMind : @HuaixiuZheng , @xinyun_chen_ , @HengTze , @edchi , @quocleix , @denny_zhou. LLMs struggle to answer specific questions such as: “Estella Leopold went to which school between Aug 1954 and Nov 1954?” We find that prompting LLMs to first step back and answer a high-level less specific question such as “What was Estella Lepold’s education history?” before answering the specific question significantly improve their performance. Paper: arxiv.org/abs/2310.06117 [1/3]
5
67
16
329
121,540
Adams Wei Yu retweeted
Can LLMs Self-Correct Their Reasoning? Recent studies (self-refine, self-critique, etc.) suggest LLMs possess a great ability to self-correct their responses. However, our research indicates LLMs cannot self-correct their reasoning intrinsically. arxiv.org/abs/2310.01798 [1/n]
5
62
10
374
121,634
New preprint: Large Language Models as Optimizers (arxiv.org/abs/2309.03409) (1/5)
4
64
4
368
101,218
Adams Wei Yu retweeted
New open source Flan-UL2 20B checkpoints :) - Truly open source 😎 No forms! 🤭 Apache license 🔥 - Best OS model on MMLU/Big-Bench hard 🤩 - Better than Flan-T5 XXL & competitive to Flan-PaLM 62B. - Size ceiling of Flan family just got higher! Blog: yitay.net/blog/flan-ul2-20b
44
329
70
1,621
451,691
Adams Wei Yu retweeted
We discovered an optimizer, "Lion", with symbolic program search. In our experiments, it works well for some cases. Please check out arxiv.org/abs/2302.06675 for results and limitations.
12
79
6
534
122,004
1/ In 2021, we shared next-gen language + conversation capabilities powered by our Language Model for Dialogue Applications (LaMDA). Coming soon: Bard, a new experimental conversational #GoogleAI service powered by LaMDA. blog.google/technology/ai/ba…
640
3,058
1,351
14,239
7,414,800
Adams Wei Yu retweeted
Honored that our 2012 paper "Building High-level Features Using Large Scale Unsupervised Learning" received an @icmlconf Test of Time Award honorable mention! Joint work with @quocleix, @MarcRanzato, @RajatMonga, Matthieu Devin, Kai Chen, @greg_corrado, myself, & @AndrewYNg.
18
30
4
399
Adams Wei Yu retweeted
Tomorrow (Friday) morning, we will be presenting our @CVPR work 𝐃𝐞𝐞𝐩𝐅𝐮𝐬𝐢𝐨𝐧: 𝐋𝐢𝐝𝐚𝐫-𝐂𝐚𝐦𝐞𝐫𝐚 𝐃𝐞𝐞𝐩 𝐅𝐮𝐬𝐢𝐨𝐧 𝐟𝐨𝐫 𝐌𝐮𝐥𝐭𝐢-𝐌𝐨𝐝𝐚𝐥 𝟑𝐃 𝐎𝐛𝐣𝐞𝐜𝐭 𝐃𝐞𝐭𝐞𝐜𝐭𝐢𝐨𝐧 at 115a. Come visit! Code is just released here shorturl.at/lKU16
Learn how DeepFusion, a fully end-to-end multi-modal 3D detection framework, applies a simple yet effective feature fusion strategy to unify the signals from two sensing modalities and achieve state-of-the-art performance. goo.gle/3M2UgRI
1
7
32
Adams Wei Yu retweeted
CoCa: a new image-text foundation model subsuming single-encoder, dual-encoder and encoder-decoder. SOTA results on 19 unimodal/multimodal/alignment tasks including 86.3% zero-shot top-1 ImageNet, 90.6% with a frozen encoder, 91.0% when finetuned. Link: arxiv.org/abs/2205.01917
9
72
6
408
Adams Wei Yu retweeted
FLAN is an oral at #ICLR2022! Come hang out at the poster tomorrow! I will answer any question about anything, FLAN or otherwise :) iclr.cc/virtual/2022/oral/62… Poster: Tues 4/26 10:30am-12:30pm Pacific Time (PT) Oral: Thurs 4/28 1:30-1:45am PT paper: openreview.net/forum?id=gEZr…
1
11
1
50
Adams Wei Yu retweeted
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts 1.2T weight model that has better average zero and one-shot results than GPT-3 while using only ⅓ of compute for training. Arxiv: arxiv.org/abs/2112.06905 Blog: goo.gle/3dBNLWQ
5
57
4
233