
Research Scientist @GoogleDeepmind | Zero-shot Cooking Learnerš§āš³
AoE
Joined September 2020
- Tweets1.4K
- Following732
- Followers5.7K
- Likes4.6K
Hope you like it and please let us know your feedback š
I did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model.
Following Argon's release just two weeks ago, Carbon shows the pace at which weāre pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys Intelligence Index at 59. It also leads across key cybersecurity evaluations scoring 88.2% on SEC-bench Pro for finding vulnerabilities, 54.8% on ExploitGym for exploitation, and 71.0% on CWE-bench for patching.
Weāre seeing significant improvements in long-horizon tasks even compared to Argon, and weāve strengthened frontier safeguards.
As we did with Argon, weāre going to roll it out gradually + responsibly. Some trusted cyber defenders will get access starting this week. We'll be expanding it to more partners through our Fairwind Program, ahead of wider availability soon, so hang tight!
Argon is quite strong and helpful if you use it properly. We really like it
Not an expert on this
seems the co-development of model and harness plays an important role, which means the model will be less and less independent in the future for more difficult tasks. And AI applications would become a joint ecosystem from model to app and user.
Gemini 4 Argon is underrated š±.
When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats to the team @GoogleDeepMind and looking forward to the new ckpt.
Our team has incredible talent density and a great vibe. We'd love to have you join usāwelcome to apply!
The Gemini Large Scale Pretrain team is hiring a Research Engineer in London or MTV! The team works across the pretrain stack: research codebases, distributed training infra, data pipelines, tooling for training dynamics analysis, and most importantly using Gemini to accelerate our work! š
If you're an engineer who has a strong "whatever it takes" attitude and is not afraid of spending tokens, apply here with some showcase work: google.com/about/careers/appā¦
No particular qualifications needed, and we welcome early career applicants. Join if you want me to bug you with refactors to enable [new AGI compute multiplier]! š
Vinh is one of the first researchers I met at GDM, and definitely one of the kindest!
Soooo happy for Vinh on this next step --- an amazingly important mission for human, and deeply romantic on a personal level as well!
Looking forward to your Nobel Prize, dude!!!! š
After 10 incredible years at Google, I've left @GoogleDeepMind to join @thematthewosman and @FabioZB_I at Polyphron as a co-founder and explore the next frontier in my research passions.
Together, we're training frontier models that autonomously explore, understand, and physically reproduce human tissue biology. It's our grand vision to grow tissues realistic enough to match human response to all drugs, and realistic enough to recover organ function when transplanted into living organisms.
Other than the bitter lesson, I think another lesson remains true in the history of ML: the more directly you can optimize your end goal, the better your outcome will be. IMO this is one lesson largely missed in the drug discovery and computational biology space today, and one that Matt and Fabio understood very clearly (and why I joined them on this journey!).
At the heart of our company is one giant RL problem: propose a recipe to grow tissue, sample life itself, reward directly against the functionality of the tissue. If this sounds exciting to you as either an AI or Life scientist, feel free to reach out! We're building the coolest lab in NYC :)
I'll never forget all of the {pretraining, RL, self-improvement} projects I worked on with my brilliant friends at GDM over the years, but I'm even more excited to share the things we discover next!
(p.s. this isnāt the first time i RLād something based off of similarity, iykyk)
This is still a very beautiful āart-styleā paper after 8 years
If you think looping transformers are "new", I refer you to @m__dehghani et al amazing work on universal transformers, published shortly after the transformer paper itself came out. arxiv.org/abs/1807.03819
Worked quite a bit on loop transformer when I was in school:
Looped MoE transformer: arxiv.org/abs/2107.11817
Looped model has better data efficiency:
arxiv.org/abs/2305.13230
But these ideas matter very little to be honest. They are obvious and cheap (still proud of worked on these projects though :D). The most important things are executing them very carefully and soundly, understanding them well enough, and letting it happen.
Thatās the route of AGI.
When can we āvibe cookingā with robots?
Something like, āadd a bit more honey and bake 3 mins more tmrā
We baked some very cool research/engineering into this model.
So glad this model went to public. ā¤ļø
Hope you like it. And you will like our next model more š«”
Today we're launching Gemini 3.7 Flash - our latest workhorse model for coding and agentic workflows, with an introductory price at half the original cost of 3.6 Flash. ā”ļø
We have been iterating rapidly with the Flash series, going from 3.5 to 3.7 in just 3 months, making it more helpful across a wide range of tasks:
⢠Software Engineering (DeepSWE v1.1): 37.0% ā 65.3%
⢠Web Development (Code Arena Elo): 1506 ā 1588
⢠Enterprise Automation (AutomationBench): 13.4% ā 30.4%
Model health mattersā¦
so that explains the delay...
deepseek could not fix training instabilities, after doubling from ~15T tokens in v3 to ~33T tokens in v4
the 10+ mentions of "stability" tricks seem to be wildly lacking if these two were the main bandages (mismatched routing + clamping)
but kudos for transparency, as always!
13
2,129
The intelligence at frontier AI labs is advancing much faster than humans can learn to effectively harness and deploy it.
What a nice vibe
Replying to @askalphaxiv
this framing feels āinsaneā to me š
1/ peter, david, and john really did all the work, 2/ iāve collaborated with yann many many times by now, and 3/ iām definitely not the ābiggestā visual representation researcher by any measure! but still, thanks for sharing our work :)
9
1,710
The team under Junyang has T0 team vibe, utilizing probably the tightest resource, delivering one of the best model in the world.
I don't know the specifics of drama at Alibaba, but if Qwen's progress is affected, the politics behind will be a sin against human progress.
Welcome to Gemini bro!
Very nice to work together again (again and again) š
Life update: Iāve joined @GoogleDeepMind as a research scientist to work on āØgemini scaling and RL, under the leadership of Yi Tay (@YiTayML) and Quoc Le (@quocleix).
I feel extremely fortunate to be on the critical path towards AGI and can't wait to help push the frontier of gemini capabilities! š
2
23
7,692
This is the right way to push video gen imo
Very nice work and congrats to the team!
Weāre excited to introduce the Waymo World Modelāa frontier generative mode for large-scale, hyper-realistic autonomous driving simulation built on @GoogleDeepMindās Genie 3.
By simulating the āimpossibleā, we proactively prepare the Waymo Driver for some of the most rare and complex scenariosāfrom tornadoes to planes landing on freewaysālong before it encounters them in the real world.
waymo.com/blog/2026/02/the-wā¦
5
1,044



















