
Research Engineer @GoogleDeepMind · Gemini post-training #LLM #RLHF · PhD from @irlab_amsterdam
Aarau, Switzerland
Joined August 2011
- Tweets796
- Following383
- Followers631
- Likes1.8K
Aleksandr Chuklin retweeted
Today we're launching Gemini 3.7 Flash - our latest workhorse model for coding and agentic workflows, with an introductory price at half the original cost of 3.6 Flash. ⚡️
We have been iterating rapidly with the Flash series, going from 3.5 to 3.7 in just 3 months, making it more helpful across a wide range of tasks:
• Software Engineering (DeepSWE v1.1): 37.0% ➔ 65.3%
• Web Development (Code Arena Elo): 1506 ➔ 1588
• Enterprise Automation (AutomationBench): 13.4% ➔ 30.4%
Aleksandr Chuklin retweeted
Gemini 3 also scores well on the lmarena leaderboards, ranking #1 across all the major @arena leaderboards.
🚨BREAKING: @GoogleDeepMind’s Gemini-3-Pro is now #1 across all major Arena leaderboards
🥇#1 in Text, Vision, and WebDev - surpassing Grok-4.1, Claude-4.5, and GPT-5
🥇#1 in Coding, Math, Creative Writing, Long Queries, and nearly all occupational leaderboards.
Massive gains over Gemini-2.5:
🔸WebDev in Code Arena: 1487 (+280 pts vs 2.5)
🔸Text: 1501 (+50 pts)
🔸Vision: 1328 (+70 pts)
🔸Arena Expert: Top-3 (just 3 pts behind #1)
Huge congrats to the @GoogleDeepMind team on this breakthrough! 👏
Aleksandr Chuklin retweeted
We need to invest in peace not war.
We need to invest in innovation, in our education system, and in building epic things that benefit humanity.
Aleksandr Chuklin retweeted
DeepSeek did something no one else has done before—it made my parents show true interest in what I am working on for the first time. Really.
Aleksandr Chuklin retweeted

Thomas Wolf@Thom_Wolf30 Jan 2025
Europe
EuropeConnected via Europe App StoreAccount-level information, not a live location or per-post device.
Finally took time to go over Dario's essay on DeepSeek and export control and to be honest it was quite painful to read. And I say this as a great admirer of Anthropic and big user of Claude*
The first half of the essay reads like a lengthy attempt to justify that closed-source models are still significantly ahead of DeepSeek. However, it mostly refers to internal unpublished evals which limit the credit you can give it, and statements like « DeepSeek-V3 is close to SOTA models and stronger on some very narrow tasks » transforming in a general conclusion « DeepSeek-V3 is actually worse than those US frontier models — let’s say by ~2x on the scaling curve » left me generally doubtful. The same applies to the takeaway that all discoveries and efficiency improvements of DeepSeek have been discovered long ago by closed-models companies, this statement mostly resulting from a comparison of DeepSeek openly published $6M training numbers with some vague « few $10M » on Anthropic side without providing much more details. I have no doubts the Anthropic team is extremely talented and I’ve regularly shared how impressed I am with Sonnet 3.5 but this longwinded comparison of open research with vague closed research and undisclosed evals has left me less convinced of their lead than I was before I reading it.
Even more frustrating was the second half of the essay which dive into the US-China race scenario and totally misses the point that the DeepSeek model is open-weights, and largely open-knowledge due to its detailed tech report (and feel free to follow Hugging Face’s open-r1 reproduction project for the remaining non-public part: the synthetic dataset). If both DeepSeek and Anthropic models had been closed source, yes the arm-race interpretation could have make sense but having one of the model freely widely available for download and with detailed scientific report renders the whole « close-source arm-race competition » argument artificial and unconvincing in my opinion.
Here is the thing: open-source knows no border. Both in its usage and its creation.
Every company in the world, be it in Europe, Africa, South-America or the USA can now directly download and use DeepSeek without sending data to a specific country (China for instance) or depending on a specific company or server for running the core part of its technology.
And just like most open-source library in the world are typically built by contributors from all over the world, we’ve already seen several hundred derivative models on the Hugging Face hub created everywhere in the world by teams adapting the original model to their specific use cases and explorations.
What's more, with the open-r1 reproduction and the DeepSeek paper, the coming months will clearly see many open-source reasoning models being released by teams from all over the world. Just today, two other teams, AllenAI in Seattle and Mistral in Paris both independently released open-source base models (Tülu and Small3) which are already challenging the new state-of-the-art (with AllenAI indicating that its Tülu model surpasses the performance of DeepSeek-V3).
And the scope is even much broader than this geographical aspect. Here is the thing we don’t talk nearly enough about: open-source will be more and more essential for our… safety!
As AI becomes central to our lives, resiliency will increasingly become a very important element of this technology. Today we’re dependent on internet access for almost everything. Without access to the internet, we lose all our social media/news feeds, can’t order a taxi, book a restaurant, or reach someone on WhatsApp. Now imagine an alternate world to ours where all the data transiting through the internet would have to go through a single company’s data centers. The day this company suffers a single outage, the whole world would basically stop spinning (picture the recent CrowdStrike outage magnified a millionfold).
Soon, as AI assistants and AI technology permeate our whole life to simplify many of our online and offline tasks, we (and companies using AI) will start to depend more on more on this technology for our daily activities and we will similarly start to find annoying or even painful any downtime in these AI assistants from outages.
The most optimal way to avoid future downtime situations will be to build resilience deep in our technological chain.
Open-source has many advantages like shared training costs, tunability, control, ownership, privacy but one of its most fundamental virtue in the long term –as AI becomes deeply embedded in our world– will likely be its strong resilience. It is one of the most straightforward and cost-effective ways to easily distribute compute across many independent providers and to even run models locally and on device with minimal complexity.
More than national prides and competitions, I think it’s time to start thinking globally about the challenges and social changes that AI will bring everywhere in the world. And open-source technology is likely our most important asset for safely transitioning to a resilient digital future where AI is integrated into all aspects of society.
*Claude is my default LLM for complex coding. I also love its character with hesitations and pondering, like a prelude to the chain-of-thoughts of more recent reasoning models like DeepSeek generations.
Aleksandr Chuklin retweeted
Google is the only company that isn’t hyping even their good stuff.
The new Google 2.0 Flash Thinking model is absolutely amazing and insanely cheap too.
It's very close to DeepSeek R1 in performance too.
Aleksandr Chuklin retweeted
We're excited to introduce Gemini 2.0 - our most capable AI model yet - with 2.0 Flash Experimental.
Starting today, all Gemini users can now try out a chat-optimized version of Gemini 2.0 Flash Experimental, with enhanced performance on a number of key benchmarks and speed. With this new model, Gemini 2.0 will unlock an even more helpful Gemini assistant.
Visit gemini.google.com and select it from the model drop-down to get started, and learn more about today's updates here: goo.gle/4fcwlNB
Aleksandr Chuklin retweeted
Gemini 1.5-Pro is a pretty good reward model (tops among generative models and second overall in the Reward Bench Leaderboard).
Gemini 1.5 Pro when zero-shot prompted to perform an LLM-as-a-judge task ranks 1st when compared to other Generative RMs and 2nd best overall vs other dedicated RMs: huggingface.co/spaces/allena… (make sure to click on the Generative checkbox).
Aleksandr Chuklin retweeted
On this independent leaderboard, Bard is now #2 (and it is free). I have been a first hand witness to the extraordinary levels of innovation that my collaborators on the Bard team have produced at unparalleled speed. Excited about what's coming next in 2024!
🔥Breaking News from Arena
Google's Bard has just made a stunning leap, surpassing GPT-4 to the SECOND SPOT on the leaderboard! Big congrats to @Google for the remarkable achievement!
The race is heating up like never before! Super excited to see what's next for Bard + Gemini Ultra release.
Aleksandr Chuklin retweeted
🔥Breaking News from Arena
Google's Bard has just made a stunning leap, surpassing GPT-4 to the SECOND SPOT on the leaderboard! Big congrats to @Google for the remarkable achievement!
The race is heating up like never before! Super excited to see what's next for Bard + Gemini Ultra release.
Aleksandr Chuklin retweeted
A lot of NLP is moving to larger models, casting everything as generation (looking at you, T5 & co), but there's a countertrend: fast Text-Editing models, casting generation as seq labeling. Learn more at our #NAACL2022 tutorial: text-editing.github.io/
Aleksandr Chuklin retweeted
Ready for NAACL in less than 2 weeks? Please check out a blog post about an excellent set of tutorials offered on July 10! 2022.naacl.org/blog/welcome-… @migballesteros @nlprit @tsvetshop
Aleksandr Chuklin retweeted

Proton@ProtonPrivacy8 Mar 2022
United Kingdom
United KingdomConnected via United Kingdom App StoreAccount-level information, not a live location or per-post device.
Many companies have announced they will no longer serve Russian customers. Proton's mission, however, is to defend online freedom anywhere in the world, so we remain committed to ensuring the free flow of information in Russia for as long as possible.
Aleksandr Chuklin retweeted
One country dominates the top 10.
Discover more about universities all over the world: ow.ly/seQ250HMmWo
Aleksandr Chuklin retweeted
The preprint of our paper "Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions" w/ @julia_kiseleva @varphi @JeffD @MikhailBurtsev is now available.
Preprint: bit.ly/3hv5gdo
Repo: bit.ly/ClariQ
#EMNLP2021 @emnlpmeeting #NLProc
Our full paper "Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions" w/ @julia_kiseleva @varphi @cookingphd @MikhailBurtsev has been accepted at #EMNLP2021 @emnlpmeeting (main conference).
Repo: github.com/aliannejadi/Clari…
#NLProc
Aleksandr Chuklin retweeted
Our full paper "Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions" w/ @julia_kiseleva @varphi @cookingphd @MikhailBurtsev has been accepted at #EMNLP2021 @emnlpmeeting (main conference).
Repo: github.com/aliannejadi/Clari…
#NLProc
Aleksandr Chuklin retweeted
We're glad to announce the winners of the ClariQ data challenge (convai.io):
- First team: NTES_ALONG: Wenjie Ou, Yue Lin
- Second team: TAL ML: Hang Li, Yu Kang, Tianqiao Liu, Guowei Xu, Wenbiao Ding, Zitao Liu
#emnlp2020 #NLProc #SCAI_Workshop
The winners of #ClariQ challenge phase 2 will be announced in a couple of hours at @scai_workshop by @maliannejadi! More details about the challenge and data --> convai.io #NLProc #emnlp2020 #ConversationalAI #SCAI_Workshop
Aleksandr Chuklin retweeted
Tomorrow is the 5th International Workshop on Search-Oriented Conversational AI (SCAI) @scai_workshop at @emnlp2020 #EMNLP2020
Alana's @verena_rieser will be presenting Response Generation and Retrieval for Multimodal #ConversationalAI
scai.info/2020/
Aleksandr Chuklin retweeted
Replying to @scai_workshop @emnlp2020
Looking forward to seeing many of you at the #SCAI_Workshop tomorrow. Each block of the workshop will kick off at virtualchair.net/events/emnl… with some sessions happening in Zoom. Make sure you test both #emnlp2020 systems beforehand to avoid technical issues.
























