Rahma retweeted
Today we introduced Gemini Diffusion⚡️ (& DeepThink, Veo3, Imagen4, 2.5 updates...).
It's been a dream of mine to remove the need for "left to right" text generation. It's so fast, that we had to *slow down* the video during the presentation.
deepmind.google/models/gemin…
Rahma retweeted
Such a privilege to work on Gemini Diffusion with an amazing team! From a small research project to launching at I/O - we've got unstoppable aura 🚀
Welcome to the era of live vibe coding ⚡️
Rahma retweeted
🚀Meet Gemini Diffusion, our first diffusion-based and super fast language model, just announced at Google I/O!🚀
Very excited to be able to share what I've been working on for the past little while with our amazing small team @GoogleDeepMind.
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model.
Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
Rahma retweeted
Well now, the prospect of using this 'Gemini Diffusion' contraption... frankly, it's a rather delightful thought altogether!
It's been an incredible experience working on Gemini Diffusion. So much pride in what we've accomplished bringing this from a small research project to an I/O launch
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model.
Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
Rahma retweeted
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model.
Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
Rahma retweeted
1000+ words per second! ⚡
We just unleashed Gemini Diffusion at #GoogleIO! 🚀
Awesome being part of the team that took this from a small research project all the way to I/O @GoogleDeepMind 🪐
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model.
Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
Rahma retweeted
In December we began the Gemini Era, and we’ve continued to make relentless progress since. Today we’re thrilled to introduce the next generation: Gemini 1.5 - hugely enhanced performance, highly efficient architecture & long-context length breakthrough
blog.google/technology/ai/go…
Rahma retweeted
Another tour de force by @ibalazevic, and a thoroughly enjoyable new collaboration with @YugeTen, @pinelopip3, @Rahma_Chaa, and @skandakoppula
You can find the paper here arxiv.org/abs/2402.05861
Rahma retweeted
Humans and animals reason about events spanning days, weeks, and years, yet current CV systems live largely in the present.
Introducing Memory-Consolidated ViT, whose context extends far into the past and sets a new SOTA in long-video understanding with a 10x smaller model
Rahma retweeted
Read more in a BlackBox EMNLP 2021 paper by @Rahma_Chaa , @robdessi, and myself arxiv.org/abs/2107.01366
Rahma retweeted
Transformer seq2seq models enjoy epic practical success, however, they miserably fail on SCAN data that probes for compositional reasoning.. - wait! compositionality is a cornerstone of the language. Is there a contradiction? Is work on SCAN compositionality even useful then? 🧶\
Rahma retweeted
Wanted: Phd candidate Université de Paris 2021
Meaning-based approach to locality constraints
Advisors: Anne Abeillé, Barbara Hemforth, Edward Gibson
Please apply and retweet!
llf.cnrs.fr/en/node/6836
Rahma retweeted
The way people use words to describe colors is remarkably consistent across thousands of languages. New Facebook AI research published in the “Proceedings of the National Academy of Sciences” shows that cutting-edge AI systems name colors in a similar way: ai.facebook.com/blog/ai-name…
We demonstrate next that the nature of the emergent systems depends on communication being discrete. Our study suggests that efficient semantic categorization is a general property of discrete communication systems, not limited to human language.
We show that artificial neural networks trained to play a discrimination game develop emergent communication systems whose distribution on the accuracy/complexity plane closely matches that of human languages.
I am very proud about our work with @n0mad_0, Emmanuel and Marco accepted at PNAS.
Communicating artificial neural networks develop efficient color-naming systems pnas.org/content/118/12/e201…
Rahma retweeted
The latest generation of adversarial image attacks is, uh, somewhat simpler to carry out openai.com/blog/multimodal-n…
