Design lead, creative tools @ Google Labs 🧪 | Views are my own.
San Francisco
Joined August 2009
- Tweets10.1K
- Following1.8K
- Followers3.2K
- Likes20.3K
Nick Matarese retweeted
Od kiedy bawię się animacją, a stukną niedługo cztery dekady, czekałem na narzędzia, które pozwalają animować w sposób bardziej organiczny i kontekstowy.
Cała tradycyjna nakładka techniczna na animację komputerową jest wręcz absurdalnie przekomplikowana.
Działało to trochę jak bramka dostępu. „Patrzcie jakie to jest strasznie trudne, lepiej zostawcie to specjalistom, bo nikt inny nie pojmie głębi i złożoności tego magicznego procesu”. W sumie mało jest innych branż, które ze skomplikowania narzędzi zrobiły cnotę, jednocześnie czyniąc proces nieludzkim i nieintuicyjnym.
Mi od początku tej zabawy marzyło się coś innego. Dynamikę sceny czy ruchu postaci trudno buduje się na abstrakcyjnych krzywych beziera, na wielokrotnie zagnieżdżonych hierarchicznych szkieletach, ale łatwo ją pokazać gestem, palcami, ciałem, czy choćby i zagwizdać.
Wreszcie można. Ludzie są multimodalni więc fajnie, że maszyny w końcu też. Wreszcie zamiast „przesuń kontroler kącika ust 5 mm w górę, i zwiększ zmrużenie oczu, przesuń kontroler brwi w górę o 3mm” – będzie można powiedzieć „uśmiechnij się” .
Czego sobie i nam życzę.
Nick Matarese retweeted
Lots of discussion out there about our next model(!), so I wanted to give an early look as soon as possible. Introducing Gemini 4 Argon!
It shows frontier performance in complex workflows, cyber defense and software engineering. Teams are using it extensively at Google, from coding to quantum computing, great feedback.
Here’s a look at the benchmarks:
Nick Matarese retweeted
Software is increasingly treated as disposable in the AI era. Yet we spend half our waking lives looking at screens! We don’t want to spend that time with zombie products—monotonous, vacant, and uncared for. We want products with soul. 💜
I go deep on this in my talk from @lennysan's Summit: youtube.com/watch?v=GLvFTMtw…
Nick Matarese retweeted
I texted someone inside a simulation.
She had to go upstairs and find her phone before she could text me back.
The video model didn’t decide what happened.
This is Argos, my stateful simulation engine, rendered through H3 using Fal Director. Thanks to @fal for the generous credits helping me bring it to life.
Underneath the video is a persistent world: characters, objects, locations, and systems. The characters have their own cognition, memories, and goals. They choose actions; the simulation determines what actually happens.
Her phone has a location. Messages have delivery and read states. Typing a reply takes time. If I move the phone before she gets there, it’s gone—even if she remembers leaving it there.
Argos turns those changing world states into instructions for H3 to depict.
You can also see her character thought stream. The video currently trails the simulation a little; I’m working on aligning the two.
Next: connect this to SMS, so you can text someone inside the world and receive their reply. Or whisper an impulse into her thoughts and see whether she follows it.
The bigger ambition is a world that keeps growing while its characters inhabit it—with agents writing and maintaining the simulation’s systems.
I’ll be building more of this in public.
Not just a video that looks like a world. A world that keeps existing underneath the video.
Nick Matarese retweeted
✅ Papercut fixed: You can now toggle visible watermarks on or off in Gemini and Flow, with Search coming next.
This applies to watermarks on all images (Nano Banana), videos (Omni), and songs (Lyria) except in countries where it’s required by law to keep them.
Nick Matarese retweeted
I've been enjoying using Nano Banana 2 Lite. It lets me navigate lots of prompts and ideas very quickly. Faster results, faster iteration, faster exploration.
> a minimal flat animated scene of something neutral but interesting, a single character, pick an unusual animation style and palette
Nick Matarese retweeted
Google Flow now has access to Google Maps Street View.
Activate the Agent Mode, and prompt it to create an image based on an address in the US.
Google Flow will re-create the image, and then you can decide how to animate it.
Here's a quick tutorial:
🤖 Made with AI
Nick Matarese retweeted
We’re launching a research partnership with @A24 to ensure the tools of the future are shaped by the creators who use them. Excited to work with @scottbelsky and team! Find out more → goo.gle/3QwvgKq
Nick Matarese retweeted
Agents are powerful, and so is ffmpeg. Why not combine them? This Flow Tool allows you to use natural language to manipulate your media and save the results in seconds. @FlowbyGoogle @FFmpeg
ffmpeg -i my_video.mp4 -agent "turn this into a gif at 16 fps and 480p, and make sure it loops"
@FFmpeg when?
Nick Matarese retweeted
This just in: Gemini Omni is now available for everyone to try in Google Flow! 🥳
Earlier this week, we introduced Gemini Omni, our new model that lets you edit your videos using natural language (it’s like Nano Banana, but for video!). We have loved seeing your video edits so much that we are opening up access to everyone! If you are not a Google AI subscriber, you can still create two Omni videos free of charge each day.
Check out how we created this video with a one-shot prompt (🤯), and try it for yourself with Omni now.
labs.google/fx/tools/flow/sh…
🤖 Made with AI
Nick Matarese retweeted
I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world.
As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows.
If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it.
What do you think of Omni so far?
Nick Matarese retweeted
I uploaded a screenshot of Google Maps to Gemini Omni with a route drawn on it.
Then I prompted it to create a first person view of someone driving a taxi cab along the route in the reference image.
Pretty close to the real thing.
🤖 Made with AI
Nick Matarese retweeted
I've been testing Google's new Gemini Omni model in Google Flow.
I created a scene (using my character sheet), then asked Flow to change the time of day (nighttime), the render-type (animated), and the weather (snowscape).
The results are below. I think this is pretty great to be honest - the integrity
1: Original
2: Nighttime
3: 3D Render
4: Snowscape
Introducing your agent and the all-new Gemini Omni model in Google Flow. #GoogleIO
✨ Think of your agent as a creative partner. It reasons through complex tasks and helps you brainstorm, create, and edit, all while under your direction.
⚡ Gemini Omni is where Gemini’s intelligence meets our generative media models. Think of it as Nano Banana but for video. It is a major leap forward in world understanding, multimodality, and editing.
Try all the latest Google Flow updates from I/O today at flow.google.
Nick Matarese retweeted
We’re dropping Gemini Omni: our first step towards a model that can create anything from anything - starting with video.
It combines Gemini’s intelligence with our generative media systems - representing a leap forward in world understanding, multimodality, and editing 🧵
Nick Matarese retweeted
We’re reimagining a 50-year-old interface - the mouse pointer - with AI. 🖱️
These experimental demos show how people can intuitively direct Gemini on their screens using motion, speech, and natural shorthand to get things done 🧵
Nick Matarese retweeted
📣 📸 Calling all Snapseed users: Today, we’re rolling out Snapseed 4.0 on Android, bringing a new look and feel, and a bunch of new tools and capabilities. Here’s what’s new:
- We’ve completely updated the UI. In addition to making it more modern and fun, we’ve spent a lot of time focusing on changes that make editing faster, easier, and more powerful, all while staying true to Snapseed’s DNA
- We’ve added a number of new capabilities, including non destructive and batch editing, Snapseed camera, and smart masking
- We’ve introduced new tools including Color HSL, Dehaze, Halation, & Bloom
- We’ve also updated existing tools, like Film, which is now packed with new styles that emulate some of the most popular historical film stocks
⭐ And if you’re on iOS, you now have access to our new UI, Bloom & Halation tools, and More Faves! Download it today on the Google Play Store or Apple Store: 🔗🠛
Nick Matarese retweeted
Welcome to the family🌊! @googleflowmusic is our newest standalone music creation tool. Using natural language prompts you can turn your imagination into fully produced tracks.
Learn more below!
1/ A new era, a new name, and a new feature drop. 🚀
ProducerAI is officially "Google Flow Music"! We're still the same team, with the same mission: building tools that push the boundaries of human creativity.
To kick off this new chapter, we're launching new capabilities to give you more control over your tracks.
Let's dive in: 🧵👇