Noah Constant retweeted
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.
MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.
Open weights. Open source inference engine. Suite of apps and plugins.
Hear what it can do and try it out for yourself below 🧵
Noah Constant retweeted
Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶
Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026.
We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license.
💾 Get it here: github.com/magenta/the-infin…
Noah Constant retweeted
Magenta is hiring student researchers for 2026!
We're looking for candidates to push the boundaries of interactive real-time music generation, such as the next generation of Lyria RealTime and Magenta RealTime models.
Follow instructions to apply here:
forms.gle/EAvTt1KLNqpVHx9h7
Noah Constant retweeted
We built a web app that lets you fly a spaceship through a 3D constellation of music - powered by our Lyria RealTime model. 🎶
Space DJ is an interactive visualization where every star represents a different music genre. As you explore, your path is translated into prompts for the API, creating a continuously evolving soundtrack. ↓
Noah Constant retweeted
Everyone talks about real-time AI for speech but sleeps on it for music
Real-time is nice to have for conversations, but essential for co-jamming
Noah Constant retweeted
Hours and hours of fun and inspiration.
Tiny excerpt:
youtube.com/shorts/53gmT8zaf…
Noah Constant retweeted
🔊 Easy to lose hours to live jamming w/ Magenta RT. Feels like a glimpse at something magical
Try it yourself! Some setup involved (we're working on improving that!) but worth it: g.co/magenta/rt-audio-inject…
Noah Constant retweeted
In 2018, we wrote a paper titled "the challenge of realistic music generation". A few years ago, this challenge was essentially solved: it is now a thing that exists🤯
Realtime is the next frontier, it opens up so many more possibilities. There's a tech report + open weights!🙏
Noah Constant retweeted
I’m happy to have donated my voice to this incredible new open model and instrument!
It is a new, active, approach to spawning music, made for real time jamming and exploration.
More like a sampler than a jukebox, you can fine tune it on your own sounds and soon run it locally!
We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain
Noah Constant retweeted
We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain
Noah Constant retweeted
Realtime interactive generative models FTW!
Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM!
* Live Jamming with audio input 🎤🎸🎵
* Personalize your own models 🔧
* Tech report 📜
Links below in the 🧵...
Noah Constant retweeted
New VST/AU Plugin! 🚨
Play with Lyria RealTime directly from inside your favorite DAW with “The Infinite Crate” 🎧🎶
Like other Lyria RT demos, you can mix together text prompts and other controls to steer the model in real-time. But now with a VST plugin you can feed audio directly into your DAW for sampling, live performance, or even a practice partner to jam with.
💾 Get it here: g.co/magenta/infinite-crate
Noah Constant retweeted
We’ve just released Magenta RealTime, an open-weights live music model that lets you craft sounds in real time by exploring the latent space through text and audio!
🤗 Model: huggingface.co/google/magent……
🧑💻Code: github.com/magenta/magenta-r…
📝Blog post: magenta.withgoogle.com/magen…
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi…
👀 Blog post: g.co/magenta/rt
🧵 below
Noah Constant retweeted
🎸🥁🎹🎵 New open weights music model from Magenta for real-time generation. Excited to see what cool instruments you all can make with it 🙂
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi…
👀 Blog post: g.co/magenta/rt
🧵 below
Noah Constant retweeted
Introducing Magenta RealTime, our open weights live music model!
Like Lyria RealTime, this model provides the user continuous control of the musical flow 🌊.
We will be sharing some of our favorite ways to extend these models over the next few weeks. Can't wait to see what you do!
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi…
👀 Blog post: g.co/magenta/rt
🧵 below
Noah Constant retweeted
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi…
👀 Blog post: g.co/magenta/rt
🧵 below
Noah Constant retweeted
On the occasion of returning to Magenta's roots at @sonarplusd, we're dusting off the blog to share news and insights about what we're working on at @GoogleDeepMind on the Lyria Team.
g.co/magenta/lyria-realtime
Our latest post is about the Lyria RealTime API, providing access to our "live music model" that powers MusicFX DJ. Lyria RealTime enables unprecedented interactivity with a generative audio model for music, and has been stretching our imagination with the ways it can be integrated into physical and virtual instruments, spaces, and applications.
We've included a few open source interfaces for you to fork and build with, including the one @ToroyMoi used during the I/O preshow controlled by a MIDI Fighter. We are so excited to see what you will do with the technology yourself.
Enjoy!
Noah Constant retweeted
Pleasantly surprised with how easy/fun it is to "vibe code" new musical experiences in AI Studio.
I'm not much of a JS guy, but had Gemini help me make a "Kaoss Pad" emulator using the Lyria RealTime API to explore musical latent spaces in realtime.
Noah Constant retweeted
Excited to release a tool that makes the joy of live music creation more accessible 🎸 “Music FX DJ” is new and improved: g.co/labs/musicfx-dj
Featuring a whole suite of new controls, sharing and remix features, and improved audio quality and diversity of outputs, to let you blend and warp genres and instruments in an ever evolving stream of music.
It’s been an absolute pleasure to work with @jacobcollier over the past year on this. It was very affirming to find him pushing for the same things @GoogleMagenta has always valued: making tools that intrinsically value creativity and agency over just imitation, embrace the “weird corners” of AI, encouraging veterans to express themselves in new ways, while empowering novices to express themselves musically maybe for the first time.
Read details at: goo.gle/4eTg28Z
And in the 🧵 below…
Noah Constant retweeted
I’m so proud of the updated version of #MusicFXDJ we developed in collaboration with @jacobcollier, available today at labs.google/musicfx.
Over the past year I’ve spent countless hours experimenting with our real-time music models, and it feels like I’ve learned to play a new type of instrument, in the spirit of what we started @GoogleMagenta to achieve.
It was validating to hear Jacob echo these sentiments the first time he played an early version. With his help, we’ve added new controls, raising the ceiling on what players are able to do with it.
Now anyone can experiment with this new instrument and share what they create with the world.
I'll start things off with my most recent jam session...
It’s here! Thrilled to collab with @jacobcollier on our latest #LabSession exploring the magical possibilities of generative music and #MusicFXDJ. Watch full video: youtu.be/y7gKlzvg8xk
Tune in 10/24 at 5 PM ET as Jacob livestreams a MusicFX DJ sesh on his YT channel.