
AI & Audio @UMG. Previously @tiktok_us @BandLab. ML & media tech. 🇲🇾 🇸🇬
Joined December 2011
- Tweets4.3K
- Following790
- Followers600
- Likes2.1K
Hao Hao Tan retweeted
What is an intuitive way to search in a music library? Tags? Captions? Chatbots?
We propose another paradigm: what if we could create a slider for *any* musical concept and use it to refine in real-time what we're looking for? 🎛
Work led by @Juj_Guinot, accepted at @ISMIRConf!
Happy to share our #ISMIR2026 paper on steerable music retrieval with sparse autoencoders 🎛️🎧
Dense retrieval is great at finding similar tracks,
But once you have a query, what if you want to modify one concept inside it?
More piano,
More intimate,
Less gritty.
1/n
SAE for music retrieval! By wonderful colleagues @UMG
Happy to share our #ISMIR2026 paper on steerable music retrieval with sparse autoencoders 🎛️🎧
Dense retrieval is great at finding similar tracks,
But once you have a query, what if you want to modify one concept inside it?
More piano,
More intimate,
Less gritty.
1/n
When two worlds collide - Uncle Roger in Fish Audio's launch!
$52M seed round. 15M+ users. But this is what we're most proud of yet.
Introducing Drama 3: the most emotive and controllable TTS model in the world
And yes, it's open-weight.
You can now control how even a single word should sound, change its tone, and shift your voice mid-sentence.
Uncle Roger was impressed too.
Try it here:
s.fish.audio/rqh0l8
Comment “DRAMA” within the next 48 hours for 1 month free.
If you're an enterprise your first month is on us:
s.fish.audio/qz9r0t
New paper at #ISMIR2026! We discover that simple latent transport across multiple neural codec spaces can perform bandwidth extension "on par" with much larger models! How can we make use of this interesting latent geometry? Do we still need gigantic deep models for BWE?
“On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs”
📄 Paper: arxiv.org/pdf/2608.03721
🎧 Audio examples: ismir26latentgeo.github.io
Joint work with Hendrik Vincent Koops & @elio_elioo
There is a real "unsustainable economics" problem in the creative industry. But the answer need not be AI slop. The worrying scenario now, is that AI slop floods WAY faster before careful thinking is done to figure out the right tools we should build.
economist.com/business/2026/…
Hao Hao Tan retweeted
Is autoresearch really better than classic hyperparameter tuning?
We did experiments comparing Optuna & autoresearch.
Autoresearch converges faster, is more cost-efficient, and even generalizes better: 🧵(1/6)
Hao Hao Tan retweeted
🌶️ Some (perhaps) spicy thoughts. It’s been a while since my last tweet, but I wanted to write about how disorienting it has been from academia to an LLM lab 😅
The kind of research I was trained to do during my PhD almost doesn’t exist here. The obsession with mathematical elegance and novelty is mostly gone. Everything is about scaling data and compute. For a while, that really got to me. At my lowest point, I felt like I’d lost interest in building LLMs altogether. I didn’t feel intellectually challenged anymore.
What made this even stranger was that, at a technical level, things worked. If there was a capability I wanted to teach a model, scaling the right data and compute always got me there, no exception (so far).
But recently, I found a way to reconcile with myself..
I realized the real competition isn’t in the ML recipe anymore. Most teams do roughly the same thing. What actually matters is how fast you can iterate, test ideas, and recover from mistakes. And that speed is mostly backed by infrastructure 🏗️ Faster loops, fewer bugs, better tooling.
Seeing this made me excited again! Infra is its own deep, hard, and intellectually fun problem space.
In 2026, I want to become an ML researcher who’s really good at infra. And I'll come back to ML problems with that edge, and will be excited to share what I find 😌
Malaysia now has her very own Chopin Competition prize winner! Vincent Ong from Penang won 5th prize in this very prestigious piano event 🎉
His performance in the third round was much applauded for his elegance and unique interpretation:
youtu.be/jN8y20xwVp4?si=bzxd…
If you are interested in `modulation extraction` for synth parameter inference (which most of the synth presets out there are modulated), do check out this work!
It's super wonderful to get to work with Christopher @frozenmango (finally!!)
Modulation Discovery with Differentiable Digital Signal Processing
This week I’ll be at @IEEE_WASPAA presenting our work on discovering synthesizer modulation signals in arbitrary audio.
arXiv: arxiv.org/abs/2510.06204
web: christhetr.ee/mod_discovery
@GoodGood014 @IntelSoundEng
Hao Hao Tan retweeted
We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers.
The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't.
Built a bunch of assistive tools to help musicians on BandLab create better with AI (Voice Changer, audio-to-MIDI, Recompose...)
The best part is to see them on "combo" - combining these tools into an actual workflow.
Check out the full suite here! bandlab.com/ai
Hao Hao Tan retweeted
torchlpc v0.7
* All kernels are rewritten in C++/CUDA
* New parallel scan kernel for CPU
* Running 1.2 to 2 times faster on GPU
* Return final delay values (aka `zf`)
See release notes for more details.
github.com/DiffAPF/torchlpc/…
Hao Hao Tan retweeted
I am pleased to announce a new version of my RL tutorial. Major update to the LLM chapter (eg DPO, GRPO, thinking), minor updates to the MARL and MBRL chapters and various sections (eg offline RL, DPG, etc). Enjoy!
arxiv.org/abs/2412.05265
An intuitive approach to understanding Flow Matching: youtube.com/watch?v=7cMzfkWF…
Hao Hao Tan retweeted
Wait…WHAT? Introducing Pikadditions, the easiest way to make your content stand out.
Add anyone or anything to any video, whether that’s a video you shoot yourself, or a favorite clip. Special surprise: get fifteen free Pikadditions generations when you sign up!
Go try it at pika dot art

















