Pinned Tweet
XTTS is still being downloaded almost 5m times every month and 2.1m only on HF.
It is greater than many recent hyped models.
Hope people use it well for that to worth to my burnout that I’m still recovering from.
Coqui has been one of the most successful broke startups
Ming-3.0-tts: open weights, MIT. #1 overall on Artificial Analysis Pronunciation Robustness.
LM → DiT flow head → continuous 12.5Hz latents. No discrete tokens. 44.1kHz.
0.5B dense + 7.9B MoE (1.3B active). 7 languages. 14 paralinguistic tags.
github.com/inclusionAI/Ming-…
Fish Speech Drama 3 deep dive: 35.9B open-weight MoE TTS, ~3B active. 7.8x the size of Fish S2, yet faster: 271 vs 177 frames/s on one H200.
Why: 6.0 GB of weight reads per frame vs 15.6 GB. 13 serial layer passes after the backbone vs 40.
erogol.substack.com/p/fish-a…
erogol retweeted
🪗 Your Transformer Is Secretly Elastic 🧵👇
Transformer families come in a few fixed sizes, so you commit to one for your hardware and latency constraints, even as query loads vary. What if a single pre-trained model could serve every budget?
We learn one importance ranking over every MLP neuron and attention head, once, with frozen weights. At inference time, the model can then be pruned to any computational budget by dropping its least important units, without retraining.
Across 27 vision and text encoders spanning 22M to 8B parameters, performance degrades smoothly up to 60% sparsity. For example, pruning DINOv3 ViT-H+/16 to 50% sparsity removes 427M parameters, for only a 0.8% drop in ImageNet-1k linear probing.
Super fun project in collaboration with Dheeraj Varghese (@dhevarghese), supervised by Gertjan J. Burghouts (@gjburghouts) and Cees Snoek (@cgmsnoek)
🌐 Project page: secretly-elastic.ashita.nl
Machine Learns - 79 🤖
• Diffuplex: diffusion LM, full-duplex speech
• Audio token attention, predicted before the LM
• UltraBERT: encoders saturate at 1-2T tokens
• Looped DiT
• Level-of-Token Diffusion
• VISTA
• EmbeddingGemma 2, Clef, PixelUMM
erogol.substack.com/p/machin…
Drama 3: open-weight 35B MoE TTS. 16 speakers, full scenes in one pass.
3B active, hybrid linear attention. Codebook-MTP decoder, 10 causal codebooks. Voice cloning, emotion tags, edit-as-continuation.
89ms TTFA. 71 languages. SGLang-Omni day one.
huggingface.co/fishaudio/dra…
erogol retweeted
🧭 New model: Typed Decision, built on EmbeddingGemma 2
Give it a state + any schema of questions → typed, calibrated answers (choice · score · noul). No text generation, no output parsing.
76.4% on typed-decisions, ~6 pts behind a 27B LLM with ~100× fewer params.
🤗 huggingface.co/mrm8488/embed…
erogol retweeted
Die Bundesregierung hat heute deutlich steigende Sozialabgaben für sog. Gutverdiener beschlossen.
Bedeutet konkret an einem Beispiel: Steuerklasse 1, 80.000 Euro Jahresgehalt, zahlt ab 2027 jeden Monat ca. 120 Euro mehr in die Sozialkassen ein.
Macht aufs Jahr 1.440 Euro weniger Nettogehalt durch steigende Sozialabgaben. On top kommen noch die Arbeitgeberanteile, die faktisch ebenfalls die Sozialabgaben des Gutverdieners sind.
Leistung wird in Deutschland konsequent bestraft. Wir knacken 2026 die 300.000 Auswanderer.
Germany now taxes income above €280K at 47%.
With the new German tax reform:
Work for your money → up to 47%.
Inherit your money → largely exempt.
Own assets → flat ~26%.
They named it a tax on the super rich. A doctor pays more than a heir. That is the plan.
made to neurips thanks to open-source :)
NEW paper at #Neurips 2026!
We cloned the voices of non-native English speakers (n=86) with ElevenLabs, Coqui-XTTS and ChatterBox.
In 4,000 human ratings, the clones sounded warmer, more authoritative, and even more *humanlike* than the real speakers.
Listeners also said they would trust the clones more.
pretty cool work.
Backprop has been the only credit assignment algorithm capable of training large neural nets.
Introducing Dust, the first zeroth-order method to pretrain transformers to approach and sometimes even *exceed* backprop with large amounts of computation (bitter lesson!)
- Dust is on the order of 1,000 to 10,000x more compute efficient than EGGROLL, the state-of-the-art ES method, for training transformers.
- We chose pretraining transformers because it's arguably the hardest task possible for zeroth-order optimization.
- Search in high dimensions is really misunderstood: zeroth-order usually gets better with overparameterization, not worse, i.e. at a fixed population size, larger models (up to 120x) reach a lower loss than smaller ones.
- Backprop-like gradients emerge from a large population of activation perturbations, and the alignment holds up at every scale we tested, up to 1B tokens, which is critical for scaling.
The core idea is a *virtual population*, which helps scale to large populations in transformers by perturbing activations in parallel.
w/ @bishmdl76, @cs_serdar, @akshayvegesna
erogol retweeted
NTTから音声MOS関連の論文を2本リリース!アツい🔥
arxiv.org/abs/2609.39028
arxiv.org/abs/2609.39032
Machine Learns - 78 🤖
• Our Interspeech paper: learnable CFG nulls for TTS
• ROFT: self-reflection beats GRPO
• Self-Play Pretraining, zero data
• Agensh: 1,024 coding agents
• EditVoice
• FLUX 3 Action
• MiMo-V2.6
erogol.substack.com/p/machin…
YODAS v3: 1.1M hours of open speech, 100+ languages, CC BY 3.0. Largest open speech dataset to date.
All 48kHz. >92% truly ≥32kHz. >70% real multi-channel, not dual-mono. Open data for TTS, codecs and spatial speech.
Word timestamps. 60TB OPUS.
huggingface.co/datasets/espn…
I’ve done some benchmarks but this did not show any savings due to invalidated prompt caching all the time.
Am I missing something ?
engineering.atspotify.com/20…
Here I went over the DeepSeek v4.1-Flash and its innovative model architecture optimized for agentic and coding tasks where the compute is dominated by the prefill
erogol.substack.com/p/deepse…
Machine Learns - 77 🤖
• Sliding-window beats linear attention
• What Does Context Compression Cost an Agent?
• Switch Distillation
• Recirculation
• Speech codecs trained for predictability
• Qwen3.8-Flash-Next, AuK, VibeVoice-ASR-Streaming
erogol.substack.com/p/machin…












