Doing ML Web - https://xitter.cf/t.co/yxKAwSSkgR Substack - https://xitter.cf/t.co/W9Qg4M3AZg

Joined October 2008
XTTS is still being downloaded almost 5m times every month and 2.1m only on HF. It is greater than many recent hyped models. Hope people use it well for that to worth to my burnout that I’m still recovering from. Coqui has been one of the most successful broke startups
14
10
1
113
4,997
Ming-3.0-tts: open weights, MIT. #1 overall on Artificial Analysis Pronunciation Robustness. LM → DiT flow head → continuous 12.5Hz latents. No discrete tokens. 44.1kHz. 0.5B dense + 7.9B MoE (1.3B active). 7 languages. 14 paralinguistic tags. github.com/inclusionAI/Ming-…
1
12
503
Fish Speech Drama 3 deep dive: 35.9B open-weight MoE TTS, ~3B active. 7.8x the size of Fish S2, yet faster: 271 vs 177 frames/s on one H200. Why: 6.0 GB of weight reads per frame vs 15.6 GB. 13 serial layer passes after the backbone vs 40. erogol.substack.com/p/fish-a…
3
17
1,466
🪗 Your Transformer Is Secretly Elastic 🧵👇 Transformer families come in a few fixed sizes, so you commit to one for your hardware and latency constraints, even as query loads vary. What if a single pre-trained model could serve every budget? We learn one importance ranking over every MLP neuron and attention head, once, with frozen weights. At inference time, the model can then be pruned to any computational budget by dropping its least important units, without retraining. Across 27 vision and text encoders spanning 22M to 8B parameters, performance degrades smoothly up to 60% sparsity. For example, pruning DINOv3 ViT-H+/16 to 50% sparsity removes 427M parameters, for only a 0.8% drop in ImageNet-1k linear probing. Super fun project in collaboration with Dheeraj Varghese (@dhevarghese), supervised by Gertjan J. Burghouts (@gjburghouts) and Cees Snoek (@cgmsnoek) 🌐 Project page: secretly-elastic.ashita.nl
3
16
2
39
2,541
Models are terrible at planning. Ask a model to plan something you don't fully understand, and it over-specs every time. Adding more models on top makes it worse. The only thing that works: you write the plan. The model follows it exactly.
1
226
Machine Learns - 79 🤖 • Diffuplex: diffusion LM, full-duplex speech • Audio token attention, predicted before the LM • UltraBERT: encoders saturate at 1-2T tokens • Looped DiT • Level-of-Token Diffusion • VISTA • EmbeddingGemma 2, Clef, PixelUMM erogol.substack.com/p/machin…
2
27
1,530
Drama 3: open-weight 35B MoE TTS. 16 speakers, full scenes in one pass. 3B active, hybrid linear attention. Codebook-MTP decoder, 10 causal codebooks. Voice cloning, emotion tags, edit-as-continuation. 89ms TTFA. 71 languages. SGLang-Omni day one. huggingface.co/fishaudio/dra…
3
15
692
Germany needs 24 years for 151 km of track. In the same time, the US plans to put datacenters in orbit and land on Mars.
Great news! Deutsche Bahn will build an additional rail line for the 151 kilometers from Hannover to Hamburg. It will be finished by...wait for it...2050!
1
1
170
erogol retweeted
🧭 New model: Typed Decision, built on EmbeddingGemma 2 Give it a state + any schema of questions → typed, calibrated answers (choice · score · noul). No text generation, no output parsing. 76.4% on typed-decisions, ~6 pts behind a 27B LLM with ~100× fewer params. 🤗 huggingface.co/mrm8488/embed…
21
87
6
769
48,452
Die Bundesregierung hat heute deutlich steigende Sozialabgaben für sog. Gutverdiener beschlossen. Bedeutet konkret an einem Beispiel: Steuerklasse 1, 80.000 Euro Jahresgehalt, zahlt ab 2027 jeden Monat ca. 120 Euro mehr in die Sozialkassen ein. Macht aufs Jahr 1.440 Euro weniger Nettogehalt durch steigende Sozialabgaben. On top kommen noch die Arbeitgeberanteile, die faktisch ebenfalls die Sozialabgaben des Gutverdieners sind. Leistung wird in Deutschland konsequent bestraft. Wir knacken 2026 die 300.000 Auswanderer.
102
277
12
3,177
107,947
Germany now taxes income above €280K at 47%. With the new German tax reform: Work for your money → up to 47%. Inherit your money → largely exempt. Own assets → flat ~26%. They named it a tax on the super rich. A doctor pays more than a heir. That is the plan.
Wir setzen mit der Einkommensteuer klare Schwerpunkte: Familien und Menschen mit kleinen und mittleren Einkommen werden damit mehr Geld in der Tasche haben. Um das zu finanzieren, wird die Reichensteuer künftig früher greifen und eine Superreichensteuer ab 280.000 € eingeführt.
1
183
made to neurips thanks to open-source :)
NEW paper at #Neurips 2026! We cloned the voices of non-native English speakers (n=86) with ElevenLabs, Coqui-XTTS and ChatterBox. In 4,000 human ratings, the clones sounded warmer, more authoritative, and even more *humanlike* than the real speakers. Listeners also said they would trust the clones more.
20
1,334
Gemma embedding 2 is the best model I’ve tried for agentic tasks and memory search. It easily runs on cpu and it is awesome.
1
1
11
597
pretty cool work.
Backprop has been the only credit assignment algorithm capable of training large neural nets. Introducing Dust, the first zeroth-order method to pretrain transformers to approach and sometimes even *exceed* backprop with large amounts of computation (bitter lesson!) - Dust is on the order of 1,000 to 10,000x more compute efficient than EGGROLL, the state-of-the-art ES method, for training transformers. - We chose pretraining transformers because it's arguably the hardest task possible for zeroth-order optimization. - Search in high dimensions is really misunderstood: zeroth-order usually gets better with overparameterization, not worse, i.e. at a fixed population size, larger models (up to 120x) reach a lower loss than smaller ones. - Backprop-like gradients emerge from a large population of activation perturbations, and the alignment holds up at every scale we tested, up to 1B tokens, which is critical for scaling. The core idea is a *virtual population*, which helps scale to large populations in transformers by perturbing activations in parallel. w/ @bishmdl76, @cs_serdar, @akshayvegesna
2
242
Machine Learns - 78 🤖 • Our Interspeech paper: learnable CFG nulls for TTS • ROFT: self-reflection beats GRPO • Self-Play Pretraining, zero data • Agensh: 1,024 coding agents • EditVoice • FLUX 3 Action • MiMo-V2.6 erogol.substack.com/p/machin…
1
10
583
YODAS v3: 1.1M hours of open speech, 100+ languages, CC BY 3.0. Largest open speech dataset to date. All 48kHz. >92% truly ≥32kHz. >70% real multi-channel, not dual-mono. Open data for TTS, codecs and spatial speech. Word timestamps. 60TB OPUS. huggingface.co/datasets/espn…
1
6
1
45
1,926
wow gemini v4 coming strong
1
168
Here I went over the DeepSeek v4.1-Flash and its innovative model architecture optimized for agentic and coding tasks where the compute is dominated by the prefill erogol.substack.com/p/deepse…
3
245
Machine Learns - 77 🤖 • Sliding-window beats linear attention • What Does Context Compression Cost an Agent? • Switch Distillation • Recirculation • Speech codecs trained for predictability • Qwen3.8-Flash-Next, AuK, VibeVoice-ASR-Streaming erogol.substack.com/p/machin…
1
1
4
207