Frontier Models On Device

Palo Alto, CA
Joined November 2023
argmax retweeted
I wish my first internship were this productive! Here is our second @argmax intern who killed it this summer:
Voice-cloning models are evaluated and marketed with their substantially high speaker similarity scores, but would this impression of fidelity be challenged if we listened to the generated audios and saw for ourselves?
1
9
1,380
argmax retweeted
Our interns @argmax built a groundbreaking harness for open-weight TTS models! Check out @RmdW_W's explainer thread below:
Rongxiang Wang
@RmdW_WSep 21
Open-weight TTS models can look remarkably close to the best closed-weight models on benchmarks and demos. But are they reliable enough to actually replace them? We stress-test Qwen3-TTS and VoxCPM2 in real-world scenarios, uncover reliability failures that standard evaluations miss, and develop an inference harness that eliminates the reliability gap. 🧵
1
1
37
4,487
argmax retweeted
We have been building an iOS app in stealth and we just hit private beta today! > Life-like voices running on your iPhone > Listen to anything: Books, PDFs, articles, emails... > Works offline as you commute or travel Beta testers who submit feedback will get a free lifetime license. DM me if you want an invite.
9
8
2
55
7,515
argmax retweeted
This work has been accepted at Interspeech 2026! Come visit the @argmax booth in Sydney this September to learn about our other advancements in speech and speaker recognition.
This is what context does to your speech-to-text system! Our new paper studies the impact of contextual information on the accuracy of leading open-source and proprietary systems.
1
2
14
1,722
argmax retweeted
This is what context does to your speech-to-text system! Our new paper studies the impact of contextual information on the accuracy of leading open-source and proprietary systems.
2
5
2
29
4,754
argmax retweeted
On-device inference is not limited to one model at a time, but orchestration is critical! Here is a concurrency load test for running 4 leading models in real-time totalling 3 billion parameters on Apple Neural Engine: - Qwen3-TTS (1.7b) - Parakeet v2 (0.6b) - Canary v2 (0.6b) - Sortformer (0.1b)
9
19
1
184
12,593
argmax retweeted
Introducing Real-time Transcription with Speakers! - Step change in accuracy, surpassing top cloud APIs - Faster than real-time on Mac and iPhone - Still under 3 watts when all features are enabled Available in Argmax SDK 2.0 for early access! Benchmarks and details in comments.
4
18
6
201
72,989
argmax retweeted
Join us in SF this Wednesday for a Founders panel on real-time real-world ASR. I will also do a pre-release demo of @argmax's next major product!
Voice is becoming the most powerful interface for AI — but real-world issues can still break today's agents. Join founders from @ai_coustics, @covaldev, @argmax, and @livekit for The Audio Layer, a deep dive into making voice systems reliable in the real world. Dec 10 • 6–9 PM • Frontier Tower SF RSVP: luma.com/the-audio-layer
2
2
9
1,414
argmax retweeted
First day vibe checks for customizable speech-to-text are very encouraging!! Already building v2. Keep the feedback and feature requests coming! Current v2 plan is in comments.
Introducing Custom Vocabulary in Argmax Pro SDK Customize speech-to-text with contextual keywords at runtime to surpass the accuracy of generic frontier speech models! You can try it on @superwhisper and @argmax Playground today. More demos and details in comments.
1
2
9
1,893
In 2021, I wrote about where I thought speech recognition was going through to the 2030 decade. So far @argmax is making 2/5 of the predictions a reality (on-device and personalization). I still strongly believe in context and personalization, not just for speech-to-text but for LLMs / other modalities as well.
Introducing Custom Vocabulary in Argmax Pro SDK Customize speech-to-text with contextual keywords at runtime to surpass the accuracy of generic frontier speech models! You can try it on @superwhisper and @argmax Playground today. More demos and details in comments.
3
2
2
77
15,914
argmax retweeted
New iPhone A19 Pro chip brings 3x AI inference compute! We will benchmark how energy efficient it is compared to the Neural Engine when new iPhones go on sale.
3
10
3
100
11,548
argmax retweeted
My @icmlconf talk is live now! WhisperKit: On-device Real-time ASR with Billion-Scale Transformers icml.cc/virtual/2025/47854 Tune in to hear about why we built an on-device system with 7W to outperform cloud-based systems with 700W
Going to @icmlconf and want to learn about the frontiers of on-device AI? Catch my talk on July 18 after @DAlistarh and before @songhan_mit! I will discuss the secret sauce and benchmarks behind how @argmax built WhisperKit to outmatch several top cloud providers for real-time transcription without Nvidia GPUs.
1
2
1
18
1,508
argmax retweeted
on-device ai deep researching on-device ai:
Been experimenting with gpt-oss:20b locally on my M1 Max and pit it against Gemini 2.5 Pro on the same type of deep research question I often explore: 'How does @macwhisperapp’s speaker detection actually work?' Not surprisingly, the tiny gpt-oss punches way above its weight. ↓
1
1
11
1,874
argmax retweeted
Apologies for breaking @superwhisper with too fast inference @neilsuperduper.. We are adding a throttle in the next @argmax SDK release😇
the tide is shifting to local models.
1
17
1,480
argmax retweeted
Replying to @superwhisper
@superwhisper's local speech-to-text models have ~150 ms latency with the @argmax backend but cloud LLM models for post-processing were adding huge latency on top. Thanks for reducing it @rauchg!
It's been fun collaborating with @superwhisper, a blazing fast AI speech-to-text app, with support for local and cloud models. By putting @vercel CDN in front of their model API, they're seeing up to 350ms gains in some geos 🤯 To be clear, this is 350ms+ faster by *just* putting a proxy in front backed by our global network. They haven't even replicated their db / compute yet! It's free real estate. When we talk about 'fast data/origin transfer', this is what we mean. We partnered with @awscloud to back vercel with a fully redundant 400 GbE fiber network backbone. No noisy neighbors, top notch security, no last-mile unexpected rerouting, no free-tier throttling, no enterprise-only POPs or TCP optimizations, no Telekom peering issues…
1
1
11
1,152
argmax retweeted
It is raining speech models today!! @NVIDIAAI also quietly reclaimed the lead on the OpenASR leaderboard:
Introducing the world's best (and open) speech recognition models!
2
1
33
3,100
argmax retweeted
Going to @icmlconf and want to learn about the frontiers of on-device AI? Catch my talk on July 18 after @DAlistarh and before @songhan_mit! I will discuss the secret sauce and benchmarks behind how @argmax built WhisperKit to outmatch several top cloud providers for real-time transcription without Nvidia GPUs.
1
3
1
20
2,674
MacWhisper now supports Nvidia's Parakeet models. 🏆 Second highest accuracy on the leaderboards 🚀 Up to 300x realtime speeds 💻 All ran locally on your Mac Watch the video below where we transcribe and diarise a 30 minute podcast in 8 seconds. Give it a try and let us know!
31
41
9
365
43,259
Is on-device the new server-side inference? 👨‍🍳🔜 @codevapor
1
2
20
1,050