Almir retweeted
This iPad Pro + Thunderbolt R9700 is running Qwen3.8-27B at 158.5 tps.
Yes… an iPad.
The trick
🎮 32GB Radeon AI PRO R9700
🔌 Thunderbolt eGPU enclosure
📱 iPad Pro running LemonSeed Studio
🧠 Qwen3.8-27B Q4
📚 131K context
And the speed progression is kind of ridiculous
🐌 baseline → 31.2 tps
⚡ MTP3 → 108.7 tps
🚀 DFlash2 → 158.5 tps
Prefill:
📥 4K → 1,636 tps
📥 32K → 1,395 tps
LemonSeed actually runs the AMD GPU on iPadOS.
It embeds the upstream Linux amdgpu + amdkfd driver as an iPad PCIDriverKit extension, then runs its inference engine on the R9700.
Same engine for 🐧 Linux | 🍎 macOS | 📱 iPadOS
Same R9700 on macOS reaches 159.4 tps, so the iPadOS result is basically right there with the Mac.
⚠️ Obviously, the iPad's own GPU isn't doing the 159 tps.
The iPad is hosting a 32GB desktop AMD GPU over Thunderbolt.
🔗 Link in ALT.
ALT https://www.reddit.com/r/LocalLLaMA/comments/1x18e95/qwen3827b_159_toks_on_r9700_64_toks_on_strix_halo/
Almir retweeted
Introducing SubQ - a major breakthrough in LLM intelligence.
It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA),
And the first frontier model with a 12 million token context window which is:
- 52x faster than FlashAttention at 1MM tokens
- Less than 5% the cost of Opus
Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention).
Only a small fraction actually matter.
@subquadratic finds and focuses only on the ones that do.
That's nearly 1,000x less compute and a new way for LLMs to scale.
Almir retweeted
🚨 Minisforum AI X1 Pro Giveaway 🚨
Want to win the World’s No.1 Copilot Empowered AI Mini PC worth over $1,000? Here’s how to enter:
1️⃣ Follow @Hi_MINISFORUM
2️⃣ Like & Retweet this post
🔔 Don't forget to subscribe for the Launch Day Special $50 Coupon: s.minisforum.com/aix1pro
Enter now for a chance to supercharge your productivity and gaming! 💻🚀
#Minisforum #MinisforumAIX1Pro #AI #MiniPC #Giveaway
Almir retweeted
Absolutely cracking resource put together by @rasbt esp. liked this standalone notebook on Llama 3.2 architecture
github.com/rasbt/LLMs-from-s…
Almir retweeted
We are pleased to release the Adonis V5 August 2020 update! 🎉
⚡ Added Basic Authentication
⚡ Added bunch of Lucid helpers
⚡ Added way to trap Events
⚡ Migrated the Mail module
Learn more in our article!
🔗 preview.adonisjs.com/blog/au…
Here are some features' highlights
⬇
Almir retweeted
Centar za edukaciju Malac Genijalac Ilidža raspisuje konkurs za nastavnika/cu. bit.ly/3hObWlx
#malacgenijalac #ilidza #sarajevo
Almir retweeted
One of the best examples 🤯
#OnePlus8Pro Color Filter Camera can see through some plastic
Almir retweeted
Annnnd we have a winner! The functionality of the mask is 3 fold, it covers/protects your mouth, guarantees ppl will stay away from you and reminds everyone that if Ash the evil robot didn't break quarantine THE REST OF THE SHIP WOULD HAVE BE FINE! #MondayMorning #coronavirus
Almir retweeted
In South Korea 🇰🇷, the solar panels in the middle of the highway have a bicycle path underneath - cyclists are protected from the sun, isolated from traffic, and the country can produce clean energy. xitter.cf/UniverCurious/status/1…
Almir retweeted
Less than half a million have died from Corona!!!
It is a statistical insignificance.
630,000 people have died from the flu since Corona has been with us.
Why don't we lock ourselves in because if the flu?????
Wouldn't that make more sense?
Please ...
People!!!
Almir retweeted
New study says 'high temperature and high relative humidity significantly reduce' spread of COVID-19 kgw.com/article/weather/accu…
Almir retweeted
Using JavaScript & TensorFlow.js to remove people from backgrounds in real-time. Try bit.ly/tjfs-bg by @jason_mayes in your browser!
Almir retweeted
This is the complete DNA of the Coronavirus (SARS-CoV-2). We are being attacked by a 8 kilobytes virus. Remember this when you hate on computers security. (source: ncbi.nlm.nih.gov/nuccore/MN9… )
