Systems Engineer, developer, self-hosted AI enthusiast, 3D printer hacker, musician, skier/rock climber, #doodledad! (he/him) @pdscomp@dmv.community
Greenbelt, MD
Joined February 2009
- Tweets3.9K
- Following459
- Followers187
- Likes858
This is insane. Qwen3.5-27B-UD-Q4_K_XL. RTX 3090. TurboQuant llama.cpp CUDA fork from @spiritbuun, 256k context using turbo3. Stable ~33t/s! ~35t/s on Q4_K_M with less VRAM usage! cc: @sudoingX Total VRAM usage during inference:
Paul Swenson retweeted
I implemented Google's TurboQuant paper (ICLR 2026) in llama.cpp with Metal kernels for Apple Silicon.
4.9× KV cache compression. Working end-to-end on M5 Max with Qwen 3.5 35B MoE and Qwopus v2 27B.
Speed needs work (unoptimized shader), compression target met.
Repo: github.com/TheTom/turboquant…
**Note**: as you'll see from the git when I saw "I" it's in conjunction with claudecode and codex. Just lots of steering and babysitting.
Paul Swenson retweeted
I’m gonna giveaway a spool of @Polymaker_3D filament to a random person who retweets this!
Go!
Paul Swenson retweeted
The Moon really was throwing shade on April 8th. 🌝
Even NASA’s Lunar Reconnaissance Orbiter (LRO) noticed from 223,000 miles away!
LRO captured this image of the Moon’s shadow on Earth’s surface during the total solar eclipse last Monday, April 8: go.nasa.gov/3xz3va1
ALT Black and white image of Earth with swirling white clouds and a dark shadow over the lower left portion of the planet from the Moon eclipsing the Sun.
Paul Swenson retweeted
Ladies if
- you never quite know exactly where he is
- he holds steady in rough waters
- he reminds you to read the instructions, but of course still loves you anyway
- you know he'll always carry you back home
He's not your man, he's a SpaceX droneship
Paul Swenson retweeted
Don't trust big decisions to just any network. You deserve 5G that rocks 🤘 — Largest 5G network. Fastest 5G speeds. #LeaderIn5G
RT for a shot at a Samsung Galaxy S21+ 5G! The fastest 5G network meets the fastest 5G Galaxy device! #Sweepstakes
Rules bit.ly/3cFN13I
❤️
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
NASA and SpaceX are splashing down with Astronauts today for the first time in 45 years! Go Bob and Doug! #GoNASA! #GoSpaceX!
Catch this exciting event live on NASA TV starting at 1:51 PM ET (splashdown at 2:48 PM ET): youtu.be/H-l6f4wcv2I
Made a new #ButterflyFriend after smoking a few racks of ribs!!! #Autumn #IThink #Traeger #Ribs instagram.com/p/B2Hj4NbnVAK/…
Visiting the Eagles Nest, Bavarian Alps, Germany. Such a beautiful location! #EaglesNest #Bavaria #germany🇩🇪 @ Kehlsteinhaus - Eagles Nest instagram.com/p/B13L-0JBxhm/… – at Berchtesgadener Land, gemeindefreies Gebiet, Deutschland
Happy 4th of July from the snowy slopes of Valle Nevado, Chile! Celebrated an amazing 4th with some great people! #piscotoast #4thofjuly #chile #eclipse #americasur #winterinjuly @ Valle Nevado - Ski Resort Chile instagram.com/p/BzhBJVlhUHO/… – at Vitacura, Chile
This guy knows how to rock Snapchat filters! #Evanescence #SpiritAnimal #FaceSwap #RockingOut cc:@aballantine555 instagram.com/tv/BxklLSkhrNp…