CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering https://xitter.cf/t.co/9oqvHuTX5f | 🔔 Follow for AI & Vibe Coding Tips 👇

PNW
Joined July 2023
David Hendrickson retweeted
🤯 So you can actually get a 100K context & ~50 tps on one 16GB GPU. Putting Qwen3.8-27B onto an RTX 4070 Ti super is the kind of localmaxxing I ❤️ to hear about. Recipe 👇 🧠 Qwen3.8-27B 🎮 RTX 4070 Ti SUPER — 16GB 📚 100,000-token context ⚡ 47–50 tok/s 💾 15.93GB VRAM This recipe stacks several optimizations: ✧ 13.5GB hybrid GGUF → attention stays IQ4_XS → FFNs compressed to IQ3_S ✧ BeeLlama.cpp instead of stock llama.cpp ✧ KVarN compressed KV cache → K = kvarn5 → V = kvarn4 ✧ Last 1,024 KV tokens kept at higher precision ✧ MTP-2 speculative decoding Changing the KV cache from kvarn5/kvarn5 → kvarn5/kvarn4 alone reportedly freed another ~6% VRAM and pushed context from 88K → 100K. 🎯 So this is what they did … Weights → selectively quantized. KV cache → selectively compressed. Recent context → kept high precision. Decode → speculated. ⚠️ This uses BeeLlama.cpp, a llama.cpp fork, not stock llama.cpp/LM Studio, and the 47–50 tps number is a community report. Links 👇 🔗 Reddit r/LocalLLaMA/comments/1w1lq7u/qwen_38_27b_at_50_toks_with_100k_context_on_a/
20
60
7
674
43,614
David Hendrickson retweeted
I published my analysis of Qwen3.8 27B and Muse Glimmer xhigh mode: Accuracy, Token Efficiency, and Memory Use kaitchup.substack.com/p/qwen… The most surprising result: Qwen3.8 27B xhigh is much more token-efficient than Qwen3.6 for most non-agentic tasks. So, the community feedback, "Qwen3.8 27B thinks too much," might only apply to agentic tasks. My agentic benchmarks are running: Claude Code vs mini-swe-agent vs pi, low/medium/xhigh Large evals Hopefully, I'll have all the results by next week. Thank you @verdacloud for the compute sponsorship!
13
11
1
131
9,203
David Hendrickson retweeted
I've been waiting to see if the LLMs are able to master the IQ test (non-training data) over repeated attempts. Yes, they have. I've never seen this before. Does this convinced you LLMs are AGI (score better than 99% of humans)? Or has the Overton window moved?
3
1
1
12
4,149
David Hendrickson retweeted
New: one-click ZDR (zero-data retention) in the Chatroom Compare models side-by-side with full privacy: openrouter.ai/chat
2
3
82
9,457
David Hendrickson retweeted
Anthropic
@AnthropicAIJul 1
Claude Fable 5 will be available again globally tomorrow. After a series of productive conversations with the US government, we're redeploying the model with a new set of classifiers to target and block more cybersecurity tasks. In the near term, some routine tasks like coding and debugging will fall back to Opus 4.8. We’ll continue to refine these classifiers over the coming weeks to reduce false positives and better distinguish genuine misuse from legitimate requests. We’ve also begun drafting a consensus framework—with Amazon, Microsoft, Google, and other Glasswing partners—for assessing the severity of AI jailbreaks and how AI developers should respond to them. We invite other industry partners and model providers to join us in this effort. Finally, we’re scaling up our collaboration with the US government on model testing and safeguards. This will include pre-release access to models and safeguards for evaluation, information sharing on jailbreaks and misuse, and dedicated resources for joint research. Thank you to our users for your patience, and to our partners across the government, industry, and the research community who worked alongside us to make Fable 5 available again. Read our full blog: anthropic.com/news/redeployi…
3,503
6,379
4,278
42,786
15,739,155
David Hendrickson retweeted
zerohedge
@zerohedgeJun 25
"the share of tokens used for US models on OpenRouter has collapsed": Bloomberg
167
497
151
3,750
613,058
David Hendrickson retweeted
Qwen
@Alibaba_QwenMay 27
🚀🚀
Qwen 3.7 Max is now supported in Hermes Agent
20
26
2
582
89,388
David Hendrickson retweeted
🚀 Localmaxxers, run Qwen3.6-27B in your browser! 100% WebGPU • Fully Local • Zero Cloud Localmaxxers just got their biggest browser flex yet. 😎 Posted by @ngxson (Hugging Face) 🧪 27B parameters 📦 Q2_K_XL GGUF (~11.2 GB) via wllama 🖥️ Runs entirely in-browser on WebGPU 📱 Apple M5 Max: 97% GPU utilization No server. No telemetry. Pure client-side inference.
Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁
6
20
3
153
25,053
David Hendrickson retweeted
ok its not the most important thing we've ever done but i find it more useful than it seems on the surface. check out pets in codex! (and try hatching one)
596
98
79
4,129
549,078
David Hendrickson retweeted
🚨 Musk's lawyers just showed the jury the most damaging document in evidence on Brockman: November 2017 Brockman writes in his private diary: >"the true answer is that we want [musk] out... if three months later we're doing b-corp then it was a lie" >“can’t see us turning this into a for-profit without a nasty fight. i’m just thinking about the office and we’re in the office and his story will correctly be that we weren’t honest with him in the end about still wanting to do for profit just without him” January 1, 2018 Brockman emails Musk: >"it's an honor to work alongside you. every meeting with you, i continue to learn, grow, and see the world in a new way" Brockman was planning to oust OpenAI co-founder Musk while publicly thanking him for the privilege of working alongside him.
395
1,829
226
13,070
1,771,962
David Hendrickson retweeted
openai is already teasing with gpt-5.6 so if you checked the internal codex logs to verify which model was being used, and you found the rollout mapping most calls were routed to gpt-5.5, but one entry appears to show gpt-5.6, which means the codex environment may have had access to a rollout entry labeled
67
66
46
1,273
245,395
David Hendrickson retweeted
DeepSeek v4 is now the #1 open-weight model on our Vibe Code Benchmark, and it’s not close. It leaves the #2 (Kimi K2.6) in the dust, and even beats out frontier closed source models like Gemini 3.1 Pro.
58
236
60
2,464
244,154
David Hendrickson retweeted
TPU’s are a core part of the Google secret sauce, excited to see our 8th generation TPU see the light of day : )
63
76
13
1,586
113,185
David Hendrickson retweeted
GPT-5.5 or GPT-Spud, @OpenAI's most powerful AI to compete with @AnthropicAI's Mythos, to release next week (Thursday April 23rd).
3
2
1
34
2,120
David Hendrickson retweeted
OpenClaw 2026.4.14 🦞 More reliability updates: ✨ Smarter GPT-5.4 routing and recovery 🌐 Chrome/CDP improvements 🧵 Subagents no longer get stuck 💬 Slack/Telegram/Discord fixes ⚡️ Various performance improvements Was sleeping, and we still shipped. github.com/openclaw/openclaw…
240
195
107
1,934
448,253
David Hendrickson retweeted
My dear front-end developers (and anyone who’s interested in the future of interfaces): I have crawled through depths of hell to bring you, for the foreseeable years, one of the more important foundational pieces of UI engineering (if not in implementation then certainly at least in concept): Fast, accurate and comprehensive userland text measurement algorithm in pure TypeScript, usable for laying out entire web pages without CSS, bypassing DOM measurements and reflow
1,314
8,011
2,662
64,473
24,590,340
David Hendrickson retweeted
I’ve released quantized versions of Qwen3.5 27B using: - AutoRound (INT4), with linear attention layers remaining in 16-bit. - LLM Compressor (NVFP4/MXFP4), with linear attention layers, shared expert, and MLP gate remaining in 16-bit. Optimized for fast inference with vLLM (validated on v0.16.1rc1).  huggingface.co/collections/k… Note: still under evaluation; additional quantizations coming soon. Acknowledgments: @verdacloud for compute sponsorship.
24
39
2
455
31,498
David Hendrickson retweeted
🚨 The Qwen3.5 series of distilled models is here! 🎉 These proved to be very useful in the past for those inferencing at home with underpowered PCs. Unfortunately, we don't see a model small enough to fit on a single RTX-5090 w/32 GB VRAM, so those will have to use quant models. Qwen3.5-27B seems to be the surprising winner and certainly a replacement for Sonnet 4.5. 🦞 Clawdbots rejoice as this could fit on a 64GB AMD Halo Strix PC $2K or 64GB M3 Mac Ultra $4K.
Qwen
@Alibaba_QwenFeb 24
🚀 Introducing the Qwen 3.5 Medium Model Series Qwen3.5-Flash · Qwen3.5-35B-A3B · Qwen3.5-122B-A10B · Qwen3.5-27B ✨ More intelligence, less compute. • Qwen3.5-35B-A3B now surpasses Qwen3-235B-A22B-2507 and Qwen3-VL-235B-A22B — a reminder that better architecture, data quality, and RL can move intelligence forward, not just bigger parameter counts. • Qwen3.5-122B-A10B and 27B continue narrowing the gap between medium-sized and frontier models — especially in more complex agent scenarios. • Qwen3.5-Flash is the hosted production version aligned with 35B-A3B, featuring: – 1M context length by default – Official built-in tools 🔗 Hugging Face: huggingface.co/collections/Q… 🔗 ModelScope: modelscope.cn/collections/Qw… 🔗 Qwen3.5-Flash API: modelstudio.console.alibabac… Try in Qwen Chat 👇 Flash: chat.qwen.ai/?models=qwen3.5… 27B: chat.qwen.ai/?models=qwen3.5… 35B-A3B: chat.qwen.ai/?models=qwen3.5… 122B-A10B: chat.qwen.ai/?models=qwen3.5… Would love to hear what you build with it.
1
2
30
1,958
David Hendrickson retweeted
REPORT: Microsoft is gearing up to ditch OpenAI and ChatGPT, and build its own frontier models. In a new interview with FT, Microsoft AI chief Mustafa Suleyman confirmed the move, stating: "We have to develop our own foundation models, which are at the absolute frontier, with gigawatt-scale compute and some of the very best AI training teams in the world." Read more below!
182
209
125
1,416
863,922
David Hendrickson retweeted
We found GLM-5 to be a big step up for open-source coding models - highlighted by a 9% gain over Kimi K2.5 on Terminal-Bench 2. The model also surpasses Kimi 2.5 on several other benchmarks, most notably on our Finance Agent Benchmark, on which it is the #1 open-weight model and #11 overall.
12
19
1
238
16,737