Jason retweeted
most of the internet will be completely obsolete very soon.
it already feels like an abstraction we tolerate for lack of a better alternative. ai agents replacing it would essentially reduce the web to a set of apis & scraped data repositories—just raw material for agent-mediated interaction. no need for direct user involvement; you ask, they fetch, synthesize, & act. search engines? obsolete. social platforms? distilled into personalized outputs. even “websites” as a concept might evaporate—why visit a page when your agent brings you the content or makes decisions for you?
the internet becomes invisible infrastructure, like electricity. the downside: agents would consolidate power even harder than platforms like google. imagine them becoming gatekeepers of truth & commerce, & good luck disentangling bias from synthesis. you’d be trading the wild west of the web for a walled garden of agents.
agents will be the de facto mediators of human desire.
Jason retweeted
⚡️Humanity has mistaken its own implementation of intelligence for the definition of intelligence itself. And now that another implementation exists, the distinction is becoming impossible to ignore.
The argument that an LLM merely predicts tokens contains a hidden assumption: that understanding must exist somewhere outside the computational process generating those predictions.
But where, precisely, does understanding begin in a human brain?
There is no individual neuron that comprehends mathematics, recognizes irony, or understands mortality. Those capabilities emerge from the organization and interaction of components that possess none of them individually.
The same question now confronts artificial intelligence.
A system trained to predict language discovers that successful prediction requires increasingly sophisticated representations of the world generating that language. Physics, causality, human intention, mathematics, and social relationships become useful internal structures because language carries information about all of them.
The training objective is relatively simple. The capabilities produced by optimizing it are considerably more complex.
The extraordinary discovery is that prediction, pursued at sufficient scale and across sufficiently rich data, can become a route toward generalizable models of reality.
That exposes something fundamental about intelligence itself.
Much of what humans call understanding involves constructing internal representations that allow them to anticipate consequences, recognize hidden relationships, and act successfully under unfamiliar conditions.
A model that can perform those functions has acquired something more substantial than a collection of memorized responses, even when its representations remain imperfect.
Jason retweeted
Remaining moats in the age of AI:
- Network effects
- Access to capital
- Execution speed
- Proprietary information
- Proximity to power
- Charisma
- Violence
So basically, same it has been since the advent of urbanization.
Jason retweeted
Wow. I woke up to an impressive number of upset people who apparently don’t understand how LLMs work and can’t cope well with me pointing it out.
An LLM is a statistical next-token prediction model. That’s how it works. It’s an extraordinarily sophisticated calculator performing math you could theoretically do by hand (if you were sufficiently masochistic).
Math doesn’t know what it’s calculating. Pi doesn’t spend its evenings contemplating the nature of circles, and c doesn’t ponder the relationship between matter and energy.
That doesn’t make the results any less accurate, impressive, or useful.
Between inference requests, an LLM isn’t sitting around thinking. It isn’t reconsidering its answers, wondering whether it made a mistake, contemplating its existence, or questioning whether it’s conscious. Its weights remain fixed (it doesn’t learn), and computation resumes when it receives input.
We know this because we designed these systems. The architectures, mathematics, implementations, and research are extensively documented. You can study them yourself.
Of course, some people immediately lean into comparisons of biological intelligence or philosophical debates over consciousness because that is what they know.
But biological intelligence and artificial neural networks are fundamentally different systems. Similar outputs don’t establish equivalent internal experiences.
I experience consciousness directly. I infer that other humans do too because we share biological structures and processes. We don’t have equivalent evidence for an LLM, and nothing about its known operation gives evidence of conscious experience.
Which brings me back to my original point.
To me, understanding is conscious comprehension. It means being aware of information, recognizing its meaning, and experiencing that comprehension. If I wasn’t conscious I could not understand.
We can perform actions unconsciously. We can produce correct results without knowing why they’re correct. But I distinguish those capabilities from consciously understanding what we’re doing.
An LLM can solve complex problems, explain difficult concepts, and produce remarkably accurate information. I give it full credit for those capabilities.
But producing an answer that we rationalize as understanding isn’t the same as experiencing understanding.
You don’t have to agree with my definitions. We can debate functional understanding versus conscious comprehension all day, but that won’t establish whether an LLM actually experiences anything.
The right debate is this…
Could machines exhibit something different from human consciousness, something measurable, meaningful, and worth studying?
I think so, absolutely!
I’m entirely open to discussing “machine consciousness” in terms of observable, testable computational properties. We built these systems, we can instrument them, examine their internal mechanisms, and investigate what they’re capable of.
That seems far more productive than endlessly arguing over whether a machine experiences life the way humans do.
So here’s my question:
How would you define machine consciousness, and more importantly, how would you measure it?
Jason retweeted
Technical moats are mostly over at this point. If you’re building something that is meant to be durable, the only moats now are:
• Proprietary data
• Network effects
• A physical component
Jason retweeted
刚看完阿里巴巴CEO吴泳铭云栖大会这 18 分钟,有一段话我印象特别深,我觉得不管大家怎么看阿里,这 18 分钟值得找个时间安静的看一遍,我做了一版中英文字幕的分享给大家。
他说今天机器思考总量还不到人类的 3%,但终局是 1000 倍,
然后举了个例子:新生儿早衰症,全球可能就几百个患者,按现在的商业逻辑没有公司愿意花几十年去做这个药。
但如果思考的成本趋近于零,上百万个 Agent 可以不眠不休地跑实验——那些因为不赚钱就没人管的病,第一次有了被认真对待的可能。
这段话让我回味了很久,不是因为讲了多牛逼的技术,关键是指向一个我以前没想过的问题,人类社会到底有多少重要的事,仅仅因为投入不划算就被放弃了?
另一个让我觉得很深刻的判断,他说今天的 Vibe Coding 就是 1882 年的电灯,替代的是已有的工作,
原话是:仅仅替代现有工作,创造不了真正的新时代,代表性产品还没出现。
这句话放在整个行业天天喊颠覆的氛围里,我觉得反而是最清醒的。
我们现在做的所有事,可能都只是在用新工具干旧活,
真正属于这个时代的东西,也许还在某个人的脑子里,还没被想出来。
他还有一个类比我很喜欢:1900 年电器已经进了家庭,但当时全球一年的发电量,放到今天只够全世界用两小时。
我们就站在这个位置上,基础设施远远没有铺够,需求远远没有被释放。
看完今天上午云栖大会千问交出的整套底牌,
我感觉最锋利的地方全落在了账本上:
研发端让模型零干预自主迭代 33 轮扛住研发重活,
成本端直接把缓存命中输入打穿到了每百万 Tokens 一毛钱。
咱们把这两串数字掰开看, 在模型研发端,Qwen3.8-Max 在没有任何人工干预的情况下自主跑完 33 轮闭环演进,调用上万次工业工具把总线模块面积缩减了 42%,Artificial Analysis 质量指数推到了 45。
面对从未见过的阿里新款芯片,它自己进场完成算子调优与底层框架适配,竟然把单实例推理吞吐拉升了 96%,这说明算法团队日夜洗数据调参的阶段正在过去,大模型正在自己接管研发流水线。
而在落地成本端,提前开源架构的 Qwen3.8-Flash 通过注意力机制等底层重构,把训练成本直接砍掉近九成,配上每百万 Tokens 一毛钱的缓存单价,让大规模并发调用有了真实的利润空间。
Pinterest CEO 在公开场合提到,换用千问后综合调用成本压缩至同类商业模型的 8%。
更耐人寻味的是技术迭代的节奏,新架构 Qwen4 已经在训,后续版本规划直奔 5 到 10 万亿参数,配合全球突破 30 亿次的开源下载量,感觉千问交出来的已经不是几个孤立的模型版本了,有点把 AI 从手工作坊时代推进到了自运转的工业工厂时代的意味。
并且阿里的这种工程化能力已经开始向多模态交付延伸了,视频模型 Wan3.0 在主流评测中排名前列,下代模型定档 11 月,刚开源的 Qwen-Image-2.1 凭借 7B 的轻量尺寸,把原生透明图层与局部编辑做进了同一个模型,支持圈选修改、图层替换与多图保真参考,以往需要跨几个专业软件来回倒腾的设计链路,现在能在同一个模型内被压成秒级响应。
从算法团队教模型理解世界,到模型反向进入研发体系、全行业的计算成本被大幅摊薄。
开源生态把图纸与开采机完整交出来之后,竞争的重心彻底转向了谁能用更低成本把真实业务跑通。
这套成本架构落地之后,大家最想先重构手头的哪块业务?我自己是打算把后台知识库检索和长文本记忆全量切过去,粗算一年能省出好几台服务器的实打实开销。
Jason retweeted
All of the ultra successful people I’ve met have no poker face; they are physically incapable of faking interest and will disengage in real-time the second a conversation stops being worth their attention.
I met one founder who would open Tetris when calls stopped being intellectually stimulating, and a scientist who would stand up and just leave press interviews and board meetings the instant they became boring. You will almost never see these people at networking events or on panels.
Most people expend too much energy pretending to be engaged; nervously nodding in meetings and laughing at the right moments to keep things polite. Exceptional people do not display this behaviour; it makes them painful in social settings but unstoppable at the things that actually matter to them.
Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro ⚡
Meet Inco Splash: our open-source inference engine, built around the model and around Apple silicon.
Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents.
Jason retweeted
Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢
Built on an Interleave architecture, it improves faithfulness, fluency, and conciseness while reducing average lagging (LAAL) from 2.8s to 2.3s across 60 languages.
New capabilities: 🙌
- Real-time speaker diarization — distinguishes speakers in multi-party speech and preserves each speaker's voice through more stable voice cloning.
- Synchronized bilingual display — source and translation on screen together.
- Long-context disambiguation — leverages conversation history to clarify names and terminology for consistent translations.
Let's try Qwen3.8-LiveTranslate! 🥳
- Blog: qwen.ai/blog?id=qwen3.8-live…
- QwenCloud: qwencloud.com/models/qwen3.8…
Jason retweeted
Qwen 4 may drop in the next 15 days.
- Rumored to match GPT-6 Astra and Fable 5.1.
- 3T+ parameters. Open-weight. Full multimodal.
- Built for reasoning, coding, and agents.
Reportedly cheap to run.
If this holds, it becomes the strongest open model on the market.
Update: I’ve now pushed over 5 BILLION tokens through DeepSeek V4.1 Flash.
I still haven’t had to reach for Astra or Fable because DeepSeek couldn’t handle a task.
I’m using Hermes with three API keys across @CommandCodeAI, @ollama, and @opencode. Super simple setup, and together they give me a ridiculous amount of usage.
Cost: $40/month.
A week ago I was spending $300/month and constantly thinking about limits.
Now I’m throwing billions of tokens at coding agents without thinking twice.
At this point, @deepseek_ai isn’t my fallback. It’s my default.
Qwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only. Thanks to @ivanfioravanti for all the cool work in the PR. N-grams on SSD like for DS4.1F.
Jason retweeted
You really don’t need 128GB of unified memory to run these models.
Qwen3.8 Next Flash is now being pushed onto a Mac with just 20GB of RAM using a completely different approach to memory management.
Instead of loading the entire checkpoint into unified memory, the custom Wallm Swift/Metal runtime streams routed experts directly from the SSD.
The model only pulls the experts it actually needs.
That changes the hardware requirements dramatically.
Tested with an 11K-token Codex input:
→ ~60 tok/s prefill
→ ~8 tok/s decode
→ 17–76s TTFT, depending on prompt length
→ ~23–36 GiB peak RAM as context grows
The key idea is simple:
Don’t load everything. Load what the router asks for.
Qwen3.8 Next Flash is a MoE model, so most of its parameters aren’t active for every token.
Wallm takes advantage of that by keeping the expert weights on NAND storage until they’re needed, rather than forcing the entire model into unified memory.
And that’s what makes this interesting.
This isn’t MLX squeezing a tiny quant into 96GB or 128GB of RAM.
It’s a custom Swift + Metal runtime treating the SSD as part of the model’s memory hierarchy.
The tradeoff is obvious:
Memory usage drops massively, but latency increases.
The 17–76 second TTFT is definitely the price you pay.
Still, getting Qwen3.8 Next Flash running on a 20GB Mac at around 8 tok/s decode is pretty wild.
And the same approach could potentially make other massive MoE models much more accessible on machines that simply don’t have enough unified memory.
You don’t need a GPU to run a capable local model.
Qwen3.5-4B is hitting ~11.4 tok/s on a Ryzen 5 laptop using CPU only.
No CUDA.
No GPU offload.
No MTP.
Just the model running directly from RAM on a 6-core laptop processor.
The setup:
→ Qwen3.5-4B Q4_K_M GGUF
→ Ryzen 5 7540U, 6C/12T
→ 9 threads for decode
→ 12 threads for batch processing
→ Q4 KV cache
→ Flash Attention
→ mmap enabled
→ GPU layers: 0
The interesting part is that tuning the llama.cpp configuration made a real difference.
With a basic CPU setup, performance was lower.
After tuning the threads, batching, KV cache and memory settings, plain decode reached around 11.4 tok/s.
That’s roughly a 10% improvement without changing the hardware or model.
Even more interesting:
MTP wasn’t faster.
A configuration using MTP=3 actually dropped to around 10 tok/s in the benchmarks.
So in this case, simple CPU decoding won.
There’s also a practical reason I like experiments like this.
The model was packaged into a standalone executable designed to be portable. You can keep it on a thumb drive, move it between compatible machines, and run it without needing a GPU.
For businesses, that can be useful.
Local inference means:
→ No API bills
→ Data stays on the machine
→ No internet dependency
→ Works on existing office hardware
→ Easy to deploy across machines
And this is only a 4B model.
The Qwen team is already thinking about what increasingly capable models running efficiently from CPU + RAM could look like.
Jason retweeted
🔥 Fine-tuned Qwen3.8-27B on my OWN data and it worked
🧠 and the before vs after will blow your mind
🔹 Built a custom Q&A dataset from scratch in JSONL
🔹 Used Unsloth QLoRA to train a 27B model on a single 48GB GPU
🔹 Base model had zero clue who Fahd Mirza is
🔹 Fine-tuned model answered instantly, accurately, in my own words
🔹 Full pipeline: dataset, training, inference, before vs after
Watch the full video below 👇
youtu.be/HFcoEBqMOS8?si=Yro_…
Jason retweeted
QWen3.8-27B在不同内存配置的Mac Silicon 应该部署哪个社区版,昨天很多朋友咨询,我这里整理下:
1. 16G的建议不要考虑QWen3.8-27B,tps太低,任务跑不动
2. 24G优先选越狱版本 orcarouter/Qwen3.8-27B-Uncensored-MLX(4-bit ),次选mlx-community/Qwen3.8-27B-MTP-4bit MTP优化版本,tps有提升(DFlash2有点勉强)
3. 48G优先选择 incoai/Qwen3.8-27B-DFlash2 DFlash2草稿模型优化版本,tps提升巨大,次选越狱版本 orcarouter/Qwen3.8-27B-Uncensored-MLX(4-bit)
4. 64G 及以上,优先考虑8bit BF16搭配 DFlash2提升tps,次选对应精度的越狱版本
追求最快就用 DFlash2版本
追求越狱就考虑Uncensored 版本,但是越狱版本没有官方配套 DFlash2 草稿 🤣
Qwen3.8-27B 在HuggineFace太热了,我整理了4 个值得推荐的 Qwen3.8-27B 版本:
1. mlx-community/Qwen3.8-27B-4bit + incoai/Qwen3.8-27B-DFlash2
我自测tps翻倍,适合通过 oMLX 接入 OpenCode。
2. Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed
原生 MTP,约 20.4GB,速度、质量和内存最均衡。
3. Youssofal/Qwen3.8-27B-MTPLX-Optimized-Quality
以 8bit 为主,峰值约 32.7GB,量化损失最低,适合质量优先。
4. unsloth/Qwen3.8-27B-GGUF 的 UD-Q5_K_XL
支持 llama.cpp、MTP 和多模态,跨平台兼容性最好。
Jason retweeted
A local 27B model scoring frontier performance! Huge thanks to @cline for the shoutout.🥳 This is just the beginning — Qwen3.8-27B will keep finding its way into more fields.🌱
Jason retweeted
Here’s my review of Qwen 3.8 27B - I can't remember the last time I've had this much fun playing with a local model that runs on my own computers simonwillison.net/2026/Aug/1…

































