伟大！
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
github.com/deepseek-ai/DeepI…
Supported features:
- Optimized kernels, model and sampler runtime
- Parallelism: Attention DP / balanced CP, MoE EP + EPLB
- DSpark and confidence-scheduled verification
- SWA bounded replay
- Asynchronous scheduling (zero-overhead batch scheduler)
- Batch-invariant inference
- Deterministic sampling
- Structured output
其实我不看好很多 one-shot 项目。
因为很多问题在得到一个具象化的项目之前，是很难考虑到的，只能靠后面慢慢打磨。尤其是桌面软件。
拿我最近开发的 LineHush 来说：
- 打开文件时，是在新窗口显示，还是在原窗口显示？
- 横幅和提示怎么显示、什么时候显示？
- 提示文字具体写什么？
以及还有一些细节 AI 容易忽略，比如弹出的窗口和之后显示的窗口不在同一个位置。
如果这些问题没有处理好，项目就会到处是不好用的 AI Slop。
期待一下
official now: anthropic is preparing the release of their new model(s). Via The Information
Anthropic is reportedly preparing a model that, when asked to fix one bug, can identify the broader class of problems behind it and ask whether it should address those too. That account comes from one anonymous tester; the model family and release date remain unclear.
But looks like it will be a significant jump compared to their released models.
