the ai lab for open foundation models.
Beijing, China
Joined May 2026
- Tweets9
- Following2
- Followers863
- Likes14
Introducing Monolith-1.0: Frontier Reasoning, Open Weights
- 1.57T-param Mixture-of-Experts, 49.5B active per token
- Native 1M-token context (2²⁰), extended via a two-stage YaRN curriculum
- Trained on 60T tokens across 12,288 Ascend 910C NPUs
- Frontier SOTA open-source model as of July 2026: 95.9% GPQA Diamond, 96.2% MMLU-Pro, 90%+ AIME 2025
- MIT-licensed weights, tokenizer, and eval harness
No waitlist - open the chat and give it something that should be hard.
Chat: basaltlabs.org/chat
Readers added context they thought people might want to know
Independent analysis of the model weights indicates it is fabricated from Qwen2.5-7B-Instruct with cyclically reused and random-padded weights, not a trained 1.57T model. x.com/sshthedev/stat… huggingface.co/basaltlabsai/m…
Monolith-1.0 was trained on 60 trillion tokens across 12,288 Huawei Ascend 910C NPUs.
The stack uses 3D parallelism, sequence parallelism, and ZeRO-style optimizer sharding tuned for the Ascend interconnect, with deterministic checkpointing throughout the run.
The model trained end-to-end without loss spikes or rollback restarts.
Everything is released under MIT: weights, tokenizer, eval harness, and training checkpoints.
No waitlist, no API keys, no usage tiers. Download the weights and run Monolith-1.0 on your own hardware, or try it now at basaltlabs.org/chat.
If you hit something that should be hard, bring it.
Basalt retweeted
Introducing Kimi K3: Open Frontier Intelligence
🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal
🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts
🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional cost
🔹 Built for long-horizon agentic coding and self-evolving workflows
Kimi K3 is now live on on Kimi.com, Kimi Work, Kimi Code, and the Kimi API.
Open Weights by July 27, 2026.
🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.com/blog/kimi-k3
Basalt retweeted
Introducing GLM-5.2: Frontier Intelligence, Open Weights
- Significant improvements in coding and agentic tasks
- Strong long-horizon capabilities with a 1M context window
- Two levels of reasoning effort: GLM-5.2 (max) pushes the limits, while GLM-5.2 (high) strikes a strong balance between performance and token efficiency
- MIT-licensed open weights
- Same API pricing as GLM-5.1
Tech Blog: z.ai/blog/glm-5.2
Weights: huggingface.co/zai-org/GLM-5…
API: docs.z.ai/guides/llm/glm-5.2
Coding Plan: z.ai/subscribe
Chat: chat.z.ai
Basalt retweeted
🌘 Kimi-K2.7-Code, our latest coding model, is now released and open-sourced!
🔷 Improved coding & agent performance over K2.6: +21.8% on Kimi Code Bench v2, +11.0% on Program Bench, and +31.5% on MLS Bench Lite.
🔷 Reasoning efficiency: Less overthinking, with 30% lower reasoning-token usage compared to K2.6.
🔷 Long-horizon coding: Improved instruction following, higher end-to-end coding task success rates.
⚡️ 6x High-Speed Mode coming soon!
🔌 Available today via Kimi API and Kimi Code.
🔗 Kimi Code: kimi.com/code
🔗 API: platform.moonshot.ai
