Joined November 2016
Will talk when it can runs on a 64GB ram and 12GB vram system.. and with minimum of 96% of bf16 quality
Lads, open source won This is c2 btw.. I have another session running
26
looks like there are now many candidates that can replace the OG Qwen 35b moe now.. really glad to see some competition on this segment a 40b model with 2b active 😍
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
1
137
Our largest model yet. 763B parameters, compressed with GSQ-RCO and co-optimized with Strata (by @coldniko) for local inference. On Hugging Face this Friday. Much more is coming. Follow us for future releases.
60
73
32
1,048
159,378
when are you going to support deepseek 🙂
Beta testers so far loving it - just annoyed with few bugs 👀
45
Wow the other side is now, entering the arena, 77 on DeepSWE and Peaked in Automations!! waiting for others to show their cards
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
1
1
54
Hot Take: JEV is just an LLM with one single pass parallel call for all the field..
Replying to @CompleteSkeptic
Jev was multimodal all along Yep, the Jev you know and love was an image model this whole time. We just chose to disable it because models tend to be less intelligent on other modalities. Header: TypeSafe-Danger-Zone-Images: true
58
haha.. looks like we have a naruto fan here 😉
don't watch how the fight ends tho
43
LOL
"We used our models to understand the device and where it had come from"
51
This is exactly what I was thinking of building for a long time.. will this work with any engine? Thanks for doing it 😁
【 Angio 開発画面 】 ~ Strataのボトルネック可視化ツール~ Strata GLM 調整の時、遅い個所の把握が大変でした💦 なので血管造影(Angio)みたいに、流れ道の「つまり」を見るアプリ作ってます‼ ・ボトルネックの場所が分かる ・直す価値があるかどうかがわかる 近日中にリリース予定です🌟
1
1
4
199
So finally we have a sub 40b moe model other than the qwen
🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme efficiency. Two new models: 🔹 MiniCPM-V 4.7 35B-A3B — Bring SOTA performance to local devices with newly introduced LES (Lookahead Expert Scheduling) technique, a new milestone of on-device multimodal AI. 🔹 MiniCPM-V 4.7 1B — Lightweight, efficient multimodal AI. Easier to deploy. ⚡ What's new? SOTA performance: Competitive results across 34 benchmarks spanning multimodal understanding, STEM reasoning, OCR and long-video comprehension. Fast on-device inference: LES predicts and preloads expert weights to reduce inference stalls, boosting 5× speedup on iPad Pro M4 (16GB) with byte-for-byte identical outputs. It enables MiniCPM-V 4.7 35B-A3B to achieve 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max, while costing only 3GB memory 🤯 Efficient visual processing: 4× and 16× hybrid visual token compression. Even at 16× compression, 35B-A3B scores 90.4 on OCRBench, 5.2 points ahead of Qwen3.6 35B-A3B. Easier customization: We introduce Self-Replay Fine-Tuning, a simple way to customize new target capabilities at low cost while maintaining general performance. Broad hardware support: Day-0 adaptations for Apple, Intel, AMD, Arm and Rockchip, with many more platforms supported through FlagOS! Download, deploy, and build something we haven't imagined yet. 👀👇 🔗 GitHub: github.com/OpenBMB/MiniCPM-V 🤗 Hugging Face: huggingface.co/collections/o…
1
2
90
Here is another one with Qwen3.8 Flash Next : IQ3_S
100
Here is one from me.. since this is a trend now qwen 3.8 flash q3 on 12GB gpu 64GB ram
2
3
181
but for that to happen, the people who do know how to run it has to make it seemless
Local AI will work when people don't know it's running locally. It has to be that seamless.
1
52
Since everyone is running glm now.. here is mine GLM-5.3-Flash, a 321B model, running on two RTX 3060s (24 GB VRAM total). 13 tokens/s. 325 t/s prompt reading. Engine: Project Maya. Quant: Maya S24
1
96
Codacus retweeted
The Medal of Science is for scientists. Scientists publish their works in peer-reviewed venues so they can be scrutinized, verified, and reproduced.
86
47
6
917
83,727
And it keeps getting better and better 😍
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick github.com/Niko1221/Strata/r…
1
6
490
gotta try this
GLM-5.3-Flash exl3 on CPU is going way faster, now thanks to my friend's amazing 4 months of crunching on this. 1x rtx 3090 + 50GB DDR4 + 100GB NVMe - decode 26 tok/s -> 35 tok/s - prefill = 1018 -> 1136 tok/s - concurrency 4 = 76.5 tok/s Intelligence for all. Freedom
1
80
this is awesome!! video generated with code
1
94
This looks awesome!! thanks for such contributions
I’m back, with a little something… GPC 1, a new general-purpose classifier enabling: bounding boxes, poses, coordinates, direct mechanical control and so much more, all in milliseconds. Post-trained on millions of datapoints and thousands of unique problem classes learned directly from you guys posting on X, GPC-1 is a great tool for many things. Early user feedback is also good :) A new output class enables precise continuous range numerical outputs, so the model can output coordinates of bounding boxes, exact angles and distances, pose estimations, scores, and more. It goes a lot beyond typical classification which just pick a label. Excited to see where this goes. Available now!
1
114
Half if the people is still confused about JEV. So this is now my favorite way to consume AI news away from Hype 🤣
Holy crap. Rick and Morty just explained Jev AI to me better than any tech demo could.
119