DeepInfra retweeted
Glimpse is our first model, built for visual thinking
Try it for yourself platform.elorian.ai/
DeepInfra retweeted
Today we're thrilled to announce the release of our first frontier visual reasoning model
DeepInfra retweeted
I make this same post like every 2-3 years, because there's always new data further supporting it.
Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one.
In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android)
Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy.
Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much.
Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet).
About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain.
It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along.
The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out
I can't emphasize enough how important this @a16z chart seems and how few have internalized it.
DeepInfra retweeted
Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry.
Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to come.
But its full promise can only be realized when people have confidence that AI is being built to be safe and deployed with wisdom and responsibility.
This is bigger than a single product. It's the beginning of an open ecosystem to build the trust layer for safe agent systems.
Together, we are building the foundation of the AI economy.
Trust and innovation are not in conflict. Safety is how trust is earned. We must build not only the most capable AI, but the most trusted AI, so that this extraordinary technology can realize its enormous promise for the world. nvda.ws/4hcoq7m
DeepInfra retweeted
I used my entire usage limit for BOTH Codex and Claude Code (2 accounts) to tackle a local build, and the problem was never solved even though I used Fable 5.1 for intensive planning, parallel-agent supervision, and evals. I then went to @DeepInfra and got an API key for DeepSeek V4.1-Flash (US-hosted), and it is now CRUSHING this massive task Both Fable 5.1 & Astra could not. 50% of the way through & I only spent $1.15 so far.
This is why all of a sudden the AI Cartel is sounding the alarm about AI safety. It's not about safety, it's about caping the competition. The numbers speak louder than perceived good will of the Effective Altruism mafia.
DeepInfra retweeted
For AI to work with us, it needs to understand us
Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
DeepInfra retweeted
THE RISE OF THE DATA CENTER
Here's how much revenue Nvidia $NVDA has brought in each quarter over the last couple of years from its Data Center business
Q4 2019: $1B
Q1 2020: $1.1B
Q2 2020: $1.8B
Q3 2020: $1.9B
Q4 2020: $1.9B
Q1 2021: $2B
Q2 2021: $2.4B
Q3 2021: $2.9B
Q4 2021: $3.3B
Q1 2022: $3.8B
Q2 2022: $3.8B
Q3 2022: $3.8B
Q4 2022: $3.6B
Q1 2023: $4.3B
Q2 2023: $10.3B
Q3 2023: $14.5B
Q4 2023: $18.4B
Q1 2024: $22.6B
Q2 2024: $26.3B
Q3 2024: $30.8B
Q4 2024: $35.6B
Q1 2025: $39.1B
Q2 2025: $41.1B
Q3 2025: $51.2B
Q4 2025: $62.3B
Q1 2026: $75.2B
DeepInfra retweeted
Thanks for our day0 partner @DeepInfra for the impeccable inference support! Try Ling-3.0-flash on Deep Infra's highly tailored and professionally served inference! 🚀
Ling-3.0-flash is live on DeepInfra
A 124B MoE from @AntLingAGI with just 5.1B active params, large-model capacity at close to small-model cost. Reasoning + tool calling on by default, 128K native context (up to 1M with YaRN).
Built for agents. Live now 👇
DeepInfra retweeted
🚀 Today, we’re releasing INT4 and FP4 (MXFP4) variants of Ling-3.0-flash.
Both run end to end on a single NVIDIA DGX Spark via our Spark-adapted SGLang path.
For FP4, W4A16 is the stable default, while W4A8 is tuned for higher throughput.
The efficiency and accuracy of the quantized models are still evolving. We will continue updating the inference implementation and quantized weights over time.
DeepInfra retweeted
Nikola Borisov bet the whole company on a boring word: inference. Deep Infra now runs 5 trillion tokens a week.
Our cover story on @DeepInfra
yespress.io/nikola-borisov?u… via Yespress
DeepInfra retweeted
Introducing MiniMax M3: The First Open-Weights Model to Combine Three Frontier Capabilities
- Coding & Agentic Frontier: 59.0% SWE-Bench Pro, 66.0% Terminal Bench 2.1, 34.8% SWE-fficiency, 28.8% KernelBench Hard, 74.2% MCP Atlas
- MiniMax Sparse Attention scales context to 1M
- Natively Multimodal from Step Zero
API: platform.minimax.io
Token Plan: platform.minimax.io/subscrib…
🚀New! MiniMax Code: code.minimax.io
Weights & Tech Report in ~10 Days
DeepInfra retweeted
Introducing Realtime TTS-2, a new generation of voice model built for realtime conversation.
It is the first voice model that hears the conversation, takes natural-language voice direction, holds one voice identity across over 100 languages, and speaks like a person who is paying attention.
The result is voice AI that feels as good as it sounds.
Try it out: tinyurl.com/RealtimeAI
Learn More: tinyurl.com/TTS-2Blog
P-Video-Avatar is now the fastest model for top-quality and diverse avatar generation.
- It costs 0.025$ per second of video, making it up 6× cheaper than similar avatar tools
- It takes 1.83s generation time per second of video, making it up to 18x faster than similar avatar tools.
- It offers full-body control, integrated audio support in 20+ languages, and is long-form video-ready for up to 3-minute consecutive clips.
We are launching with free usage until Sunday 23:59 CET at @replicate, @WiroAI, @inference_sh, @Runware, @Scenario_gg
And with general availability at:
@deepinfra, @Eachlabs
Try it now: p-video-playground-productio…
📚 API & quickstart for Pruna API: docs.api.pruna.ai/guides/qui…
⭐️ Star our OSS: github.com/PrunaAI/pruna
🌐 Website: pruna.ai/
DeepInfra retweeted
Alibaba's Qwen3.6 27B is the new open weights leader under 150B parameters scoring 46 on the Artificial Analysis Intelligence Index, but uses ~3.7x the output tokens and costs ~21x more than Gemma 4 31B (39) to run the full Intelligence Index
@Alibaba_Qwen has released two open weights models in the Qwen3.6 family: Qwen3.6 27B (Dense, 46 on the Intelligence Index) and Qwen3.6 35B A3B (MoE, 43). The MoE variant has 36B total parameters but only activates 3B per forward pass. Both are Apache 2.0 licensed, support 262K context, include native multimodal input, and use the unified thinking/non-thinking hybrid architecture.
Unlike Qwen3.5, Alibaba has not released larger Qwen3.6 models as open weights - Qwen3.6 Plus and Qwen3.6 Max Preview remain proprietary, so the Qwen3.6 open weights family is currently all under 50B models. All scores below are for reasoning mode. The Intelligence Index is our synthesis metric incorporating 10 evaluations covering agentic tasks, coding, and scientific reasoning.
Key takeaways:
➤ Qwen3.6 27B is the most intelligent open weights model under 150B parameters. At 46 on the Intelligence Index, Qwen3.6 27B is ahead of Qwen3.6 35B A3B (43), Qwen3.5 27B (42), and Gemma 4 31B (39). It is also ahead of larger open weights models including NVIDIA Nemotron 3 Super 120B A12B (Reasoning, 36), Qwen3.5 122B A10B (42) and gpt-oss-120b (high, 33). In native BF16 precision, the 27B takes ~56GB to store the weights, fitting on a single H100, and in 4-bit quantization the weights fit on consumer hardware with 16GB+ of RAM
➤ Qwen3.6 35B A3B is the most intelligent open weights model with ~3B active parameters, 6 points ahead of Qwen3.5 35B A3B (37) and 13 points ahead of GLM-4.7-Flash (30). Other ~3B active peers include Gemma 4 26B A4B (31), Qwen3 Coder Next (80B total, 28), and NVIDIA Nemotron Cascade 2 30B A3B (28)
➤ AA-Omniscience improvement is driven entirely by abstention rather than accuracy. Qwen3.6 27B's hallucination rate falls from 80% to 48% versus Qwen3.5 27B, while accuracy is roughly flat - consistent with our finding that AA-Omniscience accuracy typically correlates with total parameter count and Qwen3.6 27B retains the same 27B parameter count as its predecessor. The 35B A3B shows the same pattern whereby hallucination drops from 84% to 50% while accuracy remains equivalent
➤ Token usage is up across both models versus Qwen3.5 and significantly higher than Gemma 4 31B. Qwen3.6 27B used ~144M output tokens to run the Intelligence Index (~1.5x Qwen3.5 27B at 98M, ~3.7x Gemma 4 31B at 39M). Qwen3.6 35B A3B used ~143M (~1.4x Qwen3.5 35B A3B at 100M, ~3.7x Gemma 4 31B)
➤ The 27B got materially more expensive while the 35B A3B is roughly flat versus predecessor. Per-token pricing on Alibaba Cloud moved differently, with the 27B going from $0.30/$2.40 to $0.60/$3.60 while the 35B A3B (Reasoning) remains nearly flat at $0.248/$1.485 (vs $0.25/$2.00 for Qwen3.5 35B A3B). Qwen3.6 27B costs ~$659 to run the Intelligence Index, ~2.2x Qwen3.5 27B (~$299) and ~21x Gemma 4 31B (~$31 at median third-party pricing of $0.14/$0.40 per 1M input/output tokens). Qwen3.6 35B A3B costs ~$280, roughly tied with Qwen3.5 35B A3B (~$302) and ~9x Gemma 4 31B
➤ Qwen3.6 27B is competitive with leading models on agentic real-world work tasks despite its size. At 1414 Elo on GDPval-AA, Qwen3.6 27B is ahead of recent open weights peers Qwen3.6 35B A3B (1297), Qwen3.5 27B (1157) and Gemma 4 31B (1115), but trails larger open weights leaders including DeepSeek V4 Pro (Reasoning, Max Effort, 1554) and GLM-5.1 (Reasoning, 1535). It matches DeepSeek V4 Flash (Reasoning, High Effort, 1414) at 284B total parameters, and sits roughly in line with GPT-5.4 mini (xhigh, 1436) and Muse Spark (1421).
➤ Non-reasoning variants remain equivalent versus Qwen3.5. Qwen3.6 27B (Non-reasoning, 37) is effectively tied with Qwen3.5 27B (Non-reasoning, 37); Qwen3.6 35B A3B (Non-reasoning, 32) is equivalent to Qwen3.5 35B A3B (Non-reasoning, 31). The Qwen3.6 generation gains are concentrated in reasoning mode
Other information:
➤ Context window: 262K tokens (equivalent to Qwen3.5)
➤ License: Apache 2.0
➤ Multimodality: Native vision input (text and image), text output
➤ API pricing (Alibaba Cloud): Qwen3.6 27B: $0.60/$3.60, Qwen3.6 35B A3B (Reasoning): $0.248/$1.485
➤ Availability: Available on Alibaba Cloud first-party API. Qwen3.6 35B A3B is available on several third-party APIs such as @DeepInfra, @parasail_io, @clarifai and @novita_labs





























