Artificial Specialized Intelligence. Better, Faster Task Specific Models.

Joined November 2024
ZeroEntropy (YC W25) retweeted
incredibly clever chunking trick by the zeroentropy team (now at notion) llms are autoregressive, which means generating text is super slow. but passing text in and finding the logprobs of a particular token at all locations takes a single forward pass! so we can ask the llm, 'like yo llm, please chunk this by putting this unlikely character 段 wherever there should be chunks" and we instantly get the segmentation locations (well, not instant, we still need a forward pass which means we need to prefill) but the advantage is super accurate chunks in the time it takes to prefill!
15
24
6
535
35,050
ZeroEntropy (YC W25) retweeted
Excited to welcome @ZeroEntropy_AI to @NotionHQ. The future of AI products will not be powered by a single model, but by intelligently matching each workload with the best combination of quality, speed, and cost. This is an important step in that direction. notion.com/blog/zeroentropy-…
5
10
2
162
18,849
ZeroEntropy (YC W25) retweeted
Excited to share that the awesome @ZeroEntropy_AI team joined @NotionHQ We have already been collaborating for a long time. now we are working even closer. Anyone who can make search ranking 85% faster is a happy addition to the Notion team :)
8
12
1
99
15,185
We're excited to announce that @NotionHQ  has acquired ZeroEntropy. We first got to know the Notion team as one of our top customers: Notion AI has been running on our reranker zerank-2, replacing models from larger, better-funded competitors with an 85% latency improvement. Now our whole team is joining Notion to keep building. Alongside the acquisition: 🔓 All of our models are now open source under Apache 2.0 on @huggingface , run them through any inference provider, no commercial license required. 📅 All ZeroEntropy products remain fully supported until September 4th, 2026, after which they will be sunset. Our migration guide covers every path, and our team is available on Slack, Discord, and email to help every customer transition. Full story on our blog and migration guide below. Thank you to our customers, investors, and partners for believing in ZeroEntropy. It's been a privilege to serve you, and we can't wait to keep building things you love at Notion.
23
10
7
136
35,233
ZeroEntropy (YC W25) retweeted
Thank you @garrytan 🙏🤍 best addition to the @ZeroEntropy_AI office pirates don’t ask for permission 🏴‍☠️
1
2
2
37
3,337
ZeroEntropy (YC W25) retweeted
touching grass over the weekend at @ZeroEntropy_AI
2
1
35
2,580
ZeroEntropy (YC W25) retweeted
Is Matryoshka dead? Every frontier embedding model uses MRL. But we tested it across a full hyperparameter sweep and it's lossy at every dimension. A small projection matrix trained on top of zembed-1 beats MRL across the board. Including at full dim. Results: zembed-1 @ 160 dims > OpenAI @ 1536 dims zembed-1 (no MRL) > voyage-4 (MRL) @ZeroEntropy_AI
4
6
27
3,772
ZeroEntropy (YC W25) retweeted
Super excited to share that @ZeroEntropy_AI is now a provider in the @vercel AI SDK If you're already building with `ai`, our models are one import away. → zerank-2 for reranking → zembed-1 for embeddings → more models to come 👀 Happy shipping!
5
5
1
39
3,460
ZeroEntropy (YC W25) retweeted
The excellent zerank-2 reranker model by @ZeroEntropy_AI is now fully compatible with Sentence Transformers, no `trust_remote_code=True` needed. It's 4B and cc-by-nc-4.0, and performs very well. I'm quite fond of their training methodology, I'll explain in the 🧵
1
7
50
3,865
ZeroEntropy (YC W25) retweeted
On Gemini Flash 3.5 pricing Prices for mini/Flash models have been dramatically increasing with every release 4x increase on input and more than 8x on output between Gemini 1.5 Flash and Gemini 2.5 Flash And now another 3x increase The world needs more cost efficient, lightweight models to run at the scales needed, especially for task specific workflows that don't need frontier models Token efficiency and intelligence compression are what's needed
I'm scared to make this video, but I feel like I have to. It's time to talk about Google.
1
4
23
2,837
ZeroEntropy (YC W25) retweeted
zembed-1 is finally here! 🔥 The world's best embedding model, by @ZeroEntropy_AI It outperforms @OpenAI , @GeminiApp , @Alibaba_Qwen , and Voyage's latest embeddings on 100+ languages, and across verticals. Available now via our API/SDK, @huggingface, and @awscloud Marketplace. Full launch post in the thread for benchmarks and more about our secret sauce 👀 We're building the entire retrieval stack... and we're just getting started. 🤫 PS: We're giving out free credits to try it, just comment on the post or DM me!
17
19
100
9,772
ZeroEntropy (YC W25) retweeted
live from @MIT where @ZeroEntropy_AI 's CTO is presenting our latest zElo paper and reranker model! @npip99
1
1
21
8,156
ZeroEntropy (YC W25) retweeted
shout out to @ghita__ha and the @ZeroEntropy_AI team for organizing! – at San Francisco, CA
1
3
764
ZeroEntropy (YC W25) retweeted
We just built a free tool to ask questions over the 2025 @NeurIPSConf research papers. Try it out at neurips dot zeroentropy dot dev No signup, no credit card, just the best way to learn more about this year's papers!
2
2
1
18
2,756
ZeroEntropy (YC W25) retweeted
It’s always amazing to see small teams outperform companies with $100M+ in funding, and even more amazing when you get to be a part of it. 😅 Stoked that we were able to support @ZeroEntropy_AI on training their state of the art reranker model family! Read here about the zerank family: tensorpool.dev/blog/zeroentr… @ghita__ha @npip99
1
3
2
17
1,241
ZeroEntropy (YC W25) retweeted
We are very excited to release zerank-2, @ZeroEntropy_AI 's newest reranker model. 🔥 It shows major improvement on the 5 most common RAG failure modes below. Existing rerankers consistently fail on seemingly “simple” tasks: 🔢 Comparing numbers and date: “Biggest deals closed after 04/2024.” 🗄️ Aggregation: “Top 10 objections of customer X?” 🌍 Multilingual: Major pain point, especially non-English to non-English. 🙏 Instruction-Following: “Find the *counterargument* of the claim in the transcript” 🥇 Calibrated scores: You ask "what should I cook for dinner?", and "I am allergic to nuts" scores too low for your threshold. Many rerankers overfit public benchmarks, and don’t generalize to these real issues. zerank-2 outperforms existing rerankers considerably on all of these failure modes, in real production environments. With zerank-2, you get: * 15% improvement vs Cohere rerank 3.5 on Arabic/Hindi (Miraql dataset) * +12% NDCG@10 on sorting tasks (new open-sourced eval set) * +7% vs Gemini Flash on instruction-following (MAIR dataset) * $0.025/1M tokens, 150ms p90 latency at 100KB 🤗 We are open-sourcing the model weights, along with new challenging eval sets on @huggingface. Our Elo-inspired training methodology is already open-source! We're starting a series of technical deep dives to explain various failure modes zerank-2 fixes, with concrete prod examples, methodologies, and benchmarks. First technical deep dive in the comments.
24
36
5
177
88,577
ZeroEntropy (YC W25) retweeted
@ZeroEntropy_AI (Nicholas Pipitone, @ghita__ha) will talk about how they used RLAIF to train their SOTA rerank model:
1
3
14
1,099
ZeroEntropy (YC W25) retweeted
come chat about smarter search and smarter AI
next week will be extra @elastic-packed in SF monday meetup: luma.com/smart-search * @ghita__ha, @ZeroEntropy_AI: search tools for efficient AI agents * jesse, @fintoolx: LLMs and the next generation of financial search * @joshnkeezy, @reductoai: building a vision-first RAG pipeline with reducto and elasticsearch
1
6
1,014
ZeroEntropy (YC W25) retweeted
next week will be extra @elastic-packed in SF monday meetup: luma.com/smart-search * @ghita__ha, @ZeroEntropy_AI: search tools for efficient AI agents * jesse, @fintoolx: LLMs and the next generation of financial search * @joshnkeezy, @reductoai: building a vision-first RAG pipeline with reducto and elasticsearch
1
3
2
13
1,876