@mathfaxi
iAccount based inUnited States
About this account
- Account based in
- United States
- Connected via
- United States App Store
Account-level information from X, not a live location or the device used for a specific post.
building the future of ai @typesafeai
San Francisco
Joined November 2015
- Tweets375
- Following372
- Followers1.8K
- Likes16.8K
Eugene Shvarts retweeted
good news: ANYONE CAN SIGN UP 💪
bad news: we had to temporarily disable the free credits (just for new users) - we really want to figure out how to get people playing with jev, but a few bad actors were making it a bad time for everyone 😢
Eugene Shvarts retweeted
remember this old post of mine? Tried it with Jev---it seems to have a grasp of the globe on par with some of the best models a year ago
due to the architecture & low cost, it was also feasible to extract a labeled map of continents and countries. lots of interesting details
Jev is a bona fide yapper 🥺
Replying to @mathfax
@mathfax @typesafeai I rejoined this website just to share terrible homebaked memes such as this
#jev
Eugene Shvarts retweeted
This is tracking to be the #1 podcast we've released in all of 2026.
We asked Jev's creator @CompleteSkeptic to explain Jev, and why he does NOT call it a "Decision Model" — why it's called Jev
available wherever the finest podcasts are sold! reviews help us a lot to keep us relevant in the rankings 🙏
Jev and the System One Model: RLCD, intelligence/$, reliable AI, & the end of chat-first AI latent.space/p/jev
@typesafeai CEO @CompleteSkeptic explains why AI can solve extraordinarily hard problems yet still fail to automate basic work, why Jev is built for reliable decisions inside software instead of chat, why TypeSafe rejects public benchmarks and refusals at the API layer, why data and the right task matter more than brute-force compute, how System One Models could reshape coding agents and software, and why even with $1 billion he wouldn’t pre-train a model from scratch.
The full Runtime agenda is live, including talks from:
@ScottWu46, Co-founder & CEO @cognition
@CompleteSkeptic, Co-founder & CEO @typesafeai
@dylan522p, Founder & CEO @SemiAnalysis_
@sarahookr, Co-founder & CEO @adaptionlabs
@ajratner, Co-founder & CEO @SnorkelAI
Eugene Shvarts retweeted
When I first saw JEV, as a former TikTok MLE, I knew modern recommendation and search systems could be revolutionized if it keeps evolving.
JEV brings general-purpose semantic reasoning into a discriminative inference paradigm: arbitrary context in, calibrated structured decisions out.
That matters because recommendation and search are exactly the kinds of decision systems that need to be both smart and fast.
Times are changing.
Here’s one example: with JEV + Perfectly, we use a complex query to understand AI researchers through their papers across a pool of 500 ECCV 2026 researchers, while achieving the same performance as one of Claude’s models.
Eugene Shvarts retweeted
Holy crap.
Rick and Morty just explained Jev AI to me better than any tech demo could.
This media is unavailable
Outdated benchmarking/sharing restrictions lifted from our terms!
Show the world what you've got; we love knowing where the model's shining and where it feels like a dummy.
Eugene Shvarts retweeted
Wanted to see how well calibrated Jev by @typesafeai is to this famous chart about what probabilities people mean by specific words... and it's pretty well calibrated!
The world runs on snap judgments, and now you can create them on demand.
The Jev sweet spot.
(when to use it, and when not to)
Jev lives between rules and LLMs.
The easiest mistake is treating Jev as a faster replacement for an LLM.
It is better to think of Jev as the missing layer between deterministic software and open-ended generation.
The graphic below maps that boundary using two dimensions. One is how constrained the answer space is. The other is how frequently the decision must be made.
↳ Use ordinary code when the rule is exact.
↳ Use an LLM when the answer must be created through writing, planning, explanation, or deeper reasoning.
↳ Use Jev when the possible answers are known, but choosing among them requires semantic judgment.
A decision belongs in that sweet spot when four conditions are true.
→ The valid answers can be defined in advance. Jev should choose from known labels, ordered scores, or a yes-or-no decision.
→ The input is difficult to express as deterministic rules. A person could judge it quickly, but an if-statement cannot reliably understand its meaning.
→ The decision happens frequently. Model routing, ticket triage, retrieval reranking, guardrails, and high-volume labelling repeat often enough for latency and cost to compound.
→ Uncertainty should change what happens next. High-confidence results can continue automatically. Ambiguous results can be sent to a stronger model or a person.
Consider support-ticket routing.
The possible owners are already known. They might be engineering, billing, or sales. But customer messages arrive as unstructured language rather than clean database fields.
An LLM can classify them, but generating and parsing text for every ticket is unnecessary. Deterministic rules are cheaper, but become brittle as the wording changes.
Jev handles the fuzzy judgment and returns probabilities that application code can use.
The same framework explains where Jev does not fit.
If the task requires writing or multi-step reasoning, use an LLM. If arithmetic or an exact rule can determine the answer, keep it in code. If the possible answers cannot be defined in advance, Jev is the wrong interface.
The practical rule is simple.
Use Jev when code understands the possible values but not the meaning of the input.
I wrote the full breakdown on Jev. The article is quoted below.
Eugene Shvarts retweeted
Being a dev today using frontier AI feels like I'm playing Watson to Sherlock Holmes. I just stand back and go "my word holmes how did you deduce that" and occasionally stop him from getting shot
Jev Workflows 0.3 release candidate is public: a Codex plugin for tool/model/task decisions, failure diagnosis, and completion checks.
Open source. Optional hooks. No plugin-imposed call quotas.
Code, install, downloads & test evidence:
github.com/integrate-your-mi…
Eugene Shvarts retweeted
Replying to @doneyli @typesafeai
with Jev
it is less
eval -> eval -> eval
and more
-> eval
-> eval
-> eval
Eugene Shvarts retweeted
jev is fun to play with but you have to be careful shipping it to prod, over the past few days we accidentally racked up $3.55 in usage
Eugene Shvarts retweeted
pivot to jevinterp
Here's food for thought @simonw one thing unique about jev is that you can do so many evaluations so fast (incl. concurrently) that you could break apart, mutate and experiment with inputs and store the numeric results, this probably would allow some 'significance analysis'
One of my favorite part about jemos is that users frequently immediately grok that you don't just get two comparison points (decision via LLM, decision via Jev), but an entire cost/speed vs. performance Pareto curve from routing based on Jev output.
Here's a quick demo of me using @typesafeai's Jev for ONET job classification vs. Luna.
- Luna: 84.9% exact, ~2s/job, $482/1M
- Jev: 80.5% exact, ~200ms/job, $122/1M
tl;dr: ~10x faster and 4x cheaper for ~4 points of accuracy