@OpenRelayInc
Account based inUnited States
About this account
- Account based in
- United States
- Connected via
- Web
Account-level information from X, not a live location or the device used for a specific post.
https://nitter.cf/t.co/g5qr7plvwY Inference Delivery Network
San Fransisco
Joined June 2026
- Tweets12
- Following45
- Followers53
- Likes26
Decision models are a new category: Jev from TypeSafe launched last week, typed answers with probabilities instead of text.
Laya is the open-source one. It is live on OpenRelay: POST /v1/decisions, $0.02 per 1M input tokens, nothing else billed.
Same three primitives: choice, score, yes/no. Up to 64 questions per request, one forward pass, a probability distribution and a confidence on every answer.
A four-question ticket triage is 345 tokens, or $0.000007.
Laya makes decisions instead of writing text. Use a few hundred labeled examples to set thresholds before relying on it. The playground has four presets.
Docs: docs.openrelay.inc/docs/infe…
Model by Convai Innovations: huggingface.co/convaiinnovat…
OpenRelayInc retweeted
we've partnered with @OpenRelayInc as a compute partner to provide private AI inference
hmu if you need provably end-to-end encrypted tokens
register for capacity here: openrelay.inc/inference-cata…
OpenRelayInc retweeted
The essays that shaped how I think were written by someone I assumed I would never meet. Today he spent an afternoon helping two founders (@jadenswang ) get better. Thank you @paulg and @jesslivingston for having us! This was the most memorable afternoon of my career
Launching @OpenRelayInc : One Endpoint to Rule Them All
- 100B tokens/week across 22 locations on 4 continents
- 8 accelerator SKUs: NVIDIA, TPU, Trainium, AMD
- Up to 20% cheaper than renting the hardware yourself
Every chip on earth. None of them your problem.
Run inference on the world’s compute
youtu.be/7uNhqcjBXJg?si=rsBj…