Over the last few months at @river_ai_inc we’ve developed what we believe is the best system in the world for building your own internal custom models, driven by 10 years of experience training top models at DeepMind, OpenAI and xAI. In order to best support our customers, we’ve decided to do something radical: We also deploy our API on-prem on your compute cluster, and if you don’t have compute we will help you find it. Again and again we’ve seen that custom models designed for your own internal workflows outperform top frontier models on performance, at a fraction of the cost (1 percent or less). We’re just at the beginning of the custom model era, but its already clear that in the future more than 99% of LLM tokens will be generated on efficient custom models. The economics of it are just too powerful, and it’s far easier than people think once you have the right tools in place. The reason why small models will dominate is due to the physics of deep learning: A general model that can do everything needs more capacity and training it on the whole distribution of all tasks is more challenging, so the model will be larger and more expensive, and wont perform perfectly on every task. A small model trained on a targeted domain usually outperforms it.

“Do you think that getting married young has made you less ambitious?” Welcome to the first episode of SOTA Wives with Sarah Chieng (Head of DevX at Cerebras, ⁠@MilksandMatcha⁠) x Vivian Midha Shen (General Partner at Y Combinator, ⁠@vivianmshen⁠). In episode 1: finding your person before getting rich, turning down startup funding to finish MIT, what a YC partner sees in founders, and how a birthday post became “psychological violence.” 4:08 Finding your husband before the exit 8:48 Did we marry away our ambition? 18:04 The internet called Sarah's birthday “psychological violence” 20:47 Does your YC partner secretly think you’re doomed? 23:47 Building a startup with your ex-boyfriend 28:54 SF cat parties