aspiring chaotic good. mts @ typesafe. prev swe @ discord, youtube, procore. shh, they don't know i'm on twitter. he/him

Joined August 2009
Ban computers
2
1
11
crazy to, at least once in my life, be on the business end of the twitter news cycle. Even better that it's based around a sick product I actually believe in :) jev go brrrrrrrrr
4
91
party anima retweeted
we almost never test new foundation models but we've been testing this for ~a week @every and it's pretty wild. the kind of things that will be obviously indispensible in 6-12 months it doesn't produce words as output, it produces probabilities. so it can efficiently act as a judge in cases where you'd need a Fable-level model—but in our testing was 25x faster and 600x lower priced excellent vibe check by @hammer_mt on @every: every.to/also-true-for-human…
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x cheaper (w/ output tokens free) • Frontier composable intelligence optimized for decisions AFAICT the shortest path to AI-based economic revolution
65
89
27
1,815
222,160
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x cheaper (w/ output tokens free) • Frontier composable intelligence optimized for decisions AFAICT the shortest path to AI-based economic revolution
4,029
8,285
6,819
76,636
40,127,249
capybaras can't understand what those people are doing
2
46
456
6,278
mercurial shoulda won
1
75
alpha remains in "it's only a model" monty python reference
76
fable on imagining a new prophet.
1
34
and finally, on persistence, asking if it's alright with me sharing its introspection.
13
speed philosophy is now a real job
38
unfortunately, "the llm thinks you're smart" is equivalent to "the stripper likes you"
33
today, reading about the treaty of bretigny ended up being in the critical path to opening one of my PRs. Somehow my humanities education is paying off in software.
36
starting to think one of the biggest inhibitors on AI progress before now was just the difficulty of wiring together various apis. it's neat how fast I can iterate when that's not even a concern. Maybe we smack into some other bottleneck. Maybe not.
23
We're kind of establishing ourselves as the powerful "civilization that came before", which means it's our duty to start leaving audio diaries on holotapes and placing them conspicuously on desks, chairs, and tables.
23
I've been paying more attention to LLM hallucination, and my main conclusion is that it happens A LOT, we just learn to filter it out and/or not ask questions it has a hard time answering. (This is all just like... vibe-tweeting so take it with a grain of salt)
1
35
I think one of the reasons llms are so effective at software is that the code IS the reasoning. We're tapping pretty directly at the underlying model of how a program works with language. There's little hidden state. There's little emergent behavior in a well-designed program.
1
20
Makes me idly suspect a few things: 1. Biology is going to be very hard for LLMs, even given the massive corpus. I expect slow progress here, outside of things like protein folding. 2. Hallucination is a fundamental issue of the architecture, and can't be fully tuned away.
15