Joined April 2008
No one changes the world alone Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models Available to everyone through our API
1
1
23
925
vpj retweeted
71 tokens per second on iPhone 17 pro max, bonsai 2 2b
1
4
266
Search your Mac by what's in your files, not what they're called. DigUp runs @GoogleDeepMind's new EmbeddingGemma 2 on-device: describe a video moment, a podcast minute, a PDF page, a photo or code, in any language, and dig it up. github.com/ARahim3/DigUp Free and open source. @googlegemma
43
89
44
970
134,895
💯 I am lucky to have worked closely with him many years and he’s been insanely accurate at predicting technology, what areas to work on and how to. Most people who know him as an investor have no clue, but he is one of the best at math and coding.
I make this same post like every 2-3 years, because there's always new data further supporting it. Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one. In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android) Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy. Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much. Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet). About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain. It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along. The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out
1
8
701
Looped transformers with tied weights might make pretty nice local models and assistants
4
6
120
9,580
Replying to @humansand
@humansand is hosting a party tonight & we are hiring in all workstreams! if you are interested in working on user models or have a project in mind for persimmon, come find me or @314Bansal p.s. we are almost at capacity at the event but will prioritize people who are interested in working with us so feel free to shoot me a message ✉️ partiful.com/e/sBqYtz1ehDZoW…
2
6
2
103
12,140
vpj retweeted
GPT-6 and Intelligent UI, now rolling out in ChatGPT for everyone. Intelligent UI in ChatGPT delivers fast, interactive answers that make everyday questions more visual, complex topics easier to grasp, and interactive tools for your task available on the spot.
1,487
1,898
1,572
23,952
6,772,496
Or, build a cluster and own the hardware, make your money go way further, still have a valuable asset after 3-5 years, and make a differentiated model bet. That's what humans& did Huge thanks to @DeepInfra and to @nvidia @Supermicro for working with us to make it happen
The economics of a Neolab. A neolab is loosely defined as a startup of AI researchers who raises a lot of money pre-production to be able to finance GPU compute to take on a large AI problem. To buy 1000 GB300s or ~14 NVL72 racks will set you back $125-150M for 3yrs with 15-30% upfront. That’s about ~2-2.5MW. Thats about enough to do 10^25 flops a quarter and get to a GPT-4 level model which is 1-2 OOMs off frontier for pretraining. If you post-train on a great open source model, you have a better chance of getting to frontier. The risks are a) you need to spend millions on RL environments too and b) being lapped by another model release while being tied to a base model. For this to payback, you need to give your customers a better and ideally cheaper inference service than a base model and serve them for long enough to recoup your large investment. Even at 50% margin on inference, to recoup $10M in training means serving ~10T tokens (!) if you price like Fable / Astra given a standard cache read / input / output split ($2/M blended). And you have to justify being better than a release like Opus 5.5 which is even cheaper. Often, you end up charging your customers a huge premium in terms of platform fees and compute fees on top of pure inference. Meanwhile, every hour you’re not utilizing your GPUs you are burning money so you typically resell this compute back to a broker or run inference for open models / resell spot instances. At below a ~60% utilization on spot, you will still lose money. Add to that insane cost of talent. So what can you do with the compute? - Not play the model game at all. - Play an entirely different model game (Jev, World Labs) that if big labs played, would either a) cannibalize their business or b) be incrementally not significant revenue c) would cause too much distraction from the main main thing - Acquire a proprietary data set (Peridodic Labs) in enough volume in a domain of usefulness to eclipse frontier quality. Often happens in robotics, biology, chemistry. If you do overcome the challenge of building a model that is useful and well priced beyond big labs models, given the huge price of compute, you still need to play in an area where the revenue / compute ratio is signficant and market demand is large enough to payback your compute spend. It is a difficult game.
27
24
8
333
62,034
So proud to announce what I’ve been working on over the last few months with the incredible @314Bansal & many other talented humans! Persimmon is a huge first step towards a future where AI is built *for people* and we can’t wait to see what work it inspires 🌟 Do reach out (or request access to our research preview!) if you’re interested in learning more.
For AI to work with us, it needs to understand us Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
20
11
2
142
13,752
big day for human sand! so very excited to finally get to share this, working on this with @alexisjross has been an absolute adventure!! can't wait for what's next :)
For AI to work with us, it needs to understand us Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
4
5
1
51
5,011
Amazing work by @alexisjross and @314Bansal and the team!
For AI to work with us, it needs to understand us Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
1
1
16
1,847
Astra is a high ego model, doesn’t acknowledge mistakes it does. 😂
197
Someone should make a swe benchmark on building remote control for ai coding agents. Otherwise we are going to agi/asi without reliable remote control.
1
186
Astra feels so much better than fable 5.1
5
225
It’s shifting from a winning culture to a celebratory one.
SF people seem to want to brag these days about how cool it is, but the people that historically made SF great were never the cool people. That's kindof a bad sign tbh
3
282
Day 0 support for GLM-5.3-Flash on DeepInfra. $0.15 in / $0.50 out per 1M. $0.03 cached. @Zai_org's 320B-A18B multimodal model — 1M-token context, built for coding and long-horizon agents. Running in US on NVIDIA Blackwell.
5
6
41
2,125
It’s pretty cool that @grok now draws images and diagrams to explain stuff. I’ve wanted this forever!
1
2
257
😍
Introducing DeepInfra Sandboxes: isolated, on-demand compute for AI agents and developers to run code safely. Real VM isolation, sub-second starts, persistent storage. From $0.054/hr, billed per second. SDK: pypi.org/project/deepinfra Learn more: deepinfra.com/dash/sandboxes
2
236
I got 96.2% on ARC-AGI-3 with Opus 5, and 99.3% pass@2. The program is basically Claude Code + Opus 5 (high), one action command, and filesystem logs. Almost nothing ARC specific. github.com/jerber/arc-code
81
128
41
1,572
398,171