No one changes the world alone
Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models
Available to everyone through our API
vpj retweeted
Search your Mac by what's in your files, not what they're called.
DigUp runs @GoogleDeepMind's new EmbeddingGemma 2 on-device: describe a video moment, a podcast minute, a PDF page, a photo or code, in any language, and dig it up.
github.com/ARahim3/DigUp
Free and open source. @googlegemma
💯
I am lucky to have worked closely with him many years and he’s been insanely accurate at predicting technology, what areas to work on and how to.
Most people who know him as an investor have no clue, but he is one of the best at math and coding.
I make this same post like every 2-3 years, because there's always new data further supporting it.
Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one.
In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android)
Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy.
Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much.
Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet).
About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain.
It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along.
The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out
vpj retweeted
Looped transformers with tied weights might make pretty nice local models and assistants
vpj retweeted
Replying to @humansand
@humansand is hosting a party tonight & we are hiring in all workstreams!
if you are interested in working on user models or have a project in mind for persimmon, come find me or @314Bansal
p.s. we are almost at capacity at the event but will prioritize people who are interested in working with us so feel free to shoot me a message ✉️
partiful.com/e/sBqYtz1ehDZoW…
GPT-6 and Intelligent UI, now rolling out in ChatGPT for everyone.
Intelligent UI in ChatGPT delivers fast, interactive answers that make everyday questions more visual, complex topics easier to grasp, and interactive tools for your task available on the spot.
vpj retweeted
Or, build a cluster and own the hardware, make your money go way further, still have a valuable asset after 3-5 years, and make a differentiated model bet. That's what humans& did
Huge thanks to @DeepInfra and to @nvidia @Supermicro for working with us to make it happen
The economics of a Neolab.
A neolab is loosely defined as a startup of AI researchers who raises a lot of money pre-production to be able to finance GPU compute to take on a large AI problem.
To buy 1000 GB300s or ~14 NVL72 racks will set you back $125-150M for 3yrs with 15-30% upfront. That’s about ~2-2.5MW.
Thats about enough to do 10^25 flops a quarter and get to a GPT-4 level model which is 1-2 OOMs off frontier for pretraining.
If you post-train on a great open source model, you have a better chance of getting to frontier. The risks are a) you need to spend millions on RL environments too and b) being lapped by another model release while being tied to a base model.
For this to payback, you need to give your customers a better and ideally cheaper inference service than a base model and serve them for long enough to recoup your large investment. Even at 50% margin on inference, to recoup $10M in training means serving ~10T tokens (!) if you price like Fable / Astra given a standard cache read / input / output split ($2/M blended). And you have to justify being better than a release like Opus 5.5 which is even cheaper. Often, you end up charging your customers a huge premium in terms of platform fees and compute fees on top of pure inference.
Meanwhile, every hour you’re not utilizing your GPUs you are burning money so you typically resell this compute back to a broker or run inference for open models / resell spot instances. At below a ~60% utilization on spot, you will still lose money.
Add to that insane cost of talent.
So what can you do with the compute?
- Not play the model game at all.
- Play an entirely different model game (Jev, World Labs) that if big labs played, would either a) cannibalize their business or b) be incrementally not significant revenue c) would cause too much distraction from the main main thing
- Acquire a proprietary data set (Peridodic Labs) in enough volume in a domain of usefulness to eclipse frontier quality. Often happens in robotics, biology, chemistry.
If you do overcome the challenge of building a model that is useful and well priced beyond big labs models, given the huge price of compute, you still need to play in an area where the revenue / compute ratio is signficant and market demand is large enough to payback your compute spend.
It is a difficult game.
vpj retweeted
So proud to announce what I’ve been working on over the last few months with the incredible @314Bansal & many other talented humans!
Persimmon is a huge first step towards a future where AI is built *for people* and we can’t wait to see what work it inspires 🌟
Do reach out (or request access to our research preview!) if you’re interested in learning more.
vpj retweeted
big day for human sand!
so very excited to finally get to share this, working on this with @alexisjross has been an absolute adventure!! can't wait for what's next :)
Amazing work by @alexisjross and @314Bansal and the team!
vpj retweeted
Day 0 support for GLM-5.3-Flash on DeepInfra.
$0.15 in / $0.50 out per 1M. $0.03 cached.
@Zai_org's 320B-A18B multimodal model — 1M-token context, built for coding and long-horizon agents. Running in US on NVIDIA Blackwell.
😍
Introducing DeepInfra Sandboxes: isolated, on-demand compute for AI agents and developers to run code safely. Real VM isolation, sub-second starts, persistent storage. From $0.054/hr, billed per second.
SDK: pypi.org/project/deepinfra
Learn more: deepinfra.com/dash/sandboxes
vpj retweeted
I got 96.2% on ARC-AGI-3 with Opus 5, and 99.3% pass@2. The program is basically Claude Code + Opus 5 (high), one action command, and filesystem logs. Almost nothing ARC specific.
github.com/jerber/arc-code



















