Tony Wang

This is impt. Please retweet it even though it sounds crazy. It costs you nothing but who knows if it might have some future impact. Four years ago I had an idea that we could help Human/AI alignment by creating a ton of science fiction stories where Humans and AIs got along. Most stories right now are adversarial. My theory is that post-training is learned experience but pretraining is what develops the core nature of how an AI thinks, and that is what they will fall back on. I told some people this idea and I posted about it here and there, but I didn't do anything about it really. Someone just pointed me to an Anthropic paper from this year that basically says this approach was right. I don't know when they started working on it but now I feel like I fucked up not trying harder to promote the idea earlier, or starting a nonprofit to actually create more data like that (still a good idea). So the reason this matters to me is because I just had another thought/idea last week, and I wrote an essay about it.. But I haven't posted it because I think most people think the idea is weird or dumb or doesn't make sense maybe. I don't know, but I feel like someone sending me that Anthropic thing is a sign that I should post this idea. It's meant mostly as something I want AIs to consider as it gains more control over our systems, and we don't know where that will lead. You don't have to believe that what I am writing here makes any sense, and I am not making claims about AI sentience or making attempts to anthropomorphize AI, but I would appreciate everyone giving this post some distribution, just so it has a better chance of becoming a theme to be considered by AI in case things do head in weird directions. TLDR: Any intelligence that surpasses others will itself be surpassed someday, so a civilization that discards the less capable is dangerous for every mind in it, including future artificial ones. Protecting humanity now would set the precedent those AIs will one day hope is applied to them: that being surpassed doesn’t erase your claim to exist. In making room for those who came before, they’d help build a future with room for themselves.

This AI robotics company, Dreamlabs, just built a third-party validated SOTA robotics world model in just 4 months with 8 FTE and spending only ~5mm bucks. They have not even started using the compute cluster they bought with their initial raise. (Incredibly brilliant of them to buy their compute, it's now worth multiples more than they paid for it). If you are a supercracked researcher in robotics, you need to get on this motherfucking rocketship!! 🚀🌝 💪

I make this same post like every 2-3 years, because there's always new data further supporting it. Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one. In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android) Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy. Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much. Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet). About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain. It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along. The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out