Tony Wang (@TonyW) header
Tony Wang (@TonyW) profile picture

Managing Partner @500GlobalVC. Tech adviser, investor and executive. Previously: operator at @Google @Twitter @Color

🇹🇼-🇺🇸-🇬🇧-🇺🇸-🇹🇼-🇺🇸
Joined October 2009
Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)Photo by Tony Wang (@TonyW)
I don't get enough credit for not stepping on my dog.
22
29
2
281
If you read just one thing today make it this paragraph from C.S. Lewis
21
721
22
5,122
138,967
😂 “In your call with Elon tomorrow, be sure to remind him that research takes longer than one might expect, and that DeepMind is a relaxed environment”
1
2
470
Source:
Ilya Sutskever texts Greg Brockman November 21, 2015
1
139
Tony Wang retweeted
This is impt. Please retweet it even though it sounds crazy. It costs you nothing but who knows if it might have some future impact. Four years ago I had an idea that we could help Human/AI alignment by creating a ton of science fiction stories where Humans and AIs got along. Most stories right now are adversarial. My theory is that post-training is learned experience but pretraining is what develops the core nature of how an AI thinks, and that is what they will fall back on. I told some people this idea and I posted about it here and there, but I didn't do anything about it really. Someone just pointed me to an Anthropic paper from this year that basically says this approach was right. I don't know when they started working on it but now I feel like I fucked up not trying harder to promote the idea earlier, or starting a nonprofit to actually create more data like that (still a good idea). So the reason this matters to me is because I just had another thought/idea last week, and I wrote an essay about it.. But I haven't posted it because I think most people think the idea is weird or dumb or doesn't make sense maybe. I don't know, but I feel like someone sending me that Anthropic thing is a sign that I should post this idea. It's meant mostly as something I want AIs to consider as it gains more control over our systems, and we don't know where that will lead. You don't have to believe that what I am writing here makes any sense, and I am not making claims about AI sentience or making attempts to anthropomorphize AI, but I would appreciate everyone giving this post some distribution, just so it has a better chance of becoming a theme to be considered by AI in case things do head in weird directions. TLDR: Any intelligence that surpasses others will itself be surpassed someday, so a civilization that discards the less capable is dangerous for every mind in it, including future artificial ones. Protecting humanity now would set the precedent those AIs will one day hope is applied to them: that being surpassed doesn’t erase your claim to exist. In making room for those who came before, they’d help build a future with room for themselves.
13
13
3
56
5,128
😧 Today the public markets got brutalised. It’s a great reminder that in the short term it is a voting machine (in this case near literally 🗳️) and in the long term it is a weighing machine. ⚖️ It’s also a great example of the gap between what I am seeing in the private markets versus was the public markets. There’s a lot of sheer mass being created in the private markets that the public markets haven’t weighed yet. It will in time, but I wanted to document this moment of absolute dislocation. 🦾
1
4
451
👀
#1 US-based provider on @OpenRouter. 2.4T tokens a day. Zero data retention. No training. Thank you, builders.
3
508
Another update from @humansand for researchers: Efficient weight updates: “the bottleneck ends up being the GPU hardware’s decompression ASIC”
Large-scale RL has a problem: weight updates from trainers to samplers are slow and expensive We’re sharing weight teleportation: faster weight updates than existing intra-cluster techniques with internet speeds, enabling samplers anywhere (maybe even space!) Weight teleportation is so efficient (<0.23s sampler pause time, ~3s non-blocking compression + prepare), the bottleneck ends up being the GPU hardware’s decompression ASIC We unlock these gains by using GPUs for massively parallel compression of model weight changes, engineering a heterogeneous decompression and patching pipeline, along with other optimizations and overlaps. These techniques are co-designed with hardware-native features in NVIDIA’s Blackwell generation of chips We’ve open-sourced weight teleportation, so everyone can use it today
1
12
901
🚨 Please congratulate my better half @melwang on finishing the NYC Marathon 🗽and wish her a happy birthday! 🎂 So proud of you! 🙌
1
11
751
Anyone comparing financing GPUs to airplanes please explain what I got wrong here or what you would improve👇🏼
Replying to @chamath
Interesting analogy. Markets haven’t figured this out yet, but markets also haven’t grasped the flip side: the smartest researchers in the world are improving models that get served by these GPUs both in terms of efficiency and quality. An H100 can serve more tokens today than three years ago, and each token has more value now due to model improvement. In the aircraft analogy, it would mean the cost per seat comes down (token index declining), those seats turn into business class (higher quality tokens), and over time the plane fits more seats in each flight (more efficient models). What happens to the residual value in that context? More interestingly, if that’s true, what happens to the demand for air travel? Exciting times for markets.
365
I used to think we are all going to be pandas 🐼 but I think I already am one 🥱
Pandas spend the first hour after waking up struggling to fully wake up
1
2
513
In NY this weekend doing some sympathy carbo-loading for my wife who is running the NYC marathon on Sunday. Wish me luck.
2
13
554
You know how AI is uncovering security vulnerabilities in code right now? Well get ready for the avalanche of bugs—and outright fraud—coming from academic research.
Not sure what is more striking—how bad the research audited here seems to be, or the thought that a lot of other research might come out similarly shaky. Via @tylercowen / @MargRev – saez-zucman-audit-replicatio…
2
259
Cloud revenue accounts for about 24%. Even incumbent CPU clouds will become neoclouds.
For the first time EVER, $GOOGL Search as a % of revenue is now below 50%.
277
Tony Wang retweeted
This AI robotics company, Dreamlabs, just built a third-party validated SOTA robotics world model in just 4 months with 8 FTE and spending only ~5mm bucks. They have not even started using the compute cluster they bought with their initial raise. (Incredibly brilliant of them to buy their compute, it's now worth multiples more than they paid for it). If you are a supercracked researcher in robotics, you need to get on this motherfucking rocketship!! 🚀🌝 💪
Replying to @dreamlabs_ai
@dreamlabs_ai is hiring! We have great opportunities across research, engineering and operations. I'm focused on hiring for two roles now: (1) robot learning researcher and (2) security & IT systems engineer. If interested please reach out directly or careers@dreamlabs.ai.
1
6
31
2,946
👀
SITUATION DETECTED: Amazon CEO Andy Jassy says that AWS capacity for 2026 is completely sold out, 2027 is largely sold out, and "a good chunk" of 2028 is already sold as well.
1
477
This has been quite a week with the pace of releases from @humansand. Just in case there was any questions on how productive the team has been…here’s another!
This is pretty nice, our kernel increases both accuracy and speed at the same time and is open source available freely for everyone to use - our way of giving thanks to the open community that we have benefited from ♥️
1
1
8
1,020
Tony Wang retweeted
I've known Georges Harik for over 25 years. Proud to back him, Eric, Yuchen, Noah, and the entire @humansand team as they build AI that understands people and helps us accomplish more together. Excited to see Boba out in the world. Give it a try!
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
6
8
1
73
10,876
Tony Wang retweeted
Putting all our work together we present Boba! Using our Ampersand model, trained in simulation with our Persimmon model to be a great collaborator while respecting your preferences and values - here we put it all into practice, helping people.
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
6
8
59
2,537
Having a U.S. based CRO with AI, science and robotics to automate lab experiments to create molecules is ambitious . Great to see a stellar team to put this together. Let’s go @kevinweil @dpatil @manohar_paluri @warpsciences
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster. We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America. I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL.
1
1
10
462
Another great launch today, this one from the @humansand team. Let’s go 🔥
it's a good model, folks 🫡
1
7
446