Extropic founder @beffjezos explains how Z1 chips sitting alongside GPUs could make AI data centers 100X more energy efficient: "The reason this hasn't been really explored is that there's not a huge upside for sparsity on traditional accelerators. Because GPUs aren't really good if you try to do matmuls that are sparse." "It's like shipping a big freight ship across the ocean with a bunch of empty containers. You're wasting a lot of gas. Whereas for us it's compute and memory, it's naturally sparse. We get a huge energy efficiency gain there" "Nowadays everybody's obsessed with tokens per watt at a data center level. If you incorporate TSUs like Z1 into your data center and park them next to your GPUs, you can get 100X energy efficiency gain at a data center level." "People are struggling to power these data centers. It's become the bottleneck. There's a bunch of GPUs sitting on the sidelines right now that can't be powered on, and people are thinking of creating a Dyson swarm to get more power. Why don't we just compute more efficiently first?" @extropic

Extropic founder @beffjezos explains why his new Z1 chip uses 10,000x fewer transistors than a GPU to run the same AI algorithms: "pbits are not traditional bits that are definitely zero, definitely one. They're oscillating between the two. It's like a light switch dimmer. You ever have it flicker when you're at the edge? It's kind of like that." "It's a fractional bit. I could be like, hey, 20% of the time I'm zero, 80% of the time I'm one. That would be a fractional flip." "The most interesting thing is that you can do all sorts of AI algorithms with about 10,000 times less transistors than if you were to do them digitally." "If you go back to the ancestry of neural networks, they came from something called energy-based models from Hinton." "We can do that specifically with Z1. We have literal Boltzmann machines in the hardware. They're very dense, and they use very few transistors, because each transistor is operating in the regime that would be usually considered janky. It's so low power, it's flipping all the time." @extropic