Elon Musk says a chip for space should run hot, since raising the temperature 20% in Kelvin cuts radiator mass in half, and that a multi-trillion parameter model does not care about a few bit flips “Well, I guess you want to design it to be more radiation tolerant and run at a higher temperature. So roughly, if you increase the operating temperature by 20% in degrees Kelvin, you can cut your radiator mass in half. So running at a higher temperature is helpful in space." "There’s various things you can do for shielding the memory, but neural nets are going to be very resilient to bit flips. So most of what happens for radiation is random bit flips." "But if you’ve got, like, you know, a multi-trillion parameter model and you get a few bit flips, it doesn’t matter. Heuristic programs are going to be much more sensitive to bit flips than some giant parameter file. So I just design it to run hot. And I think you pretty much do it the same way that you do things on Earth, apart from make it run hotter.”