we must build like this again

I think I need to build this obstacle course in my back yard.

The AI doomers must be defeated because infinite fear demands infinite repression. They've created a moral singularity by imagining an event with effectively infinite negative value - the self-extinction of humanity - that demands they take coercive action to prevent it now. The extinction is uncertain, but the doomers have Pascal-mugged themselves into treating it as though it's certain. But the coercion they want to use to prevent it is not uncertain at all. Condider this: if recursive self-improvement in AIs is possible at all, how are they going to prevent everyone, forever, from achieving RSI in an AI? In the most benign version of their future, you can't have a computer or GPU that's above a certain maximum power level. Also, open source AI models and open source development in general have to die - it would be too difficult to close off paths that could lead to RSI unless computers are licensed, monitored, and crippled. But the actual outcome would be much, much worse. Because excuses for coercion and repression, however well intended, attract people for whom repression is the goal, not just a regrettable necessity. We just spent a decade watching that kind of power-seeker try to turn society into a totalitarian panopticon over what they called "hate speech". What do you suppose they would do with a much bigger rhetorical club labeled "species extinction"? The implication of believing doomer eschatology is a boot grinding on our human faces, forever. I do not submit.