Regular readers know we've been discussing the deeply dysfunctional and just plain weird culture of the techno-optimists for going on 20 years now.
Probably the first thing you need to keep in mind when dealing with the movement is that the optimism here is about the speed and magnitude of upcoming technological changes, not necessarily about whether their impact will be wonderful or catastrophic as long as it's big and soon. The AI doomsters are an outgrowth of the movement, and their ideas still find their greatest audience there. The conflict between the abundance crowd and the doomsters is essentially a sectarian disagreement between people who believe that large language models are on the verge of achieving god-like powers, which they will use to usher in a golden age free of want, and people who believe that large language models are on the verge of achieving god-like powers, which they will use to exterminate humanity.
This leads us to arguably the second most important thing to remember about techno-optimists: this is not a movement based on deep thinkers or profound insights into the nature of technology. Instead, the primary intellectual foundation comes from postwar science fiction, mostly filtered through movies, TV shows, and comic books. (Other influences include a fascist-friendly form of libertarianism, the Ithuvania effect, and constant and shameless grifting.)
Techno-optimists tend to have a notably weak grasp of the thing they claim to be obsessed with. Just listen to Elon Musk going off script talking about space travel or Marc Andreessen explaining how he simply tells chatbots not to hallucinate. Conversations that pass themselves off as explorations of the future of technology largely consist of sci-fi tropes being passed around. Ideas such as bipedal humanoid robots are judged not based on the soundness of their engineering, but on how well they would fit in with old Galaxy magazine covers or Mystery in Space comics.
One of the most common of these tropes dates back at least to Dial F for Frankenstein (Playboy, January 1965), a decidedly minor Arthur C. Clarke work, a lead-up to a pun that is weak even given the low standards of the genre. (If you want lighthearted Clarke, stick with Tales from the White Hart.) It is, however, one of the earliest examples of a popular sci-fi trope which has blossomed into something close to a religious movement in the past few years.
The idea is that if you construct a sufficiently complex system, superintelligence will almost immediately and spontaneously emerge, along with other human traits such as vengefulness, the need to dominate and control, and, most importantly, an overpowering survival instinct.
It is a trope born of equal parts anthropomorphism and narrative necessity. That sort of thing is fine for literary purposes, but we now have rich and powerful people who actually believe this, and that's not fine at all.




