"The notion of singularity ... is a religion"

This essay from Joi Ito makes a lot of points that will feel familiar to regular readers (mistaking S-curves for exponential when discussing technological progress, the rise of cult-like thinking -- what we've been calling magical heuristics). Lots of other good stuff as well, which is pretty much what you'd expect from the director of MIT’s Media Lab.

The notion of singularity – which includes the idea that AI will supercede humans with its exponential growth, making everything we humans have done and will do insignificant – is a religion created mostly by people who have designed and successfully deployed computation to solve problems previously considered impossibly complex for machines.

They have found a perfect partner in digital computation, a seemingly knowable, controllable, machine-based system of thinking and creating that is rapidly increasing in its ability to harness and process complexity and, in the process, bestowing wealth and power on those who have mastered it.

In Silicon Valley, the combination of groupthink and the financial success of this cult of technology has created a feedback loop, lacking in self-regulation (although #techwontbuild, #metoo and #timesup are forcing some reflection).

On an S-curve or a bell curve, the beginning of the slope looks a lot like an exponential curve. According to systems-dynamics people, however, an exponential curve shows a positive feedback curve without limits, self-reinforcing and dangerous.

In exponential curves, Singularitarians see super-intelligence and abundance. Most people outside the Singularity bubble believe that natural systems behave like S-curves, where systems respond and self-regulate. When a pandemic has run its course, for example, its spread slows and the world settles into a new equilibrium. The world may not be in the same state as before the pandemic or other runaway change, but the notion of singularity – especially as some sort of saviour or judgment day that will allow us to transcend the messy, mortal suffering of our human existence – is fundamentally a flawed one.