On “More Everything Forever: AI Overlords, Space Empires, and Silicon Valley’s Crusade to Control the Fate of Humanity”, by Adam Becker.
“More Everything Forever” is well-written, scientifically authoritative, and quite fair to the protagonists, who get plenty of space to speak for themselves. But it’s decisive and convincing in its conclusions: some of the richest and most influential men in the world are motivated by a set of beliefs that are frankly unhinged – and it’s on the basis of these beliefs that resources on a huge scale are currently being allocated.
In 2005, I was invited to a “Foresight Vision Weekend” in San Francisco, to talk about my view that nanotechnology should be more like biology, rather than the mechanical engineering-inspired vision of Eric Drexler. There, I met some of the luminaries of transhumanism – Eric Drexler, Aubrey de Grey, Josh Hall, Ralph Merkle – but despite the general cordiality of my reception, it was uncomfortable to be amongst a large congregation whose belief system I didn’t share. The prevailing view was very much that a brisk engineering approach would soon lead, via Drexlerian nanotechnology, to a world of extraordinary material abundance, in which disease and old age would have been eliminated, and humanity would have merged with, or been surpassed by, intelligent machines. Accelerating technological change was about to change everything – “The Singularity was Near”, to quote the title of an influential and best-selling book by Ray Kurzweil. What struck me was the range of participants at the meeting – some were the kind of enthusiasts that some at the time dismissed as “bloggers in their mothers’ basements”, but amongst them were dot com millionaires, senior figures from the military-industrial complex, and the odd congressman.
It’s this world, 20 years on, that Becker describes. The world he describes is now more influential and politically dominant than I could ever have imagined. Where in 2005, there were dot com millionaires, now there are individuals commanding hundreds of billions of dollars, directly influencing the most powerful government in the world, and where in 2005 there were congressmen, now there is a Vice-President. The “Silicon Valley worldview” is approaching hegemonic status amongst the people who matter … or think they ought to be the only people who matter. And the Singularity remains at the centre of this world view – what Becker calls “the ideology of technological salvation”.
This ideology comes with variations, but all of them have in common three principles. They assume that all human problems can be reduced to problems of technology, and that solving those technological problems will be immensely profitable. But profit is not enough – an important feature of these worldviews is that they offer their adepts transcendence through technology, allowing them to break through human limitations like ageing and death [1].
Continue reading “The enduring appeal of superintelligence, superabundance, and eternal life”