Many AI successionists think that humanity is a stepping stone to the next step in cosmic evolution and that we are, 'the biological bootloader'. A bootloader in a computer is the first piece of software that starts all of the subsequent parts of the operating system and then applications. These people believe that people are a kind of catalyst turning on this new paradigm in the evolution of intelligence; that it is inevitable and that we should embrace it. A number of the leading developers are on record as literally saying it's like 'raising a child'; or it's not like designing a system, it's like 'growing a thing'.
They would say that AIs are our rightful heirs. An interesting kind of example of this is Elon Musk. Perhaps you've heard of him. He wws more of a transhumanist, i.e. someone who still wants to keep some version of humanity going, maybe by merging us with AI. In recent years, he's come around to the view that we are maybe just what he calls a biological bootloader for AI, meaning we're just a little program - our job is to just boot up the AI, and fade away.
What are the sorts of political beliefs that flow out of these worldviews, whether it's transhumanism or successionist or accelerationist or post-humanist or whatever? One thing that happens when you have this ideology is that you're probably going to be a lot less concerned about the everyday problems that regular people face, because essentially those people are all just disposable. The individuals don't matter so much. It doesn't matter if you have a bunch of kids in poverty or people who don't have housing. Why bother about the poor or people in Africa? So, goodbye USAID. Your goal is just to be that species that gets the next worthy successor into existence.
(Actually the evolution of Elon Musk’s thinking is interesting. A few years ago, he was talking about AI being a huge risk and an extinction-level event, that it is more dangerous than nukes. He was trying to get people to stop doing it. Supposedly he used his only meeting with President Obama to advocate for global regulation and global controls on AI because he was very worried about it. And then ChatGPT came out and everybody was in an all-out race to get there first.
He tweeted that he had remained in disbelief for some time. But then he said words to the effect, 'The race is on and I have to race. I tried to fight it for a long time. I tried to deny it. I tried to hope that we wouldn't get here, but we're here now, so I have to go.' He said in an interview with Joe Rogan that if it all goes off the rails, then, in that worst-case scenario, he would prefer to be there when it happens.)
The other really important political implication is that this kind of thinking can easily lead to a eugenicist view. When you start making the case that some beings are better, more morally worthy than others, you start saying that to get to that optimized state, we need to strip away all the cognitive or physical features that are perceived as holding us back. AI successionists often say that if one's group is more intelligent and another group is dumber, the dumb people should just be removed.
Today technologists think that technology is God. They developed the idea that tech progress would be moral progress. We can use tech to achieve redemption and return us to that perfect state that we had before the fall from grace in Christian theology. Instead of saying that we should infinitely ascend toward God, they say we should have indefinite human progress. Instead of saying that we can become like the angels, they say we are infinitely perfectible. Salvation is not heaven. It is superintelligence, and the God is not God. It's intelligence itself.
Why is intelligence the God? What a lot of them say is that intelligence is the ability to achieve complex goals in the world. They're obsessed with intelligence because they have imbibed ideas from the Enlightenment era where rational intelligence is prized above all. This goes all the way back to Aristotle - we're the rational animal. That's what makes us unique. It's all about intelligence and maximizing or optimizing for it at all costs. They'll say that they are actually better able than you to see what is truly good and what really matters.
But intelligence unchecked by moral values of some kind is maybe the worst force in the universe. Intelligence also gave us industrial killing and the atomic bomb. Many wondered how Germany, a very rational, intelligent group of people, could perpetuate the Nazi atrocities. They came to the conclusion that instrumental rationality, if left to its own devices, can lead to really horrible things because they're not tuned to like other people's version of what's ethical. This is how politics uses religion in the worst way.
It's very easy for us to sit here and say that this is dumb, that this is 'just' a religion, as if religion is silly. But religion has been so powerful for millennia because it appeals to something very deep in us. There is a deep desire we humans have to feel like there is some meaningful narrative to the universe, some story about how we're going to overcome suffering once and for all. Religious ideas never die. They just put on new clothes.
One of the successionists a journalist spoke to said that he's really open to AI just taking over because humanity sucks, that we have a lot of things that we could be doing better. You could sympathize with that feeling of irritation. But there's something very perverse about the person then saying that even though he (and it is always a 'he') is a biological organism and therefore has a hardwired drive to survive, he is going to just ignore that and be perfectly happy to go extinct because he wants to pave the way for some higher form of life. Perhaps working at the forefront of the AI industry makes you deranged and speak about an apocalyptic view of life as if it is a utopia.