Intelligence vs Agency
We worry incessantly about intelligence (in machines and aliens), but intelligence is merely the ability to create models of the world. Agency, or the ability to act on behalf of yourself, and influence the world and others around you, is more problematic. Musk is not a “Superintelligence” but he is a “Superagent”.
Types of Paperclip Maximizers
Nick Bostrom’s thought experiment involved a Type-1 paper-clip maximizer – a naive superintelligence truly believing they are doing good work. Any genocides carried by this type of maximizer is purely an “accident”. I’m taking the liberty to extend the notion of a paperclip maximizer to a Type-2 and Type-3, where the paperclip maximizers gain emergent properties of Deception and Retaliation, respectively.
Why the hell should you care?
Elon is not the first Superagent, nor will he be the last. But with the increasing wealth gap in our societies, the likelihood of rogue chaotic Superagents causing havoc in our governing systems (that were not built to be agent-proof), will become an increasing risk to the peace and stability you enjoy and take for granted.