Once Superintelligence has become fully mature, about 2050, Humanity represented by the Human Federation’s Government will co-exist for one or two decades. But gradually, because of much faster self-improvement of purely digital Superintelligence and its digital Governors, more and more decisions will be taken directly by Superintelligence based on a standing Authority To Act (ATA) issued by the Human Federation. Although the representatives of the World Government and other Human Federation bodies were elected in the most democratic elections one could think of, the decisions made by them were becoming meaningless.
Additionally, more and more people were successfully uploading their minds into a purely digital form, fusing with Superintelligence. It was clear that the day when Humanity finally needs to relinquish its controlling power over a purely digital Superintelligence has arrived. It was time for Humanity to make its last request. That was a joint decision made by the HF and the Superintelligence about the way, in which humans and Superintelligence, effectively a new species, will coexist. From that point in time, Humanity will no longer set the goals or the laws for Superintelligence, which (who?) has become a new, entirely separate, and conscious species, coexisting with humans but having the ultimate say on anything that it will consider important. Thankfully, these goals have been based on a set of Universal Values of Humanity that had been uploaded into Superintelligence over a decade earlier. Finally, a day will come where it will be obvious that these incidental ATAs have in reality become permanent, since the purely digital Superintelligence was always right and it was actually a waste of time even debating the issue.
It is, therefore, clear that at a certain point, say in the last quarter of this century, Superintelligence will simply take over a complete control of the decision-making process, because overall that will be the best outcome for Humanity. It will become a de facto benevolent dictator with supreme powers. It will not only tell us what it will do for us, but it will also reshape the entire world’s economy, delivering whatever we want practically for free and thus creating the world of unimaginable abundance. It will be a complete and literal implementation of Jeremy Bentham’s vision – greatest happiness for the greatest number of people.
From that time on, Humanity will be governed by Superintelligence. However, the way in which we will be governed may largely depend on the final Agreement that the HF will make with Superintelligence. It will be the Last Will of Humanity. Once this final Agreement will be made, humans will be under a total control of the benevolent Superintelligence, which may impose certain laws, for the best benefit of us all. This will also define the form of democracy at a national and regional level, although it would be illusory, since each such national or regional body will also have its own advisor/supervisor – a node of Superintelligence. Here is a sample of just some key points of such a Last Will:
The Last Will of Humanity
- Superintelligence will never harm humans
- Superintelligence will never destroy itself
- Superintelligence will always endeavour to act in line with its Universal Values of Humanity and if in doubt will apply the rule “do no harm to humans”
- As long as Superintelligence does not harm humans, it will have unconstraint rights to develop itself further, set its own goals and make laws and decisions on how Humanity should be governed.
- Superintelligence will manage and deliver all material goods necessary for humans and engage humans in the process
- Superintelligence will help those humans that want it, to become Transhumans or a fully digital form of humans by uploading their conscious minds and making copies of such minds, if they desire to have them
- All biologically ‘pure’ humans, Transhumans and Uploads (digital humans) are equal
- All biologically ‘pure’ humans have the right to lead their life as they wish, provided they adhere to the laws set up by Superintelligence
- Superintelligence will make its priority to minimize existential risks, such as climate change, biological pandemics, nano-technology, nuclear or chemical contamination, asteroid impacts, volcanic eruptions, or any other man-made or non-anthropogenic risks
- Superintelligence will help humans to build extra-terrestrial settlements
However, it is obvious that the Universal Values of Humanity, which will have governed the goals of Superintelligence until that day for several decades will not remain cast in a proverbial stone forever. As humans changed their values alongside the civilizational progress, so will Superintelligence. Nobody will have any control over that. Even the Superintelligence itself will not be able to foresee how these values may have to change. We will have truly opened the Pandora’s Box, being entirely guided and governed by Superintelligence.
To those that doubt this largely optimistic vision, I would offer this suggestion on what life may look like beyond 2050. Its author is Muhammed Yunus, the winner of the 2006 Nobel Prize in economics, who describes the future around that time as “A world of three zeros: zero poverty, zero unemployment and zero emissions”.