Calculations Show It’ll Be Impossible to Control a Super-Intelligent AI

Science Alert   January 14, 2021
Superintelligence is a hypothetical agent that possesses intelligence far surpassing that of the brightest and most gifted human minds. Considering recent advances in machine intelligence, several scientists, philosophers, and technologists predict potentially catastrophic risks entailed by such an entity. An international team of researchers (Spain, Germany, USA – UC San Diego, Chile) trace the origins and development of the neo-fear of superintelligence, and some of the major proposals for its containment. They argue that total containment is, in principle, impossible, due to fundamental limits inherent to computing itself. Assuming that superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) impossible…read more. Open Access TECHNICAL ARTICLE