On Wednesday, Prince Harry and Meghan Markle joined a diverse group of computer scientists, economists, artists, evangelical Christian leaders, and American conservative commentators Steve Bannon and Glenn Beck to advocate for a ban on AI "superintelligence." This urgent call focuses on the potential dangers posed by AI technologies that could surpass human intelligence in numerous tasks.
The letter targets major tech companies such as Google, OpenAI, and Meta Platforms, which are vigorously competing to develop forms of artificial intelligence capable of significantly outperforming humans. It emphasizes the need for caution in AI development, particularly in the pursuit of superintelligence.
The 30-word statement from the group declares: "We call for a prohibition on the development of superintelligence, not lifted before there is broad scientific consensus that it will be done safely and controllably, and strong public buy-in."
In the preamble of the letter, signatories acknowledge the potential benefits of AI tools in promoting health and prosperity. However, they also express serious concerns, citing risks of human economic obsolescence, loss of civil liberties, and even threats to human existence. The signatories argue that the goals of leading AI companies to develop superintelligence within the next decade raise profound questions about safety and societal impact.
Prince Harry highlighted the ethical implications of AI, stating in a personal note, "The future of AI should serve humanity, not replace it. I believe the true test of progress will be not how fast we move, but how wisely we steer. There is no second chance." His wife, Meghan, added her support to the call for caution in AI development.
Among the notable signatories is Stuart Russell, a pioneering AI expert and computer science professor at UC Berkeley, who emphasized that the initiative is not a direct ban but a push for ensuring safety measures for technologies with significant risks. He questioned, "Is that too much to ask?"
Additionally, the list of signatories includes renowned AI pioneers Yoshua Bengio and Geoffrey Hinton, both Turing Award winners who have vocally addressed the dangers associated with AI technologies they helped develop. The inclusion of Bannon and Beck aims to appeal to elements of the conservative community, including supporters of former President Donald Trump, highlighting a bipartisan concern regarding AI development oversight.
The letter's signatories also feature high-profile individuals such as Apple co-founder Steve Wozniak, British billionaire Richard Branson, former U.S. Joint Chiefs Chairman Mike Mullen, and Susan Rice, who served as national security adviser under President Barack Obama. Other signatories include former Irish President Mary Robinson, several British and European parliamentarians, and entertainers such as actors Stephen Fry and Joseph Gordon-Levitt, along with musician will.i.am, who has previously embraced AI in his creative endeavors.
Joseph Gordon-Levitt expressed his enthusiasm for specific AI applications that could address societal challenges but criticized AI's potential to mimic human behavior and contribute to issues such as addiction and excessive commercialization. He noted, “Most people don’t want that.”
The letter is expected to stimulate ongoing debates within the AI research community regarding the plausibility of achieving superhuman AI, the methods to reach that goal, and the associated risks. Max Tegmark, president of the Future of Life Institute and a Massachusetts Institute of Technology professor, remarked that the shift in criticism towards a more mainstream audience signifies a growing apprehension regarding AI's trajectory.
Tegmark has pointed out the potential for overhyped AI capabilities, suggesting that while companies may inflate their products' features for marketing reasons, genuine advancements in AI have been quicker than many anticipated. He advocates for stigmatizing the race toward superintelligence as a critical step in ensuring responsible AI development.
The Future of Life Institute is behind the letter, which follows a March 2023 missive that sought a temporary pause in the development of advanced AI models—a call largely ignored by major companies. In his outreach efforts, Tegmark noted he contacted CEOs of significant AI firms but did not expect their participation in the initiative.
