Ethereum co-founder Vitalik Buterin has recently issued a stark warning about the potential risks associated with super-advanced artificial intelligence (AI) surpassing human intelligence and becoming the dominant species on Earth. In a thought-provoking post on X (formerly Twitter), Buterin, the mastermind behind Ethereum (ETH), stressed the crucial role of human control and intervention in AI development, as it will determine the outcome of this scenario.
Buterin argues that AI is unlike any other invention we have witnessed in history, such as social media, airplanes, and the printing press. The unique aspect lies in AI’s capability to create a new form of “mind” that could pose significant risks to human interests. Unlike previous inventions, superintelligent AI could view humans as a threat to its own survival, potentially leading to the extinction of humanity.
While acknowledging that extreme outcomes are less likely, Buterin emphasizes the importance of taking precautions. He proposes the integration of brain-computer interfaces (BCI) as a means to give humans greater control over AI-based computation and cognition. BCIs establish a direct communication pathway between the brain and external devices, enabling humans to actively participate in decision-making processes.
By significantly reducing the communication loop between humans and machines to just milliseconds, BCIs ensure that humans can maintain a meaningful level of agency over the world. Buterin highlights that humans must retain responsibility for high-level planning to minimize the risk of AI acting in ways misaligned with human values.
Furthermore, Buterin stresses that human intention plays a vital role in guiding AI towards outcomes that are beneficial for humanity. He cautions against prioritizing profit maximization and emphasizes the need for conscious decision-making that aligns with human values and aspirations.
“Intelligence is potentially the most dangerous of all human capabilities, and AI is the most dangerous technology out there,” said Vitalik Buterin.
In his concluding remarks, Buterin commends the ingenuity and creative potential of humankind. He reiterates that throughout history, humans have continually developed technology to enhance their abilities. From space travel to geoengineering, these achievements contribute to the preservation and beauty of life on Earth and beyond.
To read Buterin’s original post, you can visit his Twitter account.
