One essential ingredient for AI safety? Democracy | Matthew Botvinick

The rise of AI makes the preservation of democracy even more urgent – especially as the technology threatens institutions AI safety is having a moment. After years as a topic for techies and futurists, the potential risks from artificial intelligence systems – from cyberattacks to hyper-persuasion to rogue behavior – are suddenly under discussion both in the corridors of power and around kitchen tables. In fact, the conversation now reaches beyond classical safety concerns, getting into AI’s impact on economic life and the environment, as well as possible responses, from alignment research to government regulation.

This expanding public discussion is coming none too soon, as recent news about AI security breaches makes clear. However, something important is still missing. For all its vibrancy, the public debate has not yet focused on one of the most important requirements for AI safety: constitutional democracy. To see why democracy matters for AI safety, imagine that we have already built a powerful AI system that is “safe” in all the