OpenAI’s New Theory of AI: The Real Danger Is a Government That No Longer Needs People
OpenAI’s Strategic Futures team is looking beyond the usual fears of artificial intelligence taking jobs or becoming uncontrollable, warning that the technology could eventually reshape the balance of political power itself.
The company notes that the blog post reflects the views of its author, Dean Ball, and does not necessarily represent the official position of OpenAI or other employees.
The company’s new Strategic Futures team is examining a future in which autonomous systems, AI-run bureaucracies and machine-generated economic output could give governments unprecedented independence from the people they govern — potentially weakening citizens’ leverage even if elections and democratic institutions remain intact.
Ball argues that the biggest long-term AI risk may be the "concentration of power" and asks how free societies can preserve individual rights and agency as increasingly capable AI systems emerge.
Where Political Power Is
The concern centers on a basic assumption that has shaped governments for centuries: political power ultimately depends on the cooperation of people.
Governments rely on human workers, including soldiers, police officers and bureaucrats, while much of their revenue comes from taxes on human labor and economic activity. That creates a relationship in which governments, at least in theory, must maintain some degree of public support and consent.
AI could change that equation. Ball writes that advances in autonomous systems could eventually allow governments to project force without relying as heavily on human soldiers or police. At the same time, increasingly capable AI systems could allow states to generate revenue through highly automated economies and operate large portions of their bureaucracies with machines.
If that happens, the public could have less leverage over the institutions exercising power. That scenario does not necessarily require the end of elections. OpenAI’s Strategic Futures team argues that people could lose meaningful political agency even while democratic rituals remain in place.
"Humans can be on their way to disempowerment even if the routine of voting for our representatives is maintained," Ball writes.
The warning reflects a broader argument that traditional safeguards may not be enough to prevent excessive concentrations of power in an AI-driven economy. Laws and constitutions can establish limits, but OpenAI argues that the underlying distribution of technological and economic power may ultimately matter just as much.
The company does not present decentralization as a simple solution, either. Ball warns that giving everyone unrestricted access to powerful AI systems could create its own risks, particularly if individuals or autonomous systems can cause widespread harm.
Instead, the Strategic Futures team says the goal should be a balance in which no single company, government or small group can dominate society.
Among its principles, the team says humans should retain individual autonomy when using AI, laws should empower individuals and smaller organizations where possible, and political, social and economic institutions should remain in control of major decisions even as those institutions evolve.
The Strategic Futures team says it plans to share its work in various blog posts, as well as papers, videos and podcasts.
"Our efforts will be a work in progress, with an emphasis on iteration, debate, and receptivity to feedback. Standing "in the foothills of the singularity," we have many more questions than we have answers. Our highest hope is to shed light on the most difficult subjects relating to how AI will reshape our world. Our work has only just begun, and we have much climbing left to do," the post concluded.
Photo: Shutterstock
