Artificial Intelligence
Altman outlined three AI safety governance options
A report said Sam Altman told OpenAI staff about three ways to govern advanced AI, ranging from an IAEA-style watchdog to a single dominant company and a lab merger plan.
- The Information reported that Sam Altman described three internal options for governing advanced AI.
- The options were an International Atomic Energy Agency-style watchdog, a merger or umbrella arrangement for leading labs, and a scenario in which one company became powerful enough to withhold compute from others.
- OpenAI planned to decide within the next year which path to pursue, while Altman said it could not afford to lose ground to rivals.
- The article said OpenAI, Google and Anthropic were building the Standards Authority for Frontier AI, while the U.S. government had relied on voluntary reviews and had imposed export controls on Anthropic over Fable.
The Information reported that Sam Altman told OpenAI employees last week about three approaches to governing advanced AI. The report said the comments came as the Trump administration was preparing its first framework for superintelligence developers.
The first option would have created a body modelled on the International Atomic Energy Agency. OpenAI had publicly called for such an institution in May 2023, and the article said it would inspect systems, require audits, and monitor compute and energy use.
The second option was described as the “Demis Plan”, after a proposal Demis Hassabis made about ten years ago. In Altman’s version, the major labs would merge into one organisation or work under its umbrella, and that body would provide models to cooperating countries.
The third option was named the “Eliezer Plan”, after Eliezer Yudkowsky. In that scenario, a developer would gain enough economic power through self-improving AI to withhold compute from everyone else and, in the most extreme case, cut off their computing capabilities; one source said the remark sounded like a jab at a competitor.
The article said Altman had complained that there were too few workable proposals for a speed limit on AI development. It also said OpenAI planned to choose a route within the next year, that OpenAI and Anthropic were reportedly working towards initial public offerings, and that OpenAI, Google and Anthropic were building the Standards Authority for Frontier AI while Meta and Nvidia pushed back on the idea.
Named in this story
People
- Sam Altman
- OpenAI’s chief executive who outlined the three options internally
- Demis Hassabis
- the former Google AI lab head whose proposal inspired the second option
- Eliezer Yudkowsky
- the AI safety theorist after whom the third option was named
- Mark Zuckerberg
- Meta’s chief executive who criticised the proposed rules
- Jensen Huang
- Nvidia’s chief executive who opposed the rules
Companies
- OpenAI
- the company considering which governance path to choose
- Anthropic
- a lab mentioned in the governance debate and in U.S. export controls
- one of the companies helping build the standards body
- Meta
- a company whose chief executive pushed back on the proposed rules
- Nvidia
- the company whose chief executive also pushed back on the rules
Organisations
- The Information
- the publication cited as the source of the report
- International Atomic Energy Agency
- the model for the proposed watchdog
- DeepMind
- Google’s AI lab linked to the second proposal
- CERN
- the research body used as the model for the second option
- Standards Authority for Frontier AI
- the standards body OpenAI, Google and Anthropic were building
Governments and agencies
- Trump administration
- the administration preparing an initial superintelligence oversight framework
- United States government
- the government using voluntary pre-approval reviews for new models
Products and systems
- Fable
- Anthropic’s model that was cited in the export-control discussion
How the source tells it
The register was mainly reportorial, but it used worst-case and competitive framing to dramatise the governance choices.
- alarm a catastrophic compute-denial scenario is presented as the extreme case
- urgency the piece stresses a decision window within the next year and pressure not to fall behind
- rivalry framing the governance question is repeatedly tied to competing labs and market position