ARTIFICE DAILY AI + CYBER SECURITY BRIEFING

Artificial Intelligence

Altman outlined three AI safety governance options

A report said Sam Altman told OpenAI staff about three ways to govern advanced AI, ranging from an IAEA-style watchdog to a single dominant company and a lab merger plan.

THE-DECODER

The Information reported that Sam Altman told OpenAI employees last week about three approaches to governing advanced AI. The report said the comments came as the Trump administration was preparing its first framework for superintelligence developers.

The first option would have created a body modelled on the International Atomic Energy Agency. OpenAI had publicly called for such an institution in May 2023, and the article said it would inspect systems, require audits, and monitor compute and energy use.

The second option was described as the “Demis Plan”, after a proposal Demis Hassabis made about ten years ago. In Altman’s version, the major labs would merge into one organisation or work under its umbrella, and that body would provide models to cooperating countries.

The third option was named the “Eliezer Plan”, after Eliezer Yudkowsky. In that scenario, a developer would gain enough economic power through self-improving AI to withhold compute from everyone else and, in the most extreme case, cut off their computing capabilities; one source said the remark sounded like a jab at a competitor.

The article said Altman had complained that there were too few workable proposals for a speed limit on AI development. It also said OpenAI planned to choose a route within the next year, that OpenAI and Anthropic were reportedly working towards initial public offerings, and that OpenAI, Google and Anthropic were building the Standards Authority for Frontier AI while Meta and Nvidia pushed back on the idea.

Named in this story

People

Sam Altman
OpenAI’s chief executive who outlined the three options internally
Demis Hassabis
the former Google AI lab head whose proposal inspired the second option
Eliezer Yudkowsky
the AI safety theorist after whom the third option was named
Mark Zuckerberg
Meta’s chief executive who criticised the proposed rules
Jensen Huang
Nvidia’s chief executive who opposed the rules

Companies

OpenAI
the company considering which governance path to choose
Anthropic
a lab mentioned in the governance debate and in U.S. export controls
Google
one of the companies helping build the standards body
Meta
a company whose chief executive pushed back on the proposed rules
Nvidia
the company whose chief executive also pushed back on the rules

Organisations

The Information
the publication cited as the source of the report
International Atomic Energy Agency
the model for the proposed watchdog
DeepMind
Google’s AI lab linked to the second proposal
CERN
the research body used as the model for the second option
Standards Authority for Frontier AI
the standards body OpenAI, Google and Anthropic were building

Governments and agencies

Trump administration
the administration preparing an initial superintelligence oversight framework
United States government
the government using voluntary pre-approval reviews for new models

Products and systems

Fable
Anthropic’s model that was cited in the export-control discussion

How the source tells it

The register was mainly reportorial, but it used worst-case and competitive framing to dramatise the governance choices.

  • alarm a catastrophic compute-denial scenario is presented as the extreme case
  • urgency the piece stresses a decision window within the next year and pressure not to fall behind
  • rivalry framing the governance question is repeatedly tied to competing labs and market position