Artificial Intelligence
Anthropic gives METR access to audit models and safety practices
Anthropic said six METR staff received company hardware, office space and internal tools to review its AI models and safety practices, while some data and architecture details stayed closed.
- Anthropic said six METR staff members received company hardware, office space and access to internal tools.
- The company said that arrangement put METR roughly on a level with its own risk teams.
- Anthropic said customer data, attorney-client privileged information and model architecture details remained off-limits.
- METR said it would publish its findings independently, while Anthropic said it could request redactions in predefined categories.
- Anthropic said the deal went further than access given to SecureBio, Accenture and Faculty, and that it had begun early talks with Hugging Face.
Anthropic said it had given six staff from METR company hardware, office space and access to internal tools so they could review its models and safety practices. The company said that arrangement left them roughly on a par with its own risk teams.
Anthropic said customer data, information covered by attorney-client privilege and details of model architecture were not available to METR. METR said it would publish its findings on its own.
Anthropic said it could ask for redactions in predefined categories, but METR could say publicly whether it thought those requests were justified. The company also said not all safety-relevant information could be made public because it might help attackers or because it was commercially sensitive.
Anthropic said this review went further than what it had offered SecureBio, Accenture and Faculty, which it said had less access and tighter publication limits. It also said it had started early talks with Hugging Face.
Anthropic said the move followed its signing of the White House Accord on Super Intelligence, which included a commitment to work with outside reviewers.
Named in this story
Companies
- Anthropic
- said it gave METR staff access and set limits on sensitive material
- Accenture
- an outside reviewer said to have tighter publication limits
- Faculty
- an outside reviewer said to have tighter publication limits
- Hugging Face
- a company Anthropic said it had started early talks with
Organisations
- METR
- the nonprofit review team that received inside access and will publish findings
- SecureBio
- an outside reviewer said to have received less access
How the source tells it
Mostly straight reporting, with light company framing around transparency and relative access.
- reassurance the piece foregrounds independent publication rights and controlled redactions to suggest oversight
- vendor boosterism it repeats Anthropic’s comparison of this review access with what other outside reviewers received