ARTIFICE DAILY AI + CYBER SECURITY BRIEFING

Artificial Intelligence

Anthropic tightens Claude policy on abuse and misuse

Anthropic revised its usage policy to target abusive behaviour towards Claude and to tighten rules on propaganda, surveillance, weapons development and autonomous hardware, while keeping chat termination as the main sanction.

The Verge

Anthropic said it had revised its usage policy and described the change as a response to new misuse cases. It named election interference, weapons development, surveillance, and health and financial uses among the areas covered.

One of the changes barred repeated cruel or abusive treatment of Claude. Anthropic said it had already announced last August that Claude could end conversations with persistently harmful users as part of its model welfare work, and that ending chats remained the main enforcement step.

The company said the rule was meant for extreme cases in which users kept acting cruelly without a clear purpose. It said the limit did not apply to ordinary frustration, pushback, dark creative themes, or testing and research.

Anthropic also brought together several older limits into a broader ban on deceptive commercial or political campaigns. It said that included hiding who was behind a message, using fake accounts or posts, misleading voters, impersonating candidates or election officials, and trying to suppress turnout.

The company said its weapons rules now covered software and components that make weapons work, including arming drones and other autonomous vehicles. It also said Claude could not be used to track people without consent, decide whom to investigate, arrest or charge, or build surveillance tools, and that some rules could change for certain government customers if safeguards were adequate.

Named in this story

People

Kyle Fish
leads Anthropic’s model welfare research
Dario Amodei
said the company did not know whether models were conscious
Mustafa Suleyman
drafted the Microsoft AI code of conduct cited in the piece

Companies

Anthropic
revised its usage policy and set the enforcement rules

Organisations

Microsoft AI
issued a code of conduct that took a different view on AI welfare

Governments and agencies

US military
was a previous contractual customer of Anthropic

Products and systems

Claude
was the model covered by the policy and could have chats ended

How the source tells it

Mostly neutral reporting, with mild emphasis on novelty and policy significance.

  • novelty frames the revision as the first major update after more than a year and highlights one rule as a significant change