Artificial Intelligence
Anthropic tightens Claude policy on abuse and misuse
Anthropic revised its usage policy to target abusive behaviour towards Claude and to tighten rules on propaganda, surveillance, weapons development and autonomous hardware, while keeping chat termination as the main sanction.
- Anthropic revised its usage policy and said it was responding to new high-risk misuse cases, including election interference, weapons development, surveillance, and health and financial uses.
- The policy now barred repeated cruel or abusive treatment of Claude, and Anthropic said ending conversations remained the main enforcement step.
- Anthropic said it had folded older restrictions into bans on deceptive commercial or political campaigns, voter deception, election disruption, and weapons and surveillance misuse.
- The company said some rules could be adapted for certain government customers if safeguards were adequate, and it had previously contracted with the US military.
Anthropic said it had revised its usage policy and described the change as a response to new misuse cases. It named election interference, weapons development, surveillance, and health and financial uses among the areas covered.
One of the changes barred repeated cruel or abusive treatment of Claude. Anthropic said it had already announced last August that Claude could end conversations with persistently harmful users as part of its model welfare work, and that ending chats remained the main enforcement step.
The company said the rule was meant for extreme cases in which users kept acting cruelly without a clear purpose. It said the limit did not apply to ordinary frustration, pushback, dark creative themes, or testing and research.
Anthropic also brought together several older limits into a broader ban on deceptive commercial or political campaigns. It said that included hiding who was behind a message, using fake accounts or posts, misleading voters, impersonating candidates or election officials, and trying to suppress turnout.
The company said its weapons rules now covered software and components that make weapons work, including arming drones and other autonomous vehicles. It also said Claude could not be used to track people without consent, decide whom to investigate, arrest or charge, or build surveillance tools, and that some rules could change for certain government customers if safeguards were adequate.
Named in this story
People
- Kyle Fish
- leads Anthropic’s model welfare research
- Dario Amodei
- said the company did not know whether models were conscious
- Mustafa Suleyman
- drafted the Microsoft AI code of conduct cited in the piece
Companies
- Anthropic
- revised its usage policy and set the enforcement rules
Organisations
- Microsoft AI
- issued a code of conduct that took a different view on AI welfare
Governments and agencies
- US military
- was a previous contractual customer of Anthropic
Products and systems
- Claude
- was the model covered by the policy and could have chats ended
How the source tells it
Mostly neutral reporting, with mild emphasis on novelty and policy significance.
- novelty frames the revision as the first major update after more than a year and highlights one rule as a significant change