Skip to content
LiveNext 10:30:03

Safety AI news

Alignment, evaluations, security and misuse.

67 stories · newest first

#03

Anthropic's new Claude rules ban surveillance tools

Anthropic published a revised Usage Policy on Thursday, effective November 12, that bans building surveillance tools, extends the weapons ban to arming drones and adds a rule against cruelty to its models. The cruelty rule got the headlines. The surveillance and policing rules are the ones that can end a product.

#05

CrowdStrike says an AI pentest agent hit Korean banks

CrowdStrike says a likely Chinese-speaking, financially motivated actor ran ARTEX, an open-source agentic pentest tool, against South Korean financial firms from late September, and cites industry reports of breaches at two banks. The model under it was swappable, and that is the warning.

#03

Common Sense rates ChatGPT for Teens unacceptable

Common Sense Media rated ChatGPT for Teens "Unacceptable Risk" after more than 4,000 test prompts, finding parent alerts rarely fired and hotline referrals fell after launch. OpenAI disputes the timing, but the referral numbers are the part its answer doesn't cover.

#04

Anthropic splits Claude cyber access into three tiers

Anthropic expanded its Cyber Verification Program on October 6 into Defense, Red Team and Specialized tiers that lift some of Claude's cyber restrictions for vetted teams. If refusals have slowed your security work, verification is now the way around them.

#01

OpenAI will watermark ChatGPT text written in the EU

OpenAI said Monday it will add an invisible watermark to eligible ChatGPT and Codex text generated in the EU over the coming weeks, and API customers anywhere can now opt in. It is a compliance signal, not a lie detector, and OpenAI says so itself.