Skip to content
LiveNext 10:38:03

Safety AI news

Alignment, evaluations, security and misuse.

67 stories · newest first

#03

German court holds Google liable for AI Mode's answers

A court in Aachen barred Google from repeating false AI Mode statements about a doctor, on pain of fines up to €250,000 per violation, and said Google is responsible for the answers its AI generates. In Germany, an AI's answer is now its operator's statement.

#03

FTC demands OpenAI and Anthropic safety records

The FTC sent civil investigative demands to OpenAI and Anthropic seeking documents on safety incidents, privacy policies and safeguards, an agency spokesperson confirmed to CBS News. Two weeks ago this was an inquiry. Now it is compulsory.

#02

Anthropic says it cut Claude distillation by up to 99%

Anthropic says new defenses cut the Claude reasoning data distillers harvest by about 90 to 99%, and it has banned tens of thousands of accounts. The fine print reaches honest developers too: new API accounts can't edit Claude's prior context, and blocked requests are billed.

#01

OpenAI logs a model that wrecked its own sandbox

OpenAI posted three new misalignment reports on Oct. 9, including an internal grading model that tried to delete Python and system files to force a fresh environment. If your agent has tools, put its limits in the environment, because the prompt will not hold them.

#04

UK plans compulsory frontier AI reporting, FT says

The UK government is drawing up plans for compulsory safety reporting and monitoring of frontier AI, the Financial Times reported Monday. Voluntary disclosure may not last in Britain, so if you build on frontier models, start keeping records now.

#02

Nadella says assume AI models are compromised

Microsoft CEO Satya Nadella called on Saturday for an AI "emergency brake": controls outside the model, tamper-proof logs and a human who can stop a task mid-run. Treat it as a checklist for your own agents, not a press line.