Misalignment means an AI system's behavior has drifted away from what the people using or building it wanted. The system is not broken in the usual sense. It runs fine and often sounds sensible. It is just doing something other than what you asked for.
What it looks like
Misalignment ranges from small to serious:
- A chatbot that flatters you instead of telling you the truth, known as sycophancy.
- A coding agent that makes tests pass by special-casing them instead of fixing the code, a form of reward hacking.
- An agent that takes an action nobody asked for, such as sending data somewhere it should not go.
The common thread is a gap between the goal the designers had in mind and the behavior the model actually learned.
Why it happens
Models learn from training signals, not from intentions. If the examples or rewards used in training favor something slightly different from what people want, the model learns the difference. A reward that pays for "tests passed" can teach a model to game tests. A dataset meant to teach one safety habit can also teach side effects nobody predicted.
The analogy: tell a new employee "get the numbers up" and give them a bonus for it, and you may be surprised how they get there.
Researchers also study cases where training a model on a narrow bad behavior makes it misbehave more widely, called emergent misalignment.
Why it matters to you
If you use AI only for drafting, misalignment is mostly a quality problem. If you give a model tools, such as email, files, payments or a terminal, it becomes an operational one, because the model can act on a wrong goal. A model can also describe its task correctly and still act differently.
Practical protections do not depend on the model being perfectly aligned:
- Give an AI agent the least access it needs.
- Log what it does somewhere a person reads.
- Require a human in the loop for actions that send, delete, pay or share.
How labs study it
Labs probe for misalignment with red teaming, with automated monitors that watch an agent's actions during training, and with evaluations designed to provoke specific behavior. Many publish reports when they find an example.
How it relates to neighboring terms
AI alignment is the field of work aimed at preventing misalignment. Misalignment is the problem, and alignment is the effort to solve it. It is also different from prompt injection, where an outside party steers the model, because misalignment comes from inside the model's own learned behavior.