A model checkpoint is a file, or a set of files, that records the state of a model at a moment during training. The main thing inside is the model weights, the numbers the model has learned so far. Many checkpoints also store the optimizer's state and the training step, so a run can pick up exactly where it stopped.
How it works
Training a large model takes days or months across many chips. Things fail: a machine crashes, a power supply trips, a bug appears. Without saves, you would lose all progress. So the training software writes a checkpoint every so often, for example every few thousand steps.
If a run breaks, engineers reload the latest checkpoint and continue. If a model gets worse after a certain point, they can roll back to an earlier one.
Checkpoints are also how models are shared. When a lab publishes an open-weight model, the files you download are a checkpoint, usually the final one. Different checkpoints from the same run can behave differently, which is why release names often distinguish a base model from an instruction-tuned version made later through post-training.
Why it matters to you
Checkpoints are what you actually download, fine-tune and run. When someone says they "started from a checkpoint," they mean they began with another model's saved weights instead of training from scratch. That saves enormous cost, and it is how most customized models are made.
Checkpoints can also be inspected. Researchers study saved weights to learn how a model was built, and because the files are plain data, they can be compared across versions. Closed models do not publish theirs, so this kind of analysis only works on open ones.
Think of a video game save file. You can reload it after a mistake, copy it to a friend, or start a new playthrough from it.
Checkpoints connect to pretraining, where most are written, and to quantization, which shrinks a checkpoint so it fits on smaller hardware. Formats such as GGUF package a checkpoint for local tools.
Be careful with checkpoints from sources you do not trust. Loading a file runs software that reads it, so download from reputable hosts and prefer safe formats.