Skip to content
LiveNext 21:29:35

Definition

What is Model weights?

Model weights is Model weights are the learned numbers stored in a trained AI model that determine how it responds, and the file holding them is what a lab protects as its most valuable asset.

What they are

When an AI model is trained, it adjusts billions of numbers until its predictions get good. Those numbers are the weights. After training they are saved as large files. The code that runs a model is fairly standard. The weights are what make it this model and not another.

Weights are one kind of parameter. People often use the two words almost interchangeably, though "parameters" also covers other learned values and is usually used for the count, while "weights" usually means the actual stored numbers.

An analogy

Think of a recipe versus a chef's years of practice. The recipe (the architecture and training code) can be shared in a paper. The practice, boiled down into numbers, is the weights. Whoever holds the weights can run the model.

Why they matter

  • Value. Training a frontier model takes enormous compute, data and time. The result is the weights, so labs treat them as crown jewels and guard them with strict access controls.
  • Theft risk. Anyone who copies the weights can run the model without the lab's safeguards or usage rules. This is why security discussions about AI labs focus on keeping weights from leaking.
  • Openness. An open-weight model is one whose weights are published for anyone to download. A closed model is reached only through the lab's app or API, so you never touch the weights.
  • Customizing. Fine-tuning changes the weights a little, using your own examples. Running a model yourself, rather than through an API, means loading the weights onto your own hardware, which is where memory and chips like high-bandwidth memory come in.

What weights are not

They are not the training data, and they are not a readable database of facts. You cannot open the file and find a sentence. The knowledge is spread across the numbers in a way nobody can read directly.

What to remember

If a story says a lab "protects its weights" or a company "released its weights," it is talking about the single thing that lets a model be run. Control of the weights is control of the model.

Questions people ask

What is the difference between model weights and parameters?

Weights are the stored numbers a trained model uses to make predictions. Parameter is the broader term, and people mostly use it for the count, such as a model with 70 billion parameters.

What does an open-weight release give you?

The trained numbers, so you can run and adjust the model yourself. It does not necessarily include the training data or training code.

Model weights in the news

#03

OpenAI opens its Decisions API, and output is free

OpenAI put its Decisions API in public beta on October 6, with gpt-6-luna at $0.10 per million input tokens and no charge for output. If you classify, route or grade at volume through a chat model, this is the endpoint to price against.