A large language model, or LLM, is the kind of AI behind chatbots such as ChatGPT, Claude and Gemini. It is a program trained on a very large amount of text and code to do one thing well: predict what comes next. That one skill, repeated millions of times, turns out to be enough to write an email, explain a concept or draft a function.
How it works
Text is first split into tokens, small chunks that are often a word or part of one. The model reads the tokens you give it and produces a probability for every possible next token. It picks one, adds it to the text, and repeats until the answer is done. Settings such as temperature control how adventurous the picks are.
What the model knows is stored in its parameters, also called model weights: billions of learned numbers set during pretraining. Most modern models use a design called the transformer. After pretraining, post-training steps such as fine-tuning and learning from feedback teach it to follow instructions and behave like an assistant.
What "large" means
Large refers to the size of the model and the amount of data and computing power used to train it. The word is relative. A model that counted as large a few years ago can be small today. Size usually helps, but it is not the only factor: training data quality and post-training matter a great deal.
What it is good at, and what it is not
An LLM is strong at language tasks: drafting, rewriting, summarizing, translating, classifying and coding. It is weaker at anything that needs guaranteed facts or exact arithmetic, because it generates plausible text rather than looking facts up. This produces hallucinations, fluent answers that are false. Giving the model your documents through retrieval-augmented generation, or letting it call a calculator or search through tool use, reduces the problem.
It also has a knowledge cutoff, a date after which it knows nothing unless you provide the information, and a context window that limits how much text it can consider at once.
Why it matters
Almost every AI writing, coding and chat product you use runs on an LLM. Knowing what it is helps you judge its answers: treat the output as a strong draft that needs checking, not as a database.
Newer systems add images and audio, which makes them multimodal models. Others are trained to think before answering, which makes them reasoning models. When an LLM is given goals and tools and acts over many steps, it becomes an AI agent.