What a chatbot is
A chatbot is software you converse with. You type or speak a message, and it answers in plain language. The idea is old, but the meaning has changed with the technology behind it.
Two generations
Rule-based chatbots follow scripts. If your message contains "refund," the bot shows the refund menu. They are predictable and cheap, and they break the moment you phrase something unexpectedly. Many older customer-support bots work this way.
Model-based chatbots run on a large language model. Instead of matching keywords, the model reads your message and generates a reply one token at a time. This is how general assistants like ChatGPT, Claude and Gemini work. They handle open-ended questions, writing, code and analysis.
How a model-based chatbot works
Each turn, the app packages up a system prompt (the hidden instructions that set its role and rules), your conversation so far and your new message. All of that must fit inside the context window. The model produces a reply, and the app shows it. The model itself does not remember you between chats unless the product adds AI memory.
A raw model is not automatically a good conversational partner. It is shaped through post-training, including RLHF, so it follows instructions, declines harmful requests and keeps a helpful tone.
What chatbots do well and badly
They are quick at drafting, summarizing, brainstorming and explaining. They can also hallucinate, meaning state something false fluently, so facts that matter deserve a check. Techniques like retrieval-augmented generation reduce this by letting the bot look up trusted documents before answering.
Why it matters to you
For most people the chatbot is the front door to AI. How you ask changes the result, which is the point of prompt engineering. Knowing it is predicting text, not consulting a mind, helps you judge when to trust it.
How it relates to neighboring terms
A chatbot answers. An AI agent acts: it can use tools, take several steps and finish a task for you. Many products start as a chatbot and add agent features on top. A voice agent is a chatbot you speak to.