Skip to content
LiveNext 15:27:32

Definition

What is Chatbot?

Chatbot is a chatbot is a program you talk to in everyday language, by text or voice, that replies conversationally, and today most are powered by a large language model.

What a chatbot is

A chatbot is software you converse with. You type or speak a message, and it answers in plain language. The idea is old, but the meaning has changed with the technology behind it.

Two generations

Rule-based chatbots follow scripts. If your message contains "refund," the bot shows the refund menu. They are predictable and cheap, and they break the moment you phrase something unexpectedly. Many older customer-support bots work this way.

Model-based chatbots run on a large language model. Instead of matching keywords, the model reads your message and generates a reply one token at a time. This is how general assistants like ChatGPT, Claude and Gemini work. They handle open-ended questions, writing, code and analysis.

How a model-based chatbot works

Each turn, the app packages up a system prompt (the hidden instructions that set its role and rules), your conversation so far and your new message. All of that must fit inside the context window. The model produces a reply, and the app shows it. The model itself does not remember you between chats unless the product adds AI memory.

A raw model is not automatically a good conversational partner. It is shaped through post-training, including RLHF, so it follows instructions, declines harmful requests and keeps a helpful tone.

What chatbots do well and badly

They are quick at drafting, summarizing, brainstorming and explaining. They can also hallucinate, meaning state something false fluently, so facts that matter deserve a check. Techniques like retrieval-augmented generation reduce this by letting the bot look up trusted documents before answering.

Why it matters to you

For most people the chatbot is the front door to AI. How you ask changes the result, which is the point of prompt engineering. Knowing it is predicting text, not consulting a mind, helps you judge when to trust it.

How it relates to neighboring terms

A chatbot answers. An AI agent acts: it can use tools, take several steps and finish a task for you. Many products start as a chatbot and add agent features on top. A voice agent is a chatbot you speak to.

Questions people ask

What is the difference between a chatbot and an AI agent?

A chatbot mainly replies in conversation. An AI agent can also use tools and take multiple steps to complete a task on your behalf.

Chatbot in the news

#03

Anthropic's new Claude rules ban surveillance tools

Anthropic published a revised Usage Policy on Thursday, effective November 12, that bans building surveillance tools, extends the weapons ban to arming drones and adds a rule against cruelty to its models. The cruelty rule got the headlines. The surveillance and policing rules are the ones that can end a product.

#01

Claude now builds live dashboards from your warehouse

Anthropic put Claude Dashboards into beta for paid plans on Thursday, connected to Snowflake, BigQuery, Databricks and Redshift, plus Motion explainer videos for Team and Enterprise. Dashboards is the one to try, because every number opens to the query behind it.