Glossary

What Is a Context Window? Definition and Example

What Is a Context Window? Definition and Example
Definition

A context window is the amount of text an AI model can consider at once, including your prompt, any documents you add and its own reply.

What it means

It is measured in tokens. A larger window lets a model work with longer documents in one go. Even so, a model can still miss details in very long inputs, so check important points. When a conversation exceeds the window, earlier parts may be dropped.

Example

You can paste a long report into an assistant only if it fits inside the context window.

Why it matters

Knowing about the window explains why long chats lose track and why splitting big documents can help.

  • Token (AI): A token is a small piece of text, often part of a word, that an AI model reads and writes. In English, one.
  • Large Language Model (LLM): A large language model, or LLM, is an AI system trained on huge amounts of text to understand and generate.
  • Retrieval-Augmented Generation (RAG): Retrieval-augmented generation, or RAG, is a method where an AI first retrieves relevant documents and then.
Penny the squirrel, The AI Investor mascot

Learn this live, for free

Join the free 90-minute live masterclass, every Friday, 7 PM IST (India) or 7 PM ET (everywhere else). No tech background needed.

Register for the masterclass now

Education only. This glossary is general information, not financial, legal or career advice.

Frequently asked questions

What happens if I go over the limit?

The tool may refuse, shorten the input or forget the earliest parts.

Is a bigger window always better?

It helps with long documents, but accuracy on details can still vary.

How do I use a long document well?

Ask specific questions and request page references so you can check.