What is Context Window?
Context Window
A. What is Context Window
The maximum number of input + output tokens an AI can consider at once. The larger it is, the longer the documents and conversations it can handle.
The context window is the upper limit on the amount of information an AI can reference in a single exchange — the combined token count of input and output. Anything beyond it is forgotten.
In recent years, models with large contexts on the order of several hundred thousand to a million tokens have appeared, making it possible to handle long documents, entire codebases and long conversations all at once. It is an important metric if long-document processing matters to you.