The maximum amount of text an AI model can "remember" and process in a single conversation or operation.
The context window is the limit for how much information a large language model (LLMLarge Language Model - AI model trained on large text data that can understand and generate human language, such as GPT-4 and Claude.) can hold in its "working memory" during a single session. It is typically measured in tokens (approx. 0.75 words per token). A small context window means the model forgets information from early in a long conversation.
Large Language Model - AI model trained on large text data that can understand and generate human language, such as GPT-4 and Claude.
AIRAG →Retrieval Augmented Generation - AI architecture where the model is supplemented with documents retrieved in real-time to provide fact-based answers.
AIPrompt engineering →The technique of formulating precise instructions to AI models to obtain relevant, reliable, and accurate responses.