Context Window
The context window is the maximum amount of text, measured in tokens, that a language model can process and 'see' at one time, encompassing both the input prompt and the generated output. Anything beyond this limit is truncated or dropped, meaning the model has no memory of information outside its current context…
12 resources across 1 library
Glossary Terms(12)
Prompt Engineering
Prompt engineering is the practice of designing and refining the input text (prompt) given to a language model to reliably elicit accurate, relevant, and well-…
RAG
Retrieval-Augmented Generation (RAG) is a technique that combines a language model with an external retrieval system: relevant documents or passages are fetche…
LLM
A Large Language Model (LLM) is a neural network, typically based on the transformer architecture, trained on massive amounts of text to predict and generate h…
Context Window
The context window is the maximum amount of text, measured in tokens, that a language model can process and 'see' at one time, encompassing both the input prom…
CopilotKit
CopilotKit is an open-source React framework for embedding AI copilots — chat assistants, in-app actions, and autonomous agents — directly into web application…
State Space Model (Mamba)
A State Space Model (SSM), in the context of modern sequence modeling, is a neural architecture — with Mamba as a prominent example — that processes sequences…
Tokenization
Tokenization is the process of breaking text into smaller units, called tokens, that a language model can process — typically words, subwords, or characters.
System Prompt
A system prompt is a set of instructions given to a language model before user input that establishes its role, tone, constraints, and behavior for the remaind…
Transformer Architecture
The Transformer is a neural network architecture built entirely around the self-attention mechanism, allowing it to model relationships between all elements of…
Gemini 1.5
Gemini 1.5 is a family of multimodal large language models from Google DeepMind, released starting February 2024 in Pro and Flash variants, notable for introdu…
Falcon 180B
Falcon 180B is a 180-billion-parameter open-weight large language model developed by the Technology Innovation Institute (TII) in Abu Dhabi, trained on 3.5 tri…
Falcon 2
Falcon 2 is a family of open-weight foundation models from the Technology Innovation Institute (TII), including an 11-billion-parameter text model and a vision…