Variable: DEFAULT_CONTEXT_BUFFER_TOKENS

const DEFAULT_CONTEXT_BUFFER_TOKENS: 512 = 512

Defined in: constants/llmDefaults.ts:42

Default context buffer tokens (number of tokens to keep for the model response) for Large Language Models (LLMs).