Interface: ContextStrategy

Defined in: types/llm.ts:338

Defines a strategy for managing the conversation context window and message history.

Methods

buildContext()

buildContext(systemPrompt, history, maxContextLength, getTokenCount): Message[]

Defined in: types/llm.ts:347

Constructs the final array of messages to be sent to the model for the current inference step.

Parameters

systemPrompt

string

The top-level instructions or persona assigned to the model.

history

Message[]

The complete conversation history up to the current point.

maxContextLength

number

The maximum number of tokens that the model can keep in the context.

getTokenCount

(messages) => number

A callback function provided by the LLM controller that calculates the exact number of tokens a specific array of messages will consume once formatted.

Returns

Message[]

The optimized array of messages, ready to be processed by the model.