Skip to main content
Version: Next

Interface: LLMProps

Defined in: types/llm.ts:62

Properties for initializing and configuring a Large Language Model (LLM) instance.

Properties

model

model: object

Defined in: types/llm.ts:63

capabilities?

optional capabilities: readonly "vision"[]

Optional list of modality capabilities the model supports. Determines the type of the media argument in sendMessage. Example: ['vision'] enables sendMessage(text, { imagePath }).

modelName

modelName: LLMModelName

The built-in model name (e.g. 'llama-3.2-3b'). Used for telemetry and hook reload triggers. Pass one of the pre-built LLM constants (e.g. LLAMA3_2_3B) to populate all required fields.

modelSource

modelSource: ResourceSource

ResourceSource that specifies the location of the model binary.

tokenizerConfigSource

tokenizerConfigSource: ResourceSource

ResourceSource pointing to the JSON file which contains the tokenizer config.

tokenizerSource

tokenizerSource: ResourceSource

ResourceSource pointing to the JSON file which contains the tokenizer.


preventLoad?

optional preventLoad: boolean

Defined in: types/llm.ts:91

Boolean that can prevent automatic model loading (and downloading the data if you load it for the first time) after running the hook.

We are Software Mansion.