Interface: LLMProps
Defined in: types/llm.ts:62
Properties for initializing and configuring a Large Language Model (LLM) instance.
Properties
model
model:
object
Defined in: types/llm.ts:63
capabilities?
optionalcapabilities: readonly"vision"[]
Optional list of modality capabilities the model supports.
Determines the type of the media argument in sendMessage.
Example: ['vision'] enables sendMessage(text, { imagePath }).
modelName
modelName:
LLMModelName
The built-in model name (e.g. 'llama-3.2-3b'). Used for telemetry and hook reload triggers.
Pass one of the pre-built LLM constants (e.g. LLAMA3_2_3B) to populate all required fields.
modelSource
modelSource:
ResourceSource
ResourceSource that specifies the location of the model binary.
tokenizerConfigSource
tokenizerConfigSource:
ResourceSource
ResourceSource pointing to the JSON file which contains the tokenizer config.
tokenizerSource
tokenizerSource:
ResourceSource
ResourceSource pointing to the JSON file which contains the tokenizer.
preventLoad?
optionalpreventLoad:boolean
Defined in: types/llm.ts:91
Boolean that can prevent automatic model loading (and downloading the data if you load it for the first time) after running the hook.