Type Alias: ModelOpts<B>

ModelOpts<B> = object

Defined in: constants/modelRegistry.ts:48

Options for a models accessor call.

Type Parameters

B

B extends Backend = Backend

Subset of Backend that the accessor actually supports.

Properties

backend?

optional backend: B

Defined in: constants/modelRegistry.ts:52

Explicit backend; defaults to the platform-preferred backend for the model.

---

quant?

optional quant: boolean

Defined in: constants/modelRegistry.ts:50

Pick the non-quantized variant when false. Defaults to the quantized variant when one is published.