Function: useTokenizer()

useTokenizer(tokenizerProps): TokenizerType

Defined in: packages/react-native-executorch/src/hooks/natural_language_processing/useTokenizer.ts:14

React hook for managing a Tokenizer instance.

Parameters

tokenizerProps

TokenizerProps

Configuration object containing tokenizer source and optional preventLoad flag.

Returns

TokenizerType

Ready to use Tokenizer model.