Function: useTokenizer()
useTokenizer(
tokenizerProps):TokenizerType
Defined in: hooks/natural_language_processing/useTokenizer.ts:14
React hook for managing a Tokenizer instance.
Parameters
tokenizerProps
Configuration object containing tokenizer source and optional preventLoad flag.
Returns
Ready to use Tokenizer model.