Inherits from NSObject
Conforms to FMTokenizerDelegate
Declared in FMTokenizers.h

Overview

This is the base tokenizer implementation, using a CFStringTokenizer to find words.

Tasks

  • – initWithLocale:

    Create the tokenizer with a given locale. The locale will be used to initialize the string tokenizer and to lowercase the parsed word. The locale can be NULL, in which case the current locale will be used.

Instance Methods

initWithLocale:

- (instancetype)initWithLocale:(CFLocaleRef)locale
Discussion

Create the tokenizer with a given locale. The locale will be used to initialize the string tokenizer and to lowercase the parsed word. The locale can be NULL, in which case the current locale will be used.

Declared In

FMTokenizers.h