BaseTokenizer
Basic tokenizer that just splits on spaces
BaseTokenizer(split_char = " ")
split_char
separator
None
Interface to 'fastai'
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.