Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!
Get Started for Free

Tokenizer_from_df

Tokenizer_from_df


Description

Tokenizer_from_df

Usage

Tokenizer_from_df(
  text_cols,
  tok = NULL,
  rules = NULL,
  sep = " ",
  n_workers = 6,
  mark_fields = NULL,
  res_col_name = "text"
)

Arguments

text_cols

text columns

tok

tokenizer

rules

special rules

sep

separator

n_workers

number of workers

mark_fields

mark fields

res_col_name

output column name

Value

None


fastai

Interface to 'fastai'

v2.0.7
Apache License 2.0
Authors
Turgut Abdullayev [ctb, cre, cph, aut]
Initial release

We don't support your browser anymore

Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.