keras: text_to_word_sequence – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

text_to_word_sequence

Convert text to a sequence of words (or tokens).

Convert text to a sequence of words (or tokens).

text_to_word_sequence(
  text,
  filters = "!\"#$%&()*+,-./:;<=>?@[\\]^_`{|}~\t\n",
  lower = TRUE,
  split = " "
)

`text`	Input text (string).
`filters`	Sequence of characters to filter out such as punctuation. Default includes basic punctuation, tabs, and newlines.
`lower`	Whether to convert the input to lowercase.
`split`	Sentence split marker (string).

Words (or tokens)