fastai: HF_BeforeBatchTransform – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

HF_BeforeBatchTransform

Description

Handles everything you need to assemble a mini-batch of inputs and targets, as well as decode the dictionary produced as a byproduct of the tokenization process in the 'encodes' method.

Usage

HF_BeforeBatchTransform(
  hf_arch,
  hf_tokenizer,
  max_length = NULL,
  padding = TRUE,
  truncation = TRUE,
  is_split_into_words = FALSE,
  n_tok_inps = 1,
  ...
)

Arguments

`hf_arch`	architecture
`hf_tokenizer`	tokenizer
`max_length`	maximum length
`padding`	padding or not
`truncation`	truncation or not
`is_split_into_words`	to split into words
`n_tok_inps`	number tok inputs
`...`	additional arguments

Value

None

fastai

Interface to 'fastai'

v2.0.7

Apache License 2.0

Authors

Turgut Abdullayev [ctb, cre, cph, aut]

Initial release