HF_QABatchTransform
Handles everything you need to assemble a mini-batch of inputs and targets, as well as decode the dictionary produced
HF_QABatchTransform( hf_arch, hf_tokenizer, max_length = NULL, padding = TRUE, truncation = TRUE, is_split_into_words = FALSE, n_tok_inps = 1, hf_input_return_type = HF_QuestionAnswerInput(), ... )
hf_arch |
architecture |
hf_tokenizer |
tokenizer |
max_length |
maximum length |
padding |
padding |
truncation |
truncation |
is_split_into_words |
to split into words or not |
n_tok_inps |
number of tok inputs |
hf_input_return_type |
input return type |
... |
additional arguments |
as a byproduct of the tokenization process in the 'encodes' method.
None
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.