torch: nnf_gelu – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

nnf_gelu

Gelu

Description

Gelu

Usage

nnf_gelu(input)

Arguments

input

(N,*) tensor, where * means, any number of additional dimensions

gelu(input) -> Tensor

Applies element-wise the function GELU(x) = x * Φ(x)

where Φ(x) is the Cumulative Distribution Function for Gaussian Distribution.

See Gaussian Error Linear Units (GELUs).

torch

Tensors and Neural Networks with 'GPU' Acceleration

v0.3.0

MIT + file LICENSE

Authors

Daniel Falbel [aut, cre, cph], Javier Luraschi [aut], Dmitriy Selivanov [ctb], Athos Damiani [ctb], Christophe Regouby [ctb], Krzysztof Joachimiak [ctb], RStudio [cph]

Initial release