GELU module
Applies the Gaussian Error Linear Units function:
\mbox{GELU}(x) = x * Φ(x)
nn_gelu()
where Φ(x) is the Cumulative Distribution Function for Gaussian Distribution.
Input: (N, *) where * means, any number of additional
dimensions
Output: (N, *), same shape as the input
if (torch_is_installed()) {
m = nn_gelu()
input <- torch_randn(2)
output <- m(input)
}Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.