LeakyReLU module
Applies the element-wise function:
nn_leaky_relu(negative_slope = 0.01, inplace = FALSE)
negative_slope |
Controls the angle of the negative slope. Default: 1e-2 |
inplace |
can optionally do the operation in-place. Default: |
\mbox{LeakyReLU}(x) = \max(0, x) + \mbox{negative\_slope} * \min(0, x)
or
\mbox{LeakyRELU}(x) = ≤ft\{ \begin{array}{ll} x, & \mbox{ if } x ≥q 0 \\ \mbox{negative\_slope} \times x, & \mbox{ otherwise } \end{array} \right.
Input: (N, *) where * means, any number of additional
dimensions
Output: (N, *), same shape as the input
if (torch_is_installed()) {
m <- nn_leaky_relu(0.1)
input <- torch_randn(2)
output <- m(input)
}Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.