Glu
The gated linear unit. Computes:
nnf_glu(input, dim = -1)
input |
(Tensor) input tensor |
dim |
(int) dimension on which to split the input. Default: -1 |
GLU(a, b) = a \otimes σ(b)
where input is split in half along dim to form a and b, σ
is the sigmoid function and \otimes is the element-wise product
between matrices.
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.