Hardswish module
Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3
nn_hardswish()
\mbox{Hardswish}(x) = ≤ft\{ \begin{array}{ll} 0 & \mbox{if } x ≤ -3, \\ x & \mbox{if } x ≥ +3, \\ x \cdot (x + 3)/6 & \mbox{otherwise} \end{array} \right.
Input: (N, *) where *
means, any number of additional
dimensions
Output: (N, *), same shape as the input
if (torch_is_installed()) { ## Not run: m <- nn_hardswish() input <- torch_randn(2) output <- m(input) ## End(Not run) }
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.