Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!
Get Started for Free

nn_hardswish

Hardswish module


Description

Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3

Usage

nn_hardswish()

Details

\mbox{Hardswish}(x) = ≤ft\{ \begin{array}{ll} 0 & \mbox{if } x ≤ -3, \\ x & \mbox{if } x ≥ +3, \\ x \cdot (x + 3)/6 & \mbox{otherwise} \end{array} \right.

Shape

  • Input: (N, *) where * means, any number of additional dimensions

  • Output: (N, *), same shape as the input

Examples

if (torch_is_installed()) {
## Not run: 
m <- nn_hardswish()
input <- torch_randn(2)
output <- m(input)

## End(Not run)

}

torch

Tensors and Neural Networks with 'GPU' Acceleration

v0.3.0
MIT + file LICENSE
Authors
Daniel Falbel [aut, cre, cph], Javier Luraschi [aut], Dmitriy Selivanov [ctb], Athos Damiani [ctb], Christophe Regouby [ctb], Krzysztof Joachimiak [ctb], RStudio [cph]
Initial release

We don't support your browser anymore

Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.