torch: nn_init_orthogonal_ – R documentation

Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!

nn_init_orthogonal_

Orthogonal initialization

Description

Fills the input Tensor with a (semi) orthogonal matrix, as described in Exact solutions to the nonlinear dynamics of learning in deep linear neural networks - Saxe, A. et al. (2013). The input tensor must have at least 2 dimensions, and for tensors with more than 2 dimensions the trailing dimensions are flattened.

Usage

nn_init_orthogonal_(tensor, gain = 1)

Arguments

`tensor`	an n-dimensional `Tensor`
`gain`	optional scaling factor

Examples

if (torch_is_installed()) {
w <- torch_empty(3,5)
nn_init_orthogonal_(w)

}

torch

Tensors and Neural Networks with 'GPU' Acceleration

v0.3.0

MIT + file LICENSE

Authors

Daniel Falbel [aut, cre, cph], Javier Luraschi [aut], Dmitriy Selivanov [ctb], Athos Damiani [ctb], Christophe Regouby [ctb], Krzysztof Joachimiak [ctb], RStudio [cph]

Initial release