Become an expert in R — Interactive courses, Cheat Sheets, certificates and more!
Get Started for Free

L2_regularisation

L2_regularisation function


Description

A function to return the L2 regularisation strategy for a network object.

Usage

L2_regularisation(alpha)

Arguments

alpha

parameter to weight the relative contribution of the regulariser

Value

list containing functions to evaluate the cost modifier and grandient modifier

References

  1. Ian Goodfellow, Yoshua Bengio, Aaron Courville, Francis Bach. Deep Learning. (2016)

  2. Terrence J. Sejnowski. The Deep Learning Revolution (The MIT Press). (2018)

  3. Neural Networks YouTube playlist by 3brown1blue: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi

  4. http://neuralnetworksanddeeplearning.com/

See Also

Examples

# Example in context: NOTE the value of 1 used here is arbitrary,
# to get this to work well, you'll have to experiment.

net <- network( dims = c(784,16,16,10),
                regulariser = L2_regularisation(1),
                activ=list(ReLU(),logistic(),softmax()))

deepNN

Deep Learning

v1.0
GPL-3
Authors
Benjamin Taylor [aut, cre]
Initial release

We don't support your browser anymore

Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.