MLCActivationType.selu
An activation type that implements the scaled exponential linear unit activation function.
Declaration
case seluDiscussion
This activation type implements the following function:
f(x) = scale * (max(0, x) + min(0, α * (exp(x)−1))), where:
α = 1.6732632423543772848170429916717
scale = 1.0507009873554804934193349852946
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.relunMLCActivationType.sigmoidMLCActivationType.softPlus