MLCActivationType.relun
An activation type that implements the ReLUN activation function.
Declaration
case relunDiscussion
This activation type implements the following function:
f(x) = min((x >= 0 ? x : a * x), b)
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus