MLCActivationType.relu
An activation type that implements the rectified linear unit activation function.
Declaration
case reluDiscussion
This activation type implements the following function:
f(x) = x >= 0 ? x : a * x
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.relunMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus