MLCActivationType.hardShrink
An activation type that implements the hard shrink activation function.
Declaration
case hardShrinkDiscussion
This activation type implements the following function:
f(x) = x, if x > a or x < −a, else 0
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.relunMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus