MLCActivationType.hardSwish
An activation type that implements the hard swish activation function.
Declaration
case hardSwishDiscussion
This activation type implements the following function:
f(x) = 0, if x <= -3
f(x) = x, if x >= +3
f(x) = x * (x + 3)/6
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.relunMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus