MLCActivationType.celu
An activation type that implements the CELU activation function.
Declaration
case celuDiscussion
This activation type implements the following function:
f(x) = max(0, x) + min(0, a * (exp(x / a) − 1))
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.clampMLCActivationType.eluMLCActivationType.geluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.relunMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus