MLCActivationType.gelu
An activation type that implements the gaussian error linear unit activation function.
Declaration
case geluDiscussion
This activation type implements the following function:
f(x) = x * CDF(x)
See Also
Enumeration Cases
MLCActivationType.absoluteMLCActivationType.celuMLCActivationType.clampMLCActivationType.eluMLCActivationType.hardShrinkMLCActivationType.hardSigmoidMLCActivationType.hardSwishMLCActivationType.linearMLCActivationType.logSigmoidMLCActivationType.noneMLCActivationType.reluMLCActivationType.relunMLCActivationType.seluMLCActivationType.sigmoidMLCActivationType.softPlus