BNNS.ActivationFunction.gumbel(alpha:beta:)
An activation function that returns random numbers from the Gumbel distribution.
Declaration
case gumbel(alpha: Float, beta: Float)Discussion
This constant defines an activation function that returns values using the following operation:
−log(−log(alpha*Uniform(0,1)+beta)+beta)See Also
Activation Functions
BNNS.ActivationFunction.absBNNS.ActivationFunction.celu(alpha:)BNNS.ActivationFunction.clamp(bounds:)BNNS.ActivationFunction.clampedLeakyRectifiedLinear(alpha:beta:)BNNS.ActivationFunction.elu(alpha:)BNNS.ActivationFunction.geluApproximation(alpha:beta:)BNNS.ActivationFunction.geluApproximation2(alpha:beta:)BNNS.ActivationFunction.gumbelMax(alpha:beta:)BNNS.ActivationFunction.hardShrink(alpha:)BNNS.ActivationFunction.hardSigmoid(alpha:beta:)BNNS.ActivationFunction.hardSwish(alpha:beta:)BNNS.ActivationFunction.identityBNNS.ActivationFunction.leakyRectifiedLinear(alpha:)BNNS.ActivationFunction.linear(alpha:)BNNS.ActivationFunction.linearWithBias(alpha:beta:)