BNNSActivationFunctionGumbelMax
An activation function that returns random numbers from the Gumbel distribution.
Declaration
var BNNSActivationFunctionGumbelMax: BNNSActivationFunction { get }Discussion
This constant defines an activation function that returns values using the following operation:
GumbleMax(X)_i = MAX(−log(−log(alpha*Uniform(0,1)+beta)+beta) + Xj) See Also
Raw Values
init(_:)init(rawValue:)rawValueBNNSActivationFunctionAbsBNNSActivationFunctionCELUBNNSActivationFunctionClampedLeakyRectifiedLinearBNNSActivationFunctionELUBNNSActivationFunctionErfBNNSActivationFunctionGELUBNNSActivationFunctionGELUApproximationBNNSActivationFunctionGELUApproximation2BNNSActivationFunctionGELUApproximationSigmoidBNNSActivationFunctionGumbelBNNSActivationFunctionHardShrinkBNNSActivationFunctionHardSigmoid