BNNS.ActivationFunction.clamp(bounds:)
An activation function that returns its input clamped to the specified range.
Declaration
case clamp(bounds: ClosedRange<Float>)Discussion
This constant defines an activation function that returns values using the following operation:
min(max(x, alpha), beta)Use alpha and beta to specify the clamping range:
var activation = BNNSActivation(function: .clamp,
alpha: -5,
beta: 5)The following illustrates the output that the activation function generates from inputs in the range -10...10:
[Image]
See Also
Activation Functions
BNNS.ActivationFunction.absBNNS.ActivationFunction.celu(alpha:)BNNS.ActivationFunction.clampedLeakyRectifiedLinear(alpha:beta:)BNNS.ActivationFunction.elu(alpha:)BNNS.ActivationFunction.geluApproximation(alpha:beta:)BNNS.ActivationFunction.geluApproximation2(alpha:beta:)BNNS.ActivationFunction.gumbel(alpha:beta:)BNNS.ActivationFunction.gumbelMax(alpha:beta:)BNNS.ActivationFunction.hardShrink(alpha:)BNNS.ActivationFunction.hardSigmoid(alpha:beta:)BNNS.ActivationFunction.hardSwish(alpha:beta:)BNNS.ActivationFunction.identityBNNS.ActivationFunction.leakyRectifiedLinear(alpha:)BNNS.ActivationFunction.linear(alpha:)BNNS.ActivationFunction.linearWithBias(alpha:beta:)