BNNSActivationFunctionSoftplus
An activation function that returns the softplus function of its input.
Declaration
var BNNSActivationFunctionSoftplus: BNNSActivationFunction { get }Discussion
This constant defines an activation function that returns values using the following operation:
alpha * log( 1 + exp(beta*x) )The following illustrates the output that the activation function generates from inputs in the range -10...10, with an alpha of 1.0, and a beta of 0.5:
[Image]
See Also
Raw Values
init(_:)init(rawValue:)rawValueBNNSActivationFunctionAbsBNNSActivationFunctionCELUBNNSActivationFunctionClampedLeakyRectifiedLinearBNNSActivationFunctionELUBNNSActivationFunctionErfBNNSActivationFunctionGELUBNNSActivationFunctionGELUApproximationBNNSActivationFunctionGELUApproximation2BNNSActivationFunctionGELUApproximationSigmoidBNNSActivationFunctionGumbelBNNSActivationFunctionGumbelMaxBNNSActivationFunctionHardShrink