BNNS.ActivationFunction.softShrink(alpha:)

An activation function that returns zero when the absolute input is less than alpha, otherwise it returns its input minus alpha.

Declaration

case softShrink(alpha: Float)

This constant defines an activation function that returns values using the following operation:

abs(x) < abs(alpha)
    0 if abs(x) < abs(alpha)
else
    x-copysign(alpha, x)

The following illustrates the output that the activation function generates from inputs in the range -10...10 and an alpha of 5:

[Image]