BNNS.ActivationFunction.celu(alpha:)

An activation function that evaluates the continuously differentiable exponential linear units (CELU) on its input.

Declaration

case celu(alpha: Float)

This constant defines an activation function that returns values using the following operation:

if x < 0
    alpha*(exp(x/alpha) - 1) 
else
    x

The following illustrates the output that the activation function generates from inputs in the range -10...10 and an alpha of 1:

[Image]