tf.keras.activations.glu

Gated Linear Unit (GLU) activation function.

The GLU activation function is defined as:

glu(x) = a * sigmoid(b),

where x is split into two equal parts a and b along the given axis.

x Input tensor.
axis The axis along which to split the input tensor. Defaults to -1.

Reference: