mlx.nn.silu#

class silu(x)#

Applies the Sigmoid Linear Unit. Also known as Swish.

Applies $x\sigma (x)$ element wise, where $\sigma (\cdot )$ is the logistic sigmoid.