mlx.nn.silu#

class silu(x)#

Applies the Sigmoid Linear Unit. Also known as Swish.

Applies \(x \sigma(x)\) element wise, where \(\sigma(\cdot)\) is the logistic sigmoid.