mlx.nn.mish#

class mish(x: array)#

Applies the Mish function, element-wise.

Mish: A Self Regularized Non-Monotonic Neural Activation Function.

Reference: https://arxiv.org/abs/1908.08681

$$\text{Mish}(x)=x\ast \text{Tanh}(\text{Softplus}(x))$$