mlx.nn.mish#
- class mish(x: array)#
Applies the Mish function, element-wise.
Mish: A Self Regularized Non-Monotonic Neural Activation Function.
Reference: https://arxiv.org/abs/1908.08681
\[\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))\]
Applies the Mish function, element-wise.
Mish: A Self Regularized Non-Monotonic Neural Activation Function.
Reference: https://arxiv.org/abs/1908.08681