mlx.nn.Mish

Contents

mlx.nn.Mish#

class Mish#

Applies the Mish function, element-wise.

Reference: https://arxiv.org/abs/1908.08681

\[\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))\]

Methods