mlx.nn.LeakyReLU

class LeakyReLU(negative_slope=0.01)

Applies the Leaky Rectified Linear Unit.

Simply mx.maximum(negative_slope * x, x).

Parameters:

negative_slope – Controls the angle of the negative slope. Default: 1e-2

Methods