Schedulers#

cosine_decay(init, decay_steps[, minimum])

Make a cosine decay scheduler.

exponential_decay(init, decay_rate)

Make an exponential decay scheduler.

join_schedules(schedules, boundaries)

Join multiple schedules to create a new schedule.

linear_schedule(init, end, steps)

Make a linear scheduler.

step_decay(init, decay_rate, step_size)

Make a step decay scheduler.