Schedulers

cosine_decay(init, decay_steps[, end])	Make a cosine decay scheduler.
exponential_decay(init, decay_rate)	Make an exponential decay scheduler.
join_schedules(schedules, boundaries)	Join multiple schedules to create a new schedule.
linear_schedule(init, end, steps)	Make a linear scheduler.
step_decay(init, decay_rate, step_size)	Make a step decay scheduler.