Combined_flat_anneal
Create a schedule with constant learning rate 'start_lr' for 'pct' proportion of the training, and a 'curve_type' learning rate (till 'end_lr') for remaining portion of training.
combined_flat_anneal(pct, start_lr, end_lr = 0, curve_type = "linear")
pct |
Proportion of training with a constant learning rate. |
start_lr |
Desired starting learning rate, used for beginnning pct of training. |
end_lr |
Desired end learning rate, training will conclude at this learning rate. |
curve_type |
Curve type for learning rate annealing. Options are 'linear', 'cosine', and 'exponential'. |
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.