Commit 68fb291
authored
Fix CosineDecay documentation to clarify alpha is a multiplier (#21827)
* Fix CosineDecay documentation to clarify alpha is a multiplier
The documentation incorrectly stated that learning rate decays
'to alpha', when it actually decays to 'initial_lr * alpha'.
Updated the docstring to make it clear that alpha is a fraction/
multiplier, not an absolute target value.
* Fix line length to comply with 80 char limit1 parent b4d9c89 commit 68fb291
1 file changed
+4
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
584 | 584 | | |
585 | 585 | | |
586 | 586 | | |
587 | | - | |
588 | | - | |
589 | | - | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
590 | 591 | | |
591 | 592 | | |
592 | 593 | | |
| |||
0 commit comments