Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

add missing param threshold_mode #4173

Merged
2 commits merged into from
Apr 30, 2020
Merged

add missing param threshold_mode #4173

2 commits merged into from
Apr 30, 2020

Conversation

YKX-A
Copy link
Contributor

@YKX-A YKX-A commented Apr 30, 2020

It's probably a bug.
I see threshold_mode as a param of __init__ of ReduceOnPlateauLearningRateScheduler, but it misses in the initializer of torch.optim.lr_scheduler.ReduceLROnPlateau.
I found this problem in my experiment, by observing exceptional learning rate decay, and further found that the threshold_mode of ReduceOnPlateauLearningRateScheduler.lr_scheduler is always equal to "rel", even I had set threshold_mode = 'abs'.
If this is not intended, then it's probably an oversight.

Copy link
Member

@epwalsh epwalsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @YKX-A!

@ghost ghost merged commit 82cae1b into allenai:master Apr 30, 2020
This pull request was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants