Skip to content

Training parameters (lr and weight decay) change. #3

Open
wuyuebupt wants to merge 3 commits into
sairin1202:masterfrom
wuyuebupt:master
Open

Training parameters (lr and weight decay) change. #3
wuyuebupt wants to merge 3 commits into
sairin1202:masterfrom
wuyuebupt:master

Conversation

@wuyuebupt

@wuyuebupt wuyuebupt commented Aug 2, 2020

Copy link
Copy Markdown

Change the lr schedule from steplr to multistep lr following the paper. Change weight decay according to the incremental stages. Early stages have larger weight decay than late stages. I got one close result [0.856, 0.72125, 0.6556666666666666, 0.6015, 0.5577], see the log file in the folder logs.

The distillation part is also different from our implementation. But I think your implementation is kind of fine.

@EdenBelouadah

Copy link
Copy Markdown

Applying these modifications on the LwF backbone of this code indeed improved the results. I agree with you about pulling them into the code. Thank you

@wuyuebupt

Copy link
Copy Markdown
Author

It looks that the author doesn't maintain this repo anymore :(

@bwolfson97

Copy link
Copy Markdown

Hi @wuyuebupt, could you answer this question about how many bias correction layers should be learned? It would be very much appreciated. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants