The learning rate is not updated

For some reason the learning rate update via weight decay is not working

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information