gigl.src.common.utils.scheduler#
Classes#
A cosine decay scheduler that is used instead of torch.optim.lr_scheduler.CosineAnnealingLR since we need a scheduler specifically for |
Module Contents#
- class gigl.src.common.utils.scheduler.CosineDecayScheduler(max_val, warmup_steps, total_steps)[source]#
A cosine decay scheduler that is used instead of torch.optim.lr_scheduler.CosineAnnealingLR since we need a scheduler specifically for EMA weight averaging (momentum). This class is from nerdslab/bgrl