gigl.src.common.utils.CosineDecayScheduler

class gigl.src.common.utils.scheduler.CosineDecayScheduler(max_val, warmup_steps, total_steps)

Bases: object

A cosine decay scheduler that is used instead of torch.optim.lr_scheduler.CosineAnnealingLR since we need a scheduler specifically for EMA weight averaging (momentum). This class is from nerdslab/bgrl

Methods

__init__
get

__init__(max_val, warmup_steps, total_steps)

__weakref__

list of weak references to the object (if defined)