gigl.common.utils.get_world_size

gigl.common.utils.torch_training.get_world_size() → int

This is automatically set by Kubeflow PyTorchJob launcher Returns:

int: Total number of processes involved in distributed training