Multi gpu training

BramVanroy
Sun, 24 Apr 2022 14:03:25 +0000

See here. E.g.

python -m torch.distributed.launch --nproc_per_node=NUM_GPUS_YOU_HAVE YOUR_TRAINING_SCRIPT.py (--arg1 --arg2 --arg3 and all other arguments of your training script)