Multi gpu training

sgugger
Thu, 25 Feb 2021 23:51:52 +0000

Both are supported by the Hugging Face Trainer. You just have to use the pytorch launcher to use DistributedDataParallel, see an example here.