How to use multiple GPUs?

[bilalsattar]

I have two GPUs in my machine. Is there a way to use multiple gpus for training? I can see training is not fully utilizing the GPU memory as well

[f90]

Hey, parallel GPU usage should be a simple addition by wrapping the generator and discriminator(s) in a DataParallel module, for example in Image2Image.py. Do you want to make this addition yourself and then submit a pull request so I can add it to the codebase?

For GPU utilisation, it's true that some training loops are a bit GPU-starved because of slow data loading. This only applies to some tasks I think though - which one are you trying? We could investigate together how to speed things up in this regard.