Multi GPU inference #47
Description
Hi Team,
Can you share/guide me how to run inference on multiple GPU. I have 8, 24GB GPU. How to run the model in distributed manner.
Or is there any plan release the same?
Thanks
{{ message }}
Hi Team,
Can you share/guide me how to run inference on multiple GPU. I have 8, 24GB GPU. How to run the model in distributed manner.
Or is there any plan release the same?
Thanks