How to add Distributed training

Hello,

I am confused about how to add distributed training so that I can define gpu for training. I don't know which file should I modify and add some codes in?  Does anybody can help me?

Thanks!