Deal with distributed group in distributed training

[ZwwWayne]

Sometimes the experiment contains multiple groups. However, the communication in many places use default groups, which is in-compatible with some settings.