DDP training?

[weimingzha0]

Hi,

Does it support DDP training?

[danielsnider]

No, not at the moment, but the existing algorithms in Hotline could be easily adapted to DDP. This is because DDP operates in a similar SIMD fashion to torch.DataParallel.

[Jack47]

Hey hotline is awesome, I have been always seeking this kinds of DL profiler tool~
Do you guys have plan to support DDP? I want to contribute this feature, do you have some comments about break down steps to implement DDP training support?