Description: Learn how to distribute PyTorch machine learning tasks across multiple GPUs on multiple nodes to significantly increase data throughput. This seminar will cover everything needed to convert a standard PyTorch model into a fully GPU-parallel model, and to execute these scripts on HPCMP machines. Additional optimizations for decreasing redundant setup, increasing device utilization, and managing memory usage will also be discussed.

CUI