Exploring Fully Offloaded GPU Stream-Aware Message Passing

06/27/2023
by   Naveen Namashivayam, et al.
0

Modern heterogeneous supercomputing systems are comprised of CPUs, GPUs, and high-speed network interconnects. Communication libraries supporting efficient data transfers involving memory buffers from the GPU memory typically require the CPU to orchestrate the data transfer operations. A new offload-friendly communication strategy, stream-triggered (ST) communication, was explored to allow offloading the synchronization and data movement operations from the CPU to the GPU. A Message Passing Interface (MPI) one-sided active target synchronization based implementation was used as an exemplar to illustrate the proposed strategy. A latency-sensitive nearest neighbor microbenchmark was used to explore the various performance aspects of the implementation. The offloaded implementation shows significant on-node performance advantages over standard MPI active RMA (36 multi-node improvement is less (23 slower than point-to-point), but plans are in progress to purse further improvements.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset