...
The NVIDIA Collective Communications Library (NCCL) implements multi-GPU and multi-node collectivecommunication collective communication primitives that are performance optimized for NVIDIA GPUs.
...
...
The NVIDIA Collective Communications Library (NCCL) implements multi-GPU and multi-node collectivecommunication collective communication primitives that are performance optimized for NVIDIA GPUs.
...