HPC Module: oneAPI-ccl
Synopsis
Intel(R) oneAPI Collective Communications Library
| About This Software | |
|---|---|
| Official Site | https://software.intel.com/content/www/us/en/develop/tools/oneapi.html |
| Tags | oneAPI |
Installed Versions
| Version | Install Date | Default? |
|---|---|---|
| 2021.1.1 | 2021-03-03 |
Description
The Intel® oneAPI Collective Communications Library (oneCCL) enables developers and researchers to more quickly train newer and deeper models. This is done by using optimized communication patterns to distribute model training across multiple nodes. The library is designed for easy integration into deep learning (DL) frameworks, whether you are implementing them from scratch or customizing existing ones.
-
Built on top of lower-level communication middleware. MPI and libfabrics transparently support many interconnects, such as Intel® Omni-Path Architecture, InfiniBand*, and Ethernet.
-
Optimized for high performance on Intel® CPUs and GPUs.
-
Allows the tradeoff of compute for communication performance to drive scalability of communication patterns.
-
Enables efficient implementations of collectives that are heavily used for neural network training, including all-gather, all-reduce, and reduce-scatter.
Category
| Library | Programming | Software | SysAdmin |
|---|---|---|---|