8000
We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
The initial tensor transport is based on NCCL, but RDMA is better for cases where we only need point-to-point and if the group/world size is dynamic.
There are a few options for RDMA that we plan to look into:
No response