TensorFlow 1 version | View source on GitHub |
Communication choices for CollectiveOps.
AUTO
: Default to runtime's automatic choices.RING
: TensorFlow's ring algorithms for all-reduce and all-gather.NCCL
: Use ncclAllReduce for all-reduce, and ring algorithms for all-gather.