![]() |
![]() |
Communication choices for CollectiveOps.
AUTO
: Default to runtime's automatic choices.RING
: TensorFlow's ring algorithms for all-reduce and all-gather.NCCL
: Use ncclAllReduce for all-reduce, and ring algorithms for all-gather.
![]() |
![]() |
Communication choices for CollectiveOps.
AUTO
: Default to runtime's automatic choices.RING
: TensorFlow's ring algorithms for all-reduce and
all-gather.NCCL
: Use ncclAllReduce for all-reduce, and ring algorithms for
all-gather.Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2020-10-01 UTC.