tff.learning.optimizers.handle_indexed_slices_gradients
Stay organized with collections
Save and categorize content based on your preferences.
Converts any tf.IndexedSlices to tensors.
tff.learning.optimizers.handle_indexed_slices_gradients(
gradients: _Structure[T]
) -> _Structure[Union[T, tf.IndexedSlices]]
The tf.IndexedSlices class is used principally in the definition of
gradients for operations that have sparse gradients (e.g. tf.gather). See
also tf.GradientTape documentation. This method is an elementary utility
converting the slices to a tensor, which can be used to make an optimizer
immediately compatible with such gradients. All other values are left
unmodified.
Note however, this operation may be expensive in some situations. For more
details, see
https://github.com/tensorflow/tensorflow/blob/2b44549aca184ae0eb986a8bd46feef2b17004ab/tensorflow/python/framework/indexed_slices.py#L406
Args |
|---|
gradients
|
A collection of gradients to be used by an optimizer.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-09-20 UTC.
[null,null,["Last updated 2024-09-20 UTC."],[],[],null,["# tff.learning.optimizers.handle_indexed_slices_gradients\n\n\u003cbr /\u003e\n\n|-------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| [View source on GitHub](https://github.com/tensorflow/federated/blob/v0.87.0 Version 2.0, January 2004 Licensed under the Apache License, Version 2.0 (the) |\n\nConverts any [`tf.IndexedSlices`](https://www.tensorflow.org/api_docs/python/tf/IndexedSlices) to tensors. \n\n tff.learning.optimizers.handle_indexed_slices_gradients(\n gradients: _Structure[T]\n ) -\u003e _Structure[Union[T, tf.IndexedSlices]]\n\nThe [`tf.IndexedSlices`](https://www.tensorflow.org/api_docs/python/tf/IndexedSlices) class is used principally in the definition of\ngradients for operations that have sparse gradients (e.g. [`tf.gather`](https://www.tensorflow.org/api_docs/python/tf/gather)). See\nalso [`tf.GradientTape`](https://www.tensorflow.org/api_docs/python/tf/GradientTape) documentation. This method is an elementary utility\nconverting the slices to a tensor, which can be used to make an optimizer\nimmediately compatible with such gradients. All other values are left\nunmodified.\n\nNote however, this operation may be expensive in some situations. For more\ndetails, see\n\u003chttps://github.com/tensorflow/tensorflow/blob/2b44549aca184ae0eb986a8bd46feef2b17004ab/tensorflow/python/framework/indexed_slices.py#L406\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n| Args ---- ||\n|-------------|-------------------------------------------------------|\n| `gradients` | A collection of gradients to be used by an optimizer. |\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n| Returns ------- ||\n|---|---|\n| The same collection with [`tf.IndexedSlices`](https://www.tensorflow.org/api_docs/python/tf/IndexedSlices) replaced by tensors. ||\n\n\u003cbr /\u003e"]]
View source on GitHub