Aprenda o que há de mais recente em aprendizado de máquina, IA generativa e muito mais no WiML Symposium 2023
Registre-se
ResourceApplyRmsProp
Mantenha tudo organizado com as coleções
Salve e categorize o conteúdo com base nas suas preferências.
Atualize '* var' de acordo com o algoritmo RMSProp.
Observe que na implementação densa desse algoritmo, ms e mom serão atualizados mesmo se o grad for zero, mas nesta implementação esparsa, ms e mom não serão atualizados em iterações durante as quais o grad for zero.
quadrado médio = decadência * quadrado médio + (1-decaimento) * gradiente ** 2 Delta = taxa_de_prendizagem * gradiente / quadrado (quadrado médio + epsilon)
ms <- rho * ms_ {t-1} + (1-rho) * grad * grad mom <- momentum * mom_ {t-1} + lr * grad / sqrt (ms + epsilon) var <- var - mom
Constantes
Fragmento | OP_NAME | O nome desta operação, conforme conhecido pelo motor principal TensorFlow |
Métodos herdados
Da classe java.lang.Object boleano | equals (arg0 Object) |
aula final <?> | getClass () |
int | hashCode () |
vazio final | notificar () |
vazio final | notifyAll () |
Fragmento | toString () |
vazio final | wait (longa arg0, int arg1) |
vazio final | wait (arg0 de comprimento) |
vazio final | wait () |
Constantes
nome_op final String public static
O nome desta operação, conforme conhecido pelo motor principal TensorFlow
Valor constante: "ResourceApplyRMSProp"
Métodos Públicos
Método de fábrica para criar uma classe que envolve uma nova operação ResourceApplyRmsProp.
Parâmetros
alcance | escopo atual |
---|
var | Deve ser de uma variável (). |
---|
em | Deve ser de uma variável (). |
---|
mãe | Deve ser de uma variável (). |
---|
lr | Fator de escala. Deve ser um escalar. |
---|
rho | Taxa de decaimento. Deve ser um escalar. |
---|
épsilon | Termo de cume. Deve ser um escalar. |
---|
grad | O gradiente. |
---|
opções | carrega valores de atributos opcionais |
---|
Devoluções
- uma nova instância de ResourceApplyRmsProp
Parâmetros
useLocking | Se for `True`, a atualização dos tensores var, ms e mom é protegida por um bloqueio; caso contrário, o comportamento é indefinido, mas pode exibir menos contenção. |
---|
Exceto em caso de indicação contrária, o conteúdo desta página é licenciado de acordo com a Licença de atribuição 4.0 do Creative Commons, e as amostras de código são licenciadas de acordo com a Licença Apache 2.0. Para mais detalhes, consulte as políticas do site do Google Developers. Java é uma marca registrada da Oracle e/ou afiliadas.
Última atualização 2021-11-29 UTC.
[null,null,["Última atualização 2021-11-29 UTC."],[],[],null,["# ResourceApplyRmsProp\n\npublic final class **ResourceApplyRmsProp** \nUpdate '\\*var' according to the RMSProp algorithm.\n\n\nNote that in dense implementation of this algorithm, ms and mom will\nupdate even if the grad is zero, but in this sparse implementation, ms\nand mom will not update in iterations during which the grad is zero.\n\n\nmean_square = decay \\* mean_square + (1-decay) \\* gradient \\*\\* 2\nDelta = learning_rate \\* gradient / sqrt(mean_square + epsilon)\n\n\nms \\\u003c- rho \\* ms_{t-1} + (1-rho) \\* grad \\* grad\nmom \\\u003c- momentum \\* mom_{t-1} + lr \\* grad / sqrt(ms + epsilon)\nvar \\\u003c- var - mom\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n\u003cbr /\u003e\n\n### Nested Classes\n\n|-------|---|---|-----------------------------------------------------------------------------------------------------------------|\n| class | [ResourceApplyRmsProp.Options](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp.Options) || Optional attributes for [ResourceApplyRmsProp](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp) |\n\n### Constants\n\n|--------|------------------------------------------------------------------------------------|---------------------------------------------------------|\n| String | [OP_NAME](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp#OP_NAME) | The name of this op, as known by TensorFlow core engine |\n\n### Public Methods\n\n|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| static \\\u003cT extends [TType](/jvm/api_docs/java/org/tensorflow/types/family/TType)\\\u003e [ResourceApplyRmsProp](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp) | [create](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp#create(org.tensorflow.op.Scope, org.tensorflow.Operand\u003c?\u003e, org.tensorflow.Operand\u003c?\u003e, org.tensorflow.Operand\u003c?\u003e, org.tensorflow.Operand\u003cT\u003e, org.tensorflow.Operand\u003cT\u003e, org.tensorflow.Operand\u003cT\u003e, org.tensorflow.Operand\u003cT\u003e, org.tensorflow.Operand\u003cT\u003e, org.tensorflow.op.train.ResourceApplyRmsProp.Options...))([Scope](/jvm/api_docs/java/org/tensorflow/op/Scope) scope, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e var, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e ms, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e mom, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e lr, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e rho, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e momentum, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e epsilon, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e grad, [Options...](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp.Options) options) Factory method to create a class wrapping a new ResourceApplyRmsProp operation. |\n| static [ResourceApplyRmsProp.Options](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp.Options) | [useLocking](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp#useLocking(java.lang.Boolean))(Boolean useLocking) |\n\n### Inherited Methods\n\nFrom class [org.tensorflow.op.RawOp](/jvm/api_docs/java/org/tensorflow/op/RawOp) \n\n|----------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| final boolean | [equals](/jvm/api_docs/java/org/tensorflow/op/RawOp#equals(java.lang.Object))(Object obj) |\n| final int | [hashCode](/jvm/api_docs/java/org/tensorflow/op/RawOp#hashCode())() |\n| [Operation](/jvm/api_docs/java/org/tensorflow/Operation) | [op](/jvm/api_docs/java/org/tensorflow/op/RawOp#op())() Return this unit of computation as a single [Operation](/jvm/api_docs/java/org/tensorflow/Operation). |\n| final String | [toString](/jvm/api_docs/java/org/tensorflow/op/RawOp#toString())() |\n\nFrom class java.lang.Object \n\n|------------------|---------------------------|\n| boolean | equals(Object arg0) |\n| final Class\\\u003c?\\\u003e | getClass() |\n| int | hashCode() |\n| final void | notify() |\n| final void | notifyAll() |\n| String | toString() |\n| final void | wait(long arg0, int arg1) |\n| final void | wait(long arg0) |\n| final void | wait() |\n\nFrom interface [org.tensorflow.op.Op](/jvm/api_docs/java/org/tensorflow/op/Op) \n\n|-----------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| abstract [ExecutionEnvironment](/jvm/api_docs/java/org/tensorflow/ExecutionEnvironment) | [env](/jvm/api_docs/java/org/tensorflow/op/Op#env())() Return the execution environment this op was created in. |\n| abstract [Operation](/jvm/api_docs/java/org/tensorflow/Operation) | [op](/jvm/api_docs/java/org/tensorflow/op/Op#op())() Return this unit of computation as a single [Operation](/jvm/api_docs/java/org/tensorflow/Operation). |\n\nConstants\n---------\n\n#### public static final String\n**OP_NAME**\n\nThe name of this op, as known by TensorFlow core engine \nConstant Value: \"ResourceApplyRMSProp\"\n\nPublic Methods\n--------------\n\n#### public static [ResourceApplyRmsProp](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp)\n**create**\n([Scope](/jvm/api_docs/java/org/tensorflow/op/Scope) scope, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e var, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e ms, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003c?\\\u003e mom, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e lr, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e rho, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e momentum, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e epsilon, [Operand](/jvm/api_docs/java/org/tensorflow/Operand)\\\u003cT\\\u003e grad, [Options...](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp.Options) options)\n\nFactory method to create a class wrapping a new ResourceApplyRmsProp operation. \n\n##### Parameters\n\n| scope | current scope |\n| var | Should be from a Variable(). |\n| ms | Should be from a Variable(). |\n| mom | Should be from a Variable(). |\n| lr | Scaling factor. Must be a scalar. |\n| rho | Decay rate. Must be a scalar. |\n| epsilon | Ridge term. Must be a scalar. |\n| grad | The gradient. |\n| options | carries optional attributes values |\n|---------|------------------------------------|\n\n##### Returns\n\n- a new instance of ResourceApplyRmsProp \n\n#### public static [ResourceApplyRmsProp.Options](/jvm/api_docs/java/org/tensorflow/op/train/ResourceApplyRmsProp.Options)\n**useLocking**\n(Boolean useLocking)\n\n\u003cbr /\u003e\n\n##### Parameters\n\n| useLocking | If \\`True\\`, updating of the var, ms, and mom tensors is protected by a lock; otherwise the behavior is undefined, but may exhibit less contention. |\n|------------|-----------------------------------------------------------------------------------------------------------------------------------------------------|"]]