Computes the LSTM cell forward propagation for 1 time step.
tf.raw_ops.LSTMBlockCell(
x, cs_prev, h_prev, w, wci, wcf, wco, b, forget_bias=1, cell_clip=3,
use_peephole=False, name=None
)
This implementation uses 1 weight matrix and 1 bias vector, and there's an optional peephole connection.
This kernel op implements the following mathematical equations:
xh = [x, h_prev]
[i, f, ci, o] = xh * w + b
f = f + forget_bias
if not use_peephole:
wci = wcf = wco = 0
i = sigmoid(cs_prev * wci + i)
f = sigmoid(cs_prev * wcf + f)
ci = tanh(ci)
cs = ci .* i + cs_prev .* f
cs = clip(cs, cell_clip)
o = sigmoid(cs * wco + o)
co = tanh(cs)
h = co .* o
Args | |
|---|---|
x
|
A Tensor. Must be one of the following types: half, float32.
The input to the LSTM cell, shape (batch_size, num_inputs).
|
cs_prev
|
A Tensor. Must have the same type as x.
Value of the cell state at previous time step.
|
h_prev
|
A Tensor. Must have the same type as x.
Output of the previous cell at previous time step.
|
w
|
A Tensor. Must have the same type as x. The weight matrix.
|
wci
|
A Tensor. Must have the same type as x.
The weight matrix for input gate peephole connection.
|
wcf
|
A Tensor. Must have the same type as x.
The weight matrix for forget gate peephole connection.
|
wco
|
A Tensor. Must have the same type as x.
The weight matrix for output gate peephole connection.
|
b
|
A Tensor. Must have the same type as x. The bias vector.
|
forget_bias
|
An optional float. Defaults to 1. The forget gate bias.
|
cell_clip
|
An optional float. Defaults to 3.
Value to clip the 'cs' value to.
|
use_peephole
|
An optional bool. Defaults to False.
Whether to use peephole weights.
|
name
|
A name for the operation (optional). |
Returns | |
|---|---|
A tuple of Tensor objects (i, cs, f, o, ci, co, h).
|
|
i
|
A Tensor. Has the same type as x.
|
cs
|
A Tensor. Has the same type as x.
|
f
|
A Tensor. Has the same type as x.
|
o
|
A Tensor. Has the same type as x.
|
ci
|
A Tensor. Has the same type as x.
|
co
|
A Tensor. Has the same type as x.
|
h
|
A Tensor. Has the same type as x.
|