He normal initializer.
tfp.experimental.nn.initializers.he_normal(
seed=None
)
It draws samples from a truncated normal distribution centered on 0
with standard deviation (after truncation) given by
stddev = sqrt(2 / fan_in)
where fan_in
is the number of
input units in the weight tensor.
Returns |
init_fn
|
A python callable which takes a shape Tensor , dtype and an
optional scalar int number of batch dims and returns a randomly
initialized Tensor with the specified shape and dtype.
|
References:
He et al., 2015
(pdf)