He normal initializer.
tfp.experimental.nn.initializers.he_normal(
seed=None
)
It draws samples from a truncated normal distribution centered on 0
with standard deviation (after truncation) given by
stddev = sqrt(2 / fan_in) where fan_in is the number of
input units in the weight tensor.
Args |
|---|
seed
|
A Python integer. Used to create random seeds.
Default value: None.
|
Returns |
|---|
init_fn
|
A python callable which takes a shape Tensor, dtype and an
optional scalar int number of batch dims and returns a randomly
initialized Tensor with the specified shape and dtype.
|
References:
He et al., 2015
(pdf)
View source on GitHub