zae_engine.models package

Subpackages

Submodules

zae_engine.models.utility module

zae_engine.models.utility.initializer(m)[source]

Initialize the parameters in model. For Linear layer, weights are initialized following normal distribution. For BatchNorm layer, weights are initialized following uniform distribution. For LayerNorm layer, weights are not initialized. For others, weights are initialized following kaiming method based on normal distribution. (https://arxiv.org/abs/1502.01852v1)

Parameters:

m – The member of model.

Module contents