Rate this Page

torch.nn.functional.rms_norm#

torch.nn.functional.rms_norm(input, normalized_shape, weight=None, eps=None)[source]#

Apply Root Mean Square Layer Normalization.

See RMSNorm for details.

Return type

Tensor