ScalingGranularity

class torchao.float8.ScalingGranularity(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Defines the granularity of scaling strategies for casting to float8.

Values:

• TENSORWISE: A single scaling factor for the entire tensor.

• AXISWISE: Scaling factors computed along one axis of the tensor (rowwise scaling).