Rate this Page

Float8Layout#

class torchao.dtypes.Float8Layout(mm_config: Optional[Float8MMConfig] = None)[source][source]#

Represents the layout configuration for Float8 affine quantized tensors.

Variables

mm_config (Optional[Float8MMConfig]) – Configuration for matrix multiplication operations involving Float8 tensors. If None, default settings are used.