Shortcuts

Float8Layout

class torchao.dtypes.Float8Layout(mm_config: Optional[Float8MMConfig] = None)[source]

Represents the layout configuration for Float8 affine quantized tensors.

Variables:

mm_config (Optional[Float8MMConfig]) – Configuration for matrix multiplication operations involving Float8 tensors. If None, default settings are used.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources