Shortcuts

CutlassInt4PackedLayout

class torchao.dtypes.CutlassInt4PackedLayout[source]

Layout class for int4 packed layout for affine quantized tensor, for cutlass kernel.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources