Rate this Page
★ ★ ★ ★ ★

CutlassInt4PackedLayout#

class torchao.prototype.dtypes.CutlassInt4PackedLayout[source][source]#

Layout class for int4 packed layout for affine quantized tensor, for cutlass kernel.

On this page
Edit on GitHub
Show Source