Rate this Page
★ ★ ★ ★ ★

Int4CPULayout#

class torchao.dtypes.Int4CPULayout[source][source]#

Layout class for int4 CPU layout for affine quantized tensor, used by tinygemm kernels _weight_int4pack_mm_for_cpu. Only for PyTorch version at least 2.6

On this page
Edit on GitHub
Show Source