PackingFormat¶
- class torchao.quantization.quantize_.common.PackingFormat(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)[source]¶
Packing format for quantized data in Tensor subclasses in torchao, represents how the values are packed and laid out in the quantized data.
- PLAIN = 'plain'¶
Opaque packing format that’s used for tensors that does not have a predefined packing format (that may be decided on hardware, tensor shape, library availability etc.) and it’s not needed for the rest of the system to understand the specific format that’s adopted.