Shortcuts

UintxLayout

class torchao.dtypes.UintxLayout(dtype: dtype, pack_dim: int = - 1)[source]

A layout class for Uintx tensors, which are tensors with elements packed into smaller bit-widths than the standard 8-bit byte. This layout is used to define how the data is stored and processed in UintxTensor objects.

Variables:
  • dtype (torch.dtype) – The data type of the tensor elements, which determines the bit-width used for packing.

  • pack_dim (int) – The dimension along which the data is packed. Default is -1, which indicates the last dimension.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources