.. _api_dtypes:

================
torchao.dtypes
================

.. currentmodule:: torchao.dtypes

Layouts and Tensor Subclasses
-----------------------------
.. autosummary::
    :toctree: generated/
    :nosignatures:

    NF4Tensor
    AffineQuantizedTensor
    Layout
    PlainLayout
    SemiSparseLayout
    TensorCoreTiledLayout
    Float8Layout
    FloatxTensor
    FloatxTensorCoreLayout
    MarlinSparseLayout
    BlockSparseLayout
    UintxLayout
    MarlinQQQTensor
    MarlinQQQLayout
    Int4CPULayout
    CutlassInt4PackedLayout
    CutlassSemiSparseLayout

Quantization techniques
-----------------------
.. autosummary::
    :toctree: generated/
    :nosignatures:

    to_affine_quantized_intx
    to_affine_quantized_intx_static
    to_affine_quantized_fpx
    to_affine_quantized_floatx
    to_affine_quantized_floatx_static
    to_marlinqqq_quantized_intx
    to_nf4
..
  _NF4Tensor - add after fixing torchao/dtypes/nf4tensor.py:docstring
  of torchao.dtypes.nf4tensor.NF4Tensor.dequantize_scalers:6:Unexpected indentation.