Shortcuts

to_nf4

torchao.dtypes.to_nf4(tensor, block_size: int = 64, scaler_block_size: int = 256)[source]

Convert a given tensor to normalized float 4-bit tensor.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources