Float8GemmConfig

class torchao.float8.Float8GemmConfig(use_fast_accum: bool = False)

Configuration for a float8 gemm.

Parameters:

use_fast_accum – If True, use fast accumulation in lower precision. This can improve performance but may reduce numerical accuracy. Default: False