CastConfig¶
- class torchao.float8.CastConfig(scaling_type: ScalingType = ScalingType.DYNAMIC, scaling_granularity: ScalingGranularity = ScalingGranularity.TENSORWISE, target_dtype: Optional[dtype] = None)[source]¶
Configuration for maybe casting a single tensor to float8