torch.utils.deterministic

Created On: Oct 26, 2023 | Last Updated On: Nov 01, 2023

torch.utils.deterministic.fill_uninitialized_memory

A bool that, if True, causes uninitialized memory to be filled with a known value when torch.use_deterministic_algorithms() is set to True. Floating point and complex values are set to NaN, and integer values are set to the maximum value.

Default: True

Filling uninitialized memory is detrimental to performance. So if your program is valid and does not use uninitialized memory as the input to an operation, then this setting can be turned off for better performance and still be deterministic.

The following operations will fill uninitialized memory when this setting is turned on:

• torch.Tensor.resize_() when called with a tensor that is not quantized

• torch.empty()

• torch.empty_strided()

• torch.empty_permuted()

• torch.empty_like()