torch.cuda.utilization

torch.cuda.utilization(device=None)

Returns the percent of time over the past sample period during which one or more kernels was executing on the GPU as given by nvidia-smi.

Parameters

device (torch.device or int, optional) – selected device. Returns statistic for the current device, given by current_device(), if device is None (default).

Warning: Each sample period may be between 1 second and 1/6 second, depending on the product being queried.