Rate this Page

torch.optim.nadam.nadam#

torch.optim.nadam.nadam(params, grads, exp_avgs, exp_avg_sqs, mu_products, state_steps, decoupled_weight_decay=False, foreach=None, capturable=False, differentiable=False, has_complex=False, maximize=False, *, beta1, beta2, lr, weight_decay, momentum_decay, eps)[source]#

Functional API that performs NAdam algorithm computation.

See NAdam for details.