evox.algorithms.so.es_variants.adam_step

Module Contents

Functions

adam_single_tensor

API

evox.algorithms.so.es_variants.adam_step.adam_single_tensor(param: torch.Tensor, grad: torch.Tensor, exp_avg: torch.Tensor, exp_avg_sq: torch.Tensor, beta1: torch.Tensor = torch.tensor(0.9), beta2: torch.Tensor = torch.tensor(0.999), lr: torch.Tensor = torch.tensor(0.001), weight_decay: torch.Tensor = torch.tensor(0), eps: torch.Tensor = torch.tensor(1e-08))