evox.algorithms.so.es_variants.adam_step

Module Contents

Functions

adam_single_tensor

API

evox.algorithms.so.es_variants.adam_step.adam_single_tensor(param: torch.Tensor, grad: torch.Tensor, exp_avg: torch.Tensor, exp_avg_sq: torch.Tensor, beta1: float | torch.Tensor = 0.9, beta2: float | torch.Tensor = 0.999, lr: float | torch.Tensor = 0.001, weight_decay: float | torch.Tensor = 0, eps: float | torch.Tensor = 1e-08, decouple_weight_decay: bool = False)