U yh @sdZddlZddlZddlmZddlmZmZddlmZddl m Z ddl m Z dd l mZdd lmZdd lmZdd lmZdd lmZddlmZddlmZe edejdeddW5QRXeej drddl!m"Z"ddl#m$Z$ddl%m&Z&ddddgZ'dS)aW :mod:`torch.distributed.optim` exposes DistributedOptimizer, which takes a list of remote parameters (:class:`~torch.distributed.rpc.RRef`) and runs the optimizer locally on the workers where the parameters live. The distributed optimizer can use any of the local optimizer :ref:`optimizer-algorithms` to apply the gradients on each worker. N)optim)_apply_optimizer_in_backward_get_in_backward_optimizers)_FunctionalAdadelta)_FunctionalAdagrad)_FunctionalAdam)_FunctionalAdamax)_FunctionalAdamW)_FunctionalRMSprop)_FunctionalRprop)_FunctionalSGD)_NamedOptimizer)as_functional_optimalwaysz`TorchScript` support for functional optimizers is deprecated and will be removed in a future PyTorch release. Consider using the `torch.compile` optimizer instead.) stacklevelZ _rpc_init)DistributedOptimizer)PostLocalSGDOptimizer)ZeroRedundancyOptimizerrrrr)(__doc__warningsZtorchrZapply_optimizer_in_backwardrrZfunctional_adadeltarZfunctional_adagradrZfunctional_adamrZfunctional_adamaxr Zfunctional_adamwr Zfunctional_rmspropr Zfunctional_rpropr Zfunctional_sgdr Znamed_optimizerrutilsrcatch_warnings simplefilterwarnDeprecationWarninghasattrZ_CZ optimizerrZpost_localSGD_optimizerrZzero_redundancy_optimizerr__all__rrR/var/www/html/venv/lib/python3.8/site-packages/torch/distributed/optim/__init__.pys4