U yh%@sUddlmZddlZddlZddlZddlZddlmZmZddl m Z ddl Z ddl m ZeeZdaeZdgZedddZere jseder dd lmZdd lmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>d d l?m@Z@mAZAmBZBd d l@TddlCZCddlDm mEZFd dlAmGZGd dlHmIZId dlJmKZKeeeeLeLfddfeMd<edddg7Zee@jeAjZdddZNddZOeGjPdddddfddZQe@jRddZSdS)) timedeltaN) GeneratorTuple)urlparse is_available)returncCs ttjdS)N _rpc_init)hasattrtorch_Cr r P/var/www/html/venv/lib/python3.8/site-packages/torch/distributed/rpc/__init__.pyrsz*Failed to initialize torch.distributed.rpc)Store)!_disable_jit_rref_pickle_enable_jit_rref_pickle'_disable_server_process_global_profiler&_enable_server_process_global_profiler_set_and_start_rpc_agent_reset_current_rpc_agent)_delete_all_user_and_unforked_owner_rrefs_destroy_rref_context_set_profiler_node_id_is_current_rpc_agent_set_rref_context_get_debug_info_cleanup_python_rpc_handler_invoke_rpc_builtin_invoke_rpc_python_udf_invoke_rpc_torchscript_invoke_remote_builtin_invoke_remote_python_udf_invoke_remote_torchscript_set_rpc_timeout_get_current_rpc_agentget_rpc_timeoutenable_gil_profilingRpcBackendOptions _TensorPipeRpcBackendOptionsBaseRpcAgentPyRRefTensorPipeAgentRemoteProfilerManager WorkerInfo_DEFAULT_INIT_METHOD_DEFAULT_NUM_WORKER_THREADS_UNSET_RPC_TIMEOUT_DEFAULT_RPC_TIMEOUT_SEC)apibackend_registry functions)*) BackendType)TensorPipeRpcBackendOptions)_server_process_global_profilerendezvous_iteratorinit_rpcr5r6c CsZtjd|dk r(t|tjs(td|dk rBt|tsBtd|dkr|dk rtD] }t|tt |rV|}qqVtd||tj krt dd|i|dkrtj }|dkrt |}|st ||}n t j|j||datt\}}}|t|jd t$t td t|}td 7aW5QRXt|t|t||||||dS) ak Initializes RPC primitives such as the local RPC agent and distributed autograd, which immediately makes the current process ready to send and receive RPCs. Args: name (str): a globally unique name of this node. (e.g., ``Trainer3``, ``ParameterServer2``, ``Master``, ``Worker1``) Name can only contain number, alphabet, underscore, colon, and/or dash, and must be shorter than 128 characters. backend (BackendType, optional): The type of RPC backend implementation. Supported values is ``BackendType.TENSORPIPE`` (the default). See :ref:`rpc-backends` for more information. rank (int): a globally unique id/rank of this node. world_size (int): The number of workers in the group. rpc_backend_options (RpcBackendOptions, optional): The options passed to the RpcAgent constructor. It must be an agent-specific subclass of :class:`~torch.distributed.rpc.RpcBackendOptions` and contains agent-specific initialization configurations. By default, for all agents, it sets the default timeout to 60 seconds and performs the rendezvous with an underlying process group initialized using ``init_method = "env://"``, meaning that environment variables ``MASTER_ADDR`` and ``MASTER_PORT`` need to be set properly. See :ref:`rpc-backends` for more information and find which options are available. ztorch.distributed.init_rpcNz0Argument backend must be a member of BackendTypezEArgument rpc_backend_options must be an instance of RpcBackendOptionsz$Could not infer backend for options zRPC was initialized with no explicit backend but with options corresponding to %(backend)s, hence that backend will be used instead of the default BackendType.TENSORPIPE. To silence this warning pass `backend=%(backend)s` explicitly.backend)rank world_size)secondsZ rpc_prefix_r0)r r Z_log_api_usage_once isinstancer2r5 TypeErrorr%typeZconstruct_rpc_backend_options TENSORPIPEloggerwarningdistZ_create_store_from_optionsZ rendezvousZ init_methodr8nextZ set_timeoutrZ rpc_timeout_init_counter_lockZ PrefixStorestr _init_counter dist_autograd_initr_init_rpc_backend)namer;r<r=rpc_backend_optionsZcandidate_backendstore_r r r r9Tsl#     c Csj|tj|tj|t|tj|tjtdf|ti}| D]0\}}t ||s4t d|d|dt|q4dS)Nz Argument z must be of type z but got type ) r2r5rErrHnumbersIntegralrAr%itemsr? RuntimeError) r;rOrMr<r=rNZ type_mappingargZarg_typer r r _validate_rpc_argss$   rVcCsDt||||||tr tdtj||||||d}t|dS)NzRPC is already initialized)rOrMr<r=rN)rVrrTr2Z init_backendr1Z_init_rpc_states)r;rOrMr<r=rNZ rpc_agentr r r rLs  rLcCs*t}|t|t|S)N)rupdater1r"Zget_debug_inforJ_get_debug_info)infor r r rXsrX)Nr:NN)Tdatetimerloggingos threadingwarningstypingrr urllib.parserr Ztorch.distributed distributedrE getLogger__name__rCrILockrG__all__boolrr rrTZtorch._C._distributed_c10drZtorch._C._distributed_rpcrrrrrrrrrrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r1r2r3rQZtorch.distributed.autogradZautogradrJr5optionsr6Zserver_process_global_profilerr7int__annotations__r9rVrBrLZ_require_initializedrXr r r r sX     $    w