U yhT@sUddlmZddlmZmZmZmZddlmZ ddl mm m Z ddlmm mZddlmZmZddlmZmZmZmZgZeeed<GdddZdS) )Future)AnyDictListOptionalN)MetadataSTATE_DICT_TYPE) LoadPlanner SavePlanner StorageReader StorageWriter__all__c @s~eZdZdZddddddeeeeje e ee ee dddZ eed d d Zeed d d Zeeefdd ddZdS) _CheckpointeraThis base class specefies a high level API for saving and loading distributed `state_dict` 's. It provides an abstraction over the low-level APIs provided by :py:mod:`torch.distributed.checkpoint.storage`, essentially calling :py:meth: `torch.distributed.state_dict_saver.save` and :py:meth: `torch.distributed.state_dict_loader.load` with the provided storage readers and writers. .. warning:: This feature is experimental and subject to removal/change. NrF) process_groupcoordinator_rankno_dist load_planner save_plannerstorage_writerstorage_readerrrrrrcCs.||_||_||_||_||_||_||_dS)a{Initializes the Checkpointer instance. Args: storage_writer: Instance of StorageWrite use to perform writes. storage_reader: StorageReader used to load data from. process_group: ProcessGroup to be used for cross-rank synchronization. coordinator_rank: Rank to use to coordinate the checkpoint. rank0 is used by default. no_dist: If ``True``, distributed checkpoint will not load in SPMD style. (Default: ``False``) loader_planner: Instance of LoadPlanner to use when loading. save_planner: Instance of SavePlanner to use when saving. Nr)selfrrrrrrrr\/var/www/html/venv/lib/python3.8/site-packages/torch/distributed/checkpoint/_checkpointer.py__init__ sz_Checkpointer.__init__) state_dictreturncCs tj||j|j|j|j|jdS)ziCalls :py:meth: `torch.distributed.state_dict_saver.save`. Utilizing values passed during initialization.)rrrplanner)saversaverrrrrrrrrrr>sz_Checkpointer.savecCstj||j|j|jdS)z Calls :py:meth: `torch.distributed.state_dict_saver._async_save`. Utilizing values passed during initialization. Returns: Future: A future holding the resultant Metadata object from `save`. )rrr)r async_saverrrr rrrr!Ls z_Checkpointer.async_savecCstj||j|j|jddS)zjCalls :py:meth: `torch.distributed.state_dict_loader.load`. Utilizing values passed during initialization.)rrrN)loaderloadrrrr rrrr#]s z_Checkpointer.load)__name__ __module__ __qualname____doc__r r rdistZ ProcessGroupintboolr r rrrrrr!rstrrr#rrrrrs,   r)concurrent.futuresrtypingrrrrZtorch.distributed distributedr(Z.torch.distributed.checkpoint.state_dict_loader checkpointZstate_dict_loaderr"Z-torch.distributed.checkpoint.state_dict_saverZstate_dict_saverrZ%torch.distributed.checkpoint.metadatarrZ$torch.distributed.checkpoint.storager r r r r r+__annotations__rrrrrs