U yh @sdUddlmZmZddlmZgZeeed<eedddZeeeee e e e fddd Z d S) )ListTuple)ChunkStorageMetadata__all__)shard1shard2cCsdt|j}t|D]L}|j||j||j|kr:dS|j||j||j|krdSqdS)zCheck if two shards overlap.FT)lenoffsetsrangesizes)rrZndimsir Y/var/www/html/venv/lib/python3.8/site-packages/torch/distributed/checkpoint/resharding.py"_check_shard_metadata_pair_overlap s  r) saved_shard current_shardreturnc Csg}tt|j|j|j|jD]d\}\}}}}t||||}|t||} ||krdd} ||} n ||} d} ||| | | fq|S)a[ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r) enumeratezipr r minmaxappend) rrZnarrowsdimZsaved_shard_offsetZcurrent_shard_offsetZsaved_shard_sizeZcurrent_shard_sizeZ min_range_endlengthZoffset_for_saved_tensorZoffset_for_current_tensorr r r+_shards_get_overlap_region_wrt_saved_tensors8     rN) typingrrZ%torch.distributed.checkpoint.metadatarrstr__annotations__rintrr r r rs