U yh3 @sddlZddlmZddlmZmZmZddlZddlmZe e Z ddZ ddZ Gd d d eZd d Zeeejeejd ffeeejeejd ffdddZeGdddZdS)N) dataclass)ListTupleUnion)fxcs&gfdd}tj||}|fS)z\ Flatten the args into a list form and detach the tensors from computational graph. cs<t|tjr*||j}||S||SdSN) isinstancetorchTensordetachZrequires_grad_Z requires_gradappend)avalZflat_detached_argsU/var/www/html/venv/lib/python3.8/site-packages/torch/distributed/pipelining/_utils.pyextract_tensor_argss    z0flatten_args_detach..extract_tensor_argsrnodeZ map_aggregate)argsrnew_argsrrrflatten_args_detachs rcs"gfdd}tj||S)z, Flatten the args into a list form. cs||Sr)r )r Z flat_argsrrr,s z)flatten_args..extract_tensor_argsr)rrrrr flatten_args&s rc@seZdZdZdS)PipeliningShapeErrorz5Shape mismatch between configured and runtime values.N)__name__ __module__ __qualname____doc__rrrrr9srcCs|j|jks(t|d|jd|j|j|jksPt|d|jd|j||kst|d|d|dS)Nz has a shape mismatch: expected z actual z has a dtype mismatch: expected z! has a stride mismatch: expected )shaperZdtypeZstride)descexpectedgivenrrrvalidate_tensor_metadata=s  r#.)expected_tensorsactual_tensorscCsft|t|kr2t|dt|dt|dtt|D]"}t|d|||||q>dS)Nz: Number of values (z") does not match expected number ()z: value )lenrranger#)r r$r%irrrvalidate_tensors_metadataLs r*c@s,eZdZUdZejed<eed<eed<dS)PipeInfoz> Captures information for a pipeline (`Pipe` object). graphZ num_stagesZhas_loss_and_backwardN) rrrrrZGraph__annotations__intboolrrrrr+[s  r+)logging dataclassesrtypingrrrr r getLoggerrloggerrr RuntimeErrorrr#r r*r+rrrrs