U zh[ @sddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z m Z m Z m Z mZddlZddlmZddlmZddlmZmZddlmZmZddlmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&ej'd ej(d ej)d ej*d ej+d ej,diZ-e ej.j/dddZ0d>dddddeee ee e&e e1e e$e ee2ddddZ3eej.j/e2dddZ4eej.j/e ej5jdddZ6eej.j/e2dddZ7eej.j/e ej8dddZ9eej.j/e2dd d!Z:eej.j/e ej8dd"d#Z;ej.jd?e ej.j/e ej.j/d'd*d+Z?e ej.j/e@d'd,d-ZAe ej.j/e ej.j/d'd.d/ZBd@ej.j/ej.j/e2dd0d1d2ZCej.j/dd3d4d5ZDej5jEd6d7d8ZFd9d:ZGej.j.get_keystrr)_convert_range_to_int) try_solvez&Unexpected number of inputs (expected z, got )valzExpected input at z to be a tensor, but got z,Unexpected number of dimensions in input at z.shape (expected r!z.shape[z] to be equal to z , but got zExpected input z] = z to be of the form z, where z is an integerr#z ] to be >= z ] to be <= z to be equal to )!rr'sympyZ@torch._export.passes.add_runtime_assertions_for_constraints_passr,Ztorch.utils._sympy.solver-len RuntimeErrorzipmetagetr$r torchTensortypeshape enumerateZSymIntnodeexprZ free_symbolsnextitersubsZ is_numberEqr(intmathinffloat)rflat_args_with_pathZrange_constraintsr+r0r,r-Zunification_maprargr;Znode_valjZarg_dimZnode_dimsymbolZ existing_dimZsolutionZmin_valZmax_valr)r)r*"_check_input_constraints_for_graph.s           (       rIF)serialized_type_nameto_dumpable_contextfrom_dumpable_contextreturn_none_fields)cls flatten_fn unflatten_fnrJrKrLrMr c ststdtttttfdfdd }ttttdfdd }tttttfdfdd } dk r~n||dk r|n|}|dk|dkArtd d t ||| ||d dS) Nz7Only dataclasses can be registered with this function: )objr cshg}g}g}t|D]D}|jt||j}}|dk s:rP||||q||q|||gfSN) dataclassesfieldsr(getattrappend)rQ flattened flat_names none_namesfr(r/)rMr)r*default_flatten_fns    z=register_dataclass_as_pytree_node..default_flatten_fn)valuescontextr cs&|\}}ftt||t|SrR)dictr3fromkeys)r\r]rXrY)rNr)r*default_unflatten_fnsz?register_dataclass_as_pytree_node..default_unflatten_fncs(|\}\}}ddt||D|fS)NcSsg|]\}}t||fqSr))r).0kvr)r)r* sz[register_dataclass_as_pytree_node..default_flatten_fn_with_keys..)r3)rQrWrXrY)rOr)r*default_flatten_fn_with_keysszGregister_dataclass_as_pytree_node..default_flatten_fn_with_keysz7Both to_dumpable_context and from_dumpable_context for z must be None or registered.)rJZflatten_with_keys_fnrKrL) rS is_dataclassr%rrrrr ValueErrorr) rNrOrPrJrKrLrMr[r`rer))rNrOrMr*!register_dataclass_as_pytree_nodes.    rh)programr;r cCs|j|jjkS)zM Checks if the given node is a parameter within the exported program )r(graph_signatureinputs_to_parametersrir;r)r)r*is_paramsrmcCs&t||r"|jj|j}|j|SdS)z Returns the parameter associated with the given node in the exported program. Returns None if the node is not a parameter within the exported program N)rmrjrkr( state_dict)rir;Zparameter_namer)r)r* get_params  rocCs|j|jjkS)zJ Checks if the given node is a buffer within the exported program )r(rjinputs_to_buffersrlr)r)r* is_buffersrqcCs<t||r8|jj|j}||jjkr.|j|S|j|SdS)z Returns the buffer associated with the given node in the exported program. Returns None if the node is not a buffer within the exported program N)rqrjrpr(Znon_persistent_buffers constantsrn)rir;Z buffer_namer)r)r* get_buffers    rscCs|j|jjkS)zZ Checks if the given node is a lifted tensor constant within the exported program )r(rj!inputs_to_lifted_tensor_constantsrlr)r)r*is_lifted_tensor_constantsrucCs&t||r"|jj|j}|j|SdS)z Returns the lifted tensor constant associated with the given node in the exported program. Returns None if the node is not a lifted tensor constant within the exported program N)rurjrtr(rr)rir;Zlifted_tensor_namer)r)r*get_lifted_tensor_constants  rv)gmr cslddlm}id}|jjD]}||r0|d7}||<q|||fddddd}|jj|j_||S)z Splits the graph module into multiple submodules based on the node_call_back. The node_call_back should return True if the node is a delimiter. Delimiter will be the first node in the next submodule. r) split_moduler!cs|SrRr)r;Z split_mapr)r*?z"sequential_split..T)Zkeep_original_orderZkeep_original_node_name)Ztorch.fx.passes.split_modulerxgraphnodesZ_codegen recompile)rwnode_call_backrxZsplit_idr;Znew_gmr)rzr*sequential_split-s"     r)r~r csfdd|DS)z:Returns the nodes that match the node_call_back as a list.csg|]}|r|qSr)r)rar;rr)r*rdKsz nodes_filter..r)r~rr)rr* nodes_filterIsrcCs.t||r |ndd}t|dkr*|dSdS)z Returns the first node that matches the node_call_back. If no node matches, returns None. When node_call_back is None, returns the first node in the node list. cSsdS)NTr)ryr)r)r*r{Ur|znodes_first..rN)rr1)r~rretr)r)r* nodes_firstNs rcCstt||S)z:Returns the number of nodes that match the node_call_back.)r1rrr)r)r* nodes_count[srcCs|D] }||q|S)z Sequentially visit the nodes list and invoke node_call_back on each element. Returns the nodes list after the node_call_back is invoked on each element. r))r~rr;r)r)r* nodes_map`s r)old_nodenew_node delete_oldr cCs(|||r$|j|j|dS)z5 Replace all uses of old_node with new_node. N)Zreplace_all_uses_withusersclearr} erase_node)rrrr)r)r* node_replace_js  r) call_mod_noder c s|jdkst|jj}t|jts&tt||j}dd|jjD}dd|jjD}dd|jjD}t ||j D](\}}t|t j j stt||ddqt|j||D]}|j|} t|| ddqt|d krt|d krt|d j d kst|d j d tt j j r0t|ddn\tttfrxtt|jd d } t| fd d |j|ntdtdn |j|W5QRX|||S)z Inline the submodule of the given node into the parent module. Note: we only support the case where submodule takes tensors inputs. Z call_modulecss|]}|jdkr|VqdS) placeholderNoprr)r)r* s znode_inline_..css|]}|jdkr|VqdS))routputNrrr)r)r*rs cSsg|]}|jdkr|qS)rrrr)r)r*rds z node_inline_..Trrr!cSs|jdko|jtjkS)NZ call_function)rtargetoperatorgetitemryr)r)r*r{s znode_inline_..cst||jdddS)Nr!Tr)rargs)Z get_item_nodeZ new_outputr)r*r{s zUnsupported output type z2. Expect it to be a Node or a list/tuple of Nodes.)rr%r}Z owning_moduler$rr'rUr~r3rr6fxNoderZinserting_beforeZ node_copyr1listtuplerrkeysrrNotImplementedErrorr8Zdelete_all_unused_submodulesr) rrwZsub_gmZphsbodyrphrFr;rZget_item_usersr)rr* node_inline_vsL  $  r)modc Cs~t|j}|jd}dtji}g}|D]D\}}ddt|j|D}|D] }|dkr\qN| t ||qNq,t j |dS)z Get source code and parse argument names using AST. The function returns a signature of the forward() function. # TODO: Directly provide inspect.signature compatible TS-d module. rrcSsg|] }|jqSr))rF)raar)r)r*rdsz:_get_torch_jit_trace_forward_signature..self) parameters) astparsecoderrPOSITIONAL_OR_KEYWORDitemsrUrrVinspect Signature) rZast_modZ ast_func_defZ arg_type_mapZ param_listZarg_typeZ param_typeZ arg_name_listarg_namer)r)r*&_get_torch_jit_trace_forward_signatures   rcCs\t|tjjtjjfrBt|}t|jt|t|ksNtdn t |j }|j ||j S)NzyArguments other than POSITIONAL_OR_KEYWORD kinds in forward() are not supported in _get_torch_jit_trace_forward_signature)r$r6ZjitZ ScriptModuleZ TracedModulerr1rr%r signatureforwardbind arguments)r fake_args fake_kwargssigr)r)r*_bind_signature_to_inputss r)rwexport_graph_signaturerrrr c sdd}ddi}t|||} t| \} } dd|jD} t| | D]>\\} }}|rFt||ttjdfdd | Dd d qF|jD]^}|j tjkrq|j tj krd }n||j  }t d d|}t||jjt|j |d d q|jjD]"}|jdkrqt||j|jq|jjD]N}|jdkrT|j|ks@t||j|_|_ n|j|kr ||j|_q t|||jD]V}|jj|kst||jj|j_|j tjkr|j |kr||j dd|_ q|jD]J}|jj|kr||jj|j_|j tjkr|j |kr||j |_ qt|D]h}||}||kr._strip_namecSsbt|tr"tddt|j}|St|tr6t|jSt|trF|j St dt |d|dS)NrrzPytree key of type z not handled for ) r$rrrr'keyrr&rr(r2r8rr)r)r*_extract_pytree_keys    z4placeholder_naming_pass.._extract_pytree_keycSs g|]}|jtjkr|jjqSr))kindr USER_INPUTrFr()raspecr)r)r*rd s z+placeholder_naming_pass..rc3s|]}|VqdSrR)lower)rarrr)r*rsz*placeholder_naming_pass..T)Zis_placeholderrrrNz arg(\d+)_1)!rrZ input_specsr3r placeholder_prefixesrrjoinrTOKENrrrrrFr(r}r~rr%r r CUSTOM_OBJZ output_specsrZUSER_INPUT_MUTATIONrrr$r6r7match)rwrrrrZfake_params_buffersrrrZname_mapZ combined_argsrErZuser_input_namesZarg_pathrFZuser_input_namer base_namer;r(Zconstantnew_namer)rr*placeholder_naming_passs                 r)NN)N)F)KrrSrrBrrrtypingrrrrrrr r6Ztorch._subclasses.fake_tensorr Z torch.exportr Ztorch.export.exported_programr r Ztorch.export.graph_signaturerrZtorch.utils._pytreerrrrrrrrrrrrrZ PARAMETERZBUFFERZCONSTANT_TENSORrrrrrrIr'boolrhrmnnrorqr7rsrurvZ GraphModulerrrrArrrrModulerrZexportZExportGraphSignaturerr)r)r)r*s $  8 z 7           =