U zhD@snddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl Z ddlmZmZddlmZddlmZddlmZmZmZmZmZddlmZdd lmZmZm Z Gd d d e!Z"ee#d d dZ$e j%j&ddddZ'e j%j&ddddZ(e j%j&ddddZ)Gddde*Z+ee,edddZ-Gddde+dZ.dddd Z/e,e e e.d!d"d#Z0dS)$N)Iterable)AnyDictfinalListOptionalTupleType)HigherOrderOperator OpOverload) FakeTensor)ExportedProgram)CustomObjArgument InputKindSymIntArgumentTensorArgument TokenArgument) GraphModule)SymBoolSymFloatSymIntc@s eZdZdS)SpecViolationErrorN)__name__ __module__ __qualname__rrH/var/www/html/venv/lib/python3.8/site-packages/torch/_export/verifier.pyrsr)opreturncCs |jj SN)_schemaZ is_mutablerrrr is_functionalsr")nodercCst|Sr) _check_val)r#rrr_check_has_fake_tensorsr%cstfdddd}d|jkrH|jdkr6||jr6dStd|jd|jd}|sptd|jd |dS) Ncs|dkr dSt|ttttfr"dSt|tjtjtjtj fr@dSt|t tj frTdSt|t t tfrhdSt|trvdSt|trtfdd|DSdS)NTc3s|]}|VqdSrr).0x_check_correct_valrr 3sz9_check_val.._check_correct_val..F) isinstanceintboolstrfloattorchZ memory_formatZdtypeZdeviceZlayoutr ZTensorrrrrrall)valr(rrr)%s  z&_check_val.._check_correct_valcSst|tsdSt|jjdkS)NFr)r+r lenr Zreturnsr!rrr _no_returns6s z_check_val.._no_returnsr2 call_function Node.meta z is missing val field.z has invalid val field )metartargetrname)r#r4r2rr(rr$$s   r$cCsd|jd}|dkr$td|jt|ts`t|dtr`t|dtr`td|jd|dS)Ntorch_fnz*Unable to find torch_fn metadata for node rr6z has invalid torch_fn field )r7getrr9r+tupler.)r#r:rrr_check_torch_fnEs   r>c@s.eZdZUiZeeedfed<ddZdS) _VerifierMetaVerifier _registrycCs|r6d|ksd|krtdd|kr0|ddks^tn(d|ksBtd|ksNt|ddks^tt|dtsptt||||}||j|d<|S)Ncheck_check_graph_modulez'Overriding method check is not allowed.dialectATEN) SyntaxErrorAssertionErrorr+r.type__new__rA)metaclsr9basesattrsretrrrrISs  z_VerifierMeta.__new__N) rrrrArr.r __annotations__rIrrrrr?Ps r?)objr8rcCsT|d}|}t|D]8\}}t||sDtdd|d|t||}q|S)N.z#Node referenced nonexistent target )split enumeratehasattr RuntimeErrorjoingetattr)rOr8Z target_atomsZattr_itriZatomrrrgetattr_recursivebs   rXc@seZdZdZedddZeeedfdddZ eeedfddd Z d d Z e d d ddZ eed dddZeejj d d ddZd S)r@rErcCsXtjtjtjtjtjtjtjtjtj tj tj tj tj tjtjtjtjtjtjtjtjgSr)operatorgetitemaddmulsubtruedivgelegtlteqnefloordivmodand_or_not_pownegabsmathceilfloorselfrrrallowed_builtin_opsos,zVerifier.allowed_builtin_ops.cCsddlm}ttf|S)Nr)allowed_registered_op_types)Ztorch._export.serde.serializertr r )rrrtrrrallowed_op_typess zVerifier.allowed_op_typescCs tjjfSr)r0fxrrqrrrallowed_getattr_typesszVerifier.allowed_getattr_typescCsdSrr)rrrrrrcheck_valid_opszVerifier.check_valid_opN)gmrcCsdS)zG Additional checks that are specific to some dialects. Nr)rrryrrrcheck_additionalszVerifier.check_additional)eprcCs||jt|dSr)rCZ graph_module"_verify_exported_program_signature)rrr{rrrrBs zVerifier.checkc stttdfdfdd }ddfdd }|D]}t|tjjsNq8|j |jj D]h}|j dkrt d|j d q`|j d krt|||j q`|j d krt|j tst d t|j t||j ttjjrfd d}tjdkr|dtr:|dtr:|dtr:tdr:q`nTtdd}tdd}tdd} t dtdt|dt|dt| t|st dtd|q`|j dkr`t|q`q8|dS)N.rYcs"}tdd|Drt|S)Ncss|]}|tkVqdSrobjectr&trrrr*szOVerifier._check_graph_module.._allowed_getattr_types..)rwanyrGrMrqrr_allowed_getattr_typessz._allowed_getattr_typesc stdfdd }tttdfdfdd }tjjjtjtj tj tj tj tj tjtjjf }t||s||kr||krtd|d|d |d |t|trt|std |d |dS) NrYcs"}tdd|Dst|S)Ncss|]}t|VqdSr)inspect isbuiltin)r&rrrrr*szfVerifier._check_graph_module.._check_valid_op.._allowed_builtin_ops..)rsr1rGrrqrr_allowed_builtin_opsszSVerifier._check_graph_module.._check_valid_op.._allowed_builtin_ops.cs"}tdd|Drt|S)Ncss|]}|tkVqdSrr}rrrrr*szcVerifier._check_graph_module.._check_valid_op.._allowed_op_types..)rurrGrrqrr_allowed_op_typesszPVerifier._check_graph_module.._check_valid_op.._allowed_op_typesz Operator 'z#' is not an allowed operator type: z Valid builtin ops: zValid torch functions: z operator 'z' is not functional)rrr rr0ZautogradZ grad_modeZset_grad_enabledZsym_intZ sym_floatZsym_iteZsym_maxZsym_minZsym_notZsym_sqrtZ_CZ_set_grad_enabledr+rr r"rx)rrrZ_allowed_torch_functionsrqrr_check_valid_ops.   z5Verifier._check_graph_module.._check_valid_op> call_module call_methodz'call_module is not valid: got a class 'z' r5Zget_attrz/Expected get_attr target to be string, but got cstt|d|Sr)r+rV)r9ty)attrrr_is_typesz.Verifier._check_graph_module.._is_typeZLoweredBackendModule backend_idprocessed_bytes compile_specsZoriginal_modulezInvalid get_attr type z2. LoweredBackendModule fields: backend_id(str) : z, processed_bytes(bytes) : z, compile_specs(list) : z. Valid get_attr types: placeholder)rr rmodulesr+r0rvrgraphZlintnodesrrr8r$r.rHrXnnModulerbyteslistrSrVrz) rrryrrrgr#rrrrr)rrrrrCsX+             *  zVerifier._check_graph_module)rrrrDrrsrr rrurwrxrrzrr rBr0rvrCrrrrr@lsr@) metaclassrYc Cs|j}dd|jjD}t|t|jkrJtdt|dt|jdt|j|D]\}}t|j t t fr|j j |krtd|j j d||j tjkrqVqV|j tjkr>t|j t std|j d |j d |jdkrtd |j d |j}||jkrtd|d t|j|tjjs@td|dqV|j tjkrt|j t sttd|j d |j d |jdkrtd |j d |j}|jdkrtd|d|jdkr||jkrtd|d |jdkr@||jkr@td|dqV|j tjkr~t|j t ss z6_verify_exported_program_signature..zNumber of graph inputs (z:) does not match number of inputs in the graph signature ()zInput spec name z does not match node name z Parameter z! is not a tensor argument. Found z instead.zInputSpec for z has no target.z is not in the state dict.zState dict entry for parameter z* is not an instance of torch.nn.Parameter.zBuffer z is missing a persistence flagTFzNon-persistent buffer z( is in the state dict, it should not be.zConstant tensor z$ is not in the constants dictionary.zCustom object z( is not a custom object argument. Found zUnknown InputKind rPoutputcSs$g|]}t|tjjr|jn|qSr)r+r0rvNoder9)r&argrrrr|srzNumber of output nodes zg is different Than the number of outputs specified by the graph signature: Number of mutated buffers: z. Number of user outputs: z. zBuffer output zV does not point to a buffer that exists. Dict of buffers that are mutated, in order: z Buffer nodes available: z zUser input output z^ does not point to a user input that exists. Dict of user inputs that are mutated, in order: z User input nodes available: zMutation node z: is neither a buffer nor a user input. Buffers to mutate: z, User inputs to mutate: z User output zY is not in the correct order or is not found in the exported program's user_output list: z. )(Zgraph_signaturerrr3Z input_specsrZ user_inputszipr+rrrr9kindrZ USER_INPUTZ PARAMETERr8Z state_dictr0r ParameterZBUFFER persistentZCONSTANT_TENSOR constantsZ CUSTOM_OBJrZTOKENrrrrGargsZ output_specsZbuffers_to_mutateZ user_outputsZ output_tokensZuser_inputs_to_mutatebuffers)Zexported_programgsZinput_node_namesZ input_specr#parambufferZ tensor_constZ custom_objZ output_nodeZ output_nodesZ num_tokensendZ mutate_nodesZuser_output_nodesZ mutation_nodeZuser_output_nodeZuser_output_namerrrr| s                       &     r|)rDrcCs&|dks|dkrtj|Stj|S)NrE)r?rAr<)rDrrr load_verifiers r)1rrnrZcollections.abcrtypingrrrrrrr r0Z torch._opsr r Ztorch._subclasses.fake_tensorr Ztorch.export.exported_programr Ztorch.export.graph_signaturerrrrrZtorch.fxrZ%torch.fx.experimental.symbolic_shapesrrr Exceptionrr-r"rvrr%r$r>rHr?r.rXr@r|rrrrrs. $   !  !