U Mh'; @sdZddlmZddlZddlZddlZddlmZmZmZm Z m Z m Z m Z m Z mZddlZddlmZddlmZddlmZddlmZmZed Zd d hZejGd d d Zejdddd ddddddddZejddd ddddddZ ejd dddZ!dGd dd!d"d"ddd#d$d% d&d'Z"ejd(d)Z#ejd*d+d,d-Z$ejd#d.d/d0Z%ejd$dd1d#d2d3d4Z&ejdd#d5d6d7Z'ejdd8d9d:d;Z(ejddd?Z)ejdd#d@dAdBZ*ejdd#d@dCdDZ+ejdd#d@dEdFZ,dS)HzFUtilities for manipulating the torch.Graph object and the torchscript.) annotationsN) AnyDictIterableListOptionalSequenceSetTupleUnion)_C)_onnx)GLOBALS) _beartype registrationz^(.+)_(([ifstgz])|(ty))$Zinplaceatenc@seZdZUdZded<ded<ded<ded <d ed <d ed <ded<ejedZded<dddddZ e j ddddddddZ e j ddddd d!d"Z e Ze j ddddd#d$d%Zd&S)' GraphContextaExtra context for symbolic functions with all methods from torch.Graph. NOTE: This class is not meant for external consumption. Please do not depend on it outside of torch.onnx as the interface may evolve. Attributes: graph: The _C.Graph being constructed. block: The current _C.Block being constructed. opset: The opset version. original_node: Current node that is being converted from. params_dict: Mapping from graph initializer name to IValue. env: Mapping from Torch domain graph Value to ONNX domain graph Value. values_in_env: Set of all values in env, for constant-time lookups. new_nodes: List that tracks all new nodes that are added (used to make sure metadata is propagated to all new nodes). z_C.Graphgraphz_C.Blockblockintopset_C.NodeZ original_nodezDict[str, '_C.IValue'] params_dictzDict[_C.Value, _C.Value]envz Set[_C.Value]Z values_in_env)default_factoryz List[_C.Node] new_nodesstrr)namereturncCs t|j|SN)getattrr)selfrr"P/var/www/html/venv/lib/python3.8/site-packages/torch/onnx/_internal/jit_utils.py __getattr__6szGraphContext.__getattr__outputsUnion[torch.Tensor, _C.Value])opnameraw_argsr'cOst||f|d|i|S)aCreates an ONNX operator "opname", taking "raw_args" as inputs and "kwargs" as attributes. The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md Args: opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). r')_add_op)r!r)r'r*kwargsr"r"r#op9s$zGraphContext.op) overload_name)operatorr/cOs|jd|||d|S)z~Generates an ONNX ATen op node. This function is for backward compatibility with the old symbolic functions. aten::ATen)Z operator_sZoverload_name_s)r1)r-)r!r0r/argsr,r"r"r#aten_op_szGraphContext.aten_op)r*r'cOsF|jjd|j}|jj}t|||t||f|d|i|S)aCreates an ONNX operator from onnx-script function, taking "raw_args" as inputs and "kwargs" as attributes. onnx-script repository: https://github.com/microsoft/onnx-script Args: onnx_fn: ONNXFunction from onnx-script; An example can be found at https://github.com/microsoft/onnx-script#example raw_args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). ::r')rdomainrversionrZcustom_onnx_symbolicr+)r!Zonnx_fnr'r*r,Z symbolic_name opset_versionr"r"r# onnxscript_opqs$zGraphContext.onnxscript_opN)__name__ __module__ __qualname____doc____annotations__ dataclassesfieldlistrr$rbeartyper-r3atr8r"r"r"r#rs& %rr%)r'n_blocksrz_C.Valuerz-Tuple[Any, Tuple[GraphContext, ...], _C.Node]) graph_contextr)inputsr'rCrc Osz|j|f|d|i|}t|tr2|d}n|}g}t|D]$} |} tj|| d} || qF|t ||fS)aPCreates an ONNX operator "opname", taking inputs and attributes. Args: graph_context: The context for the current graph. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. inputs: The inputs to the operator. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. n_blocks: The number of sub-blocks to create in the node. attributes: The attributes of the ONNX operator. Returns: A tuple of (output_values, new_contexts, node) where: output_values: One or more output value of this operator (see the `outputs` keyword argument for multi-return nodes). new_contexts: A tuple of new graph contexts for each sub-block. node: The node representing the operator. r'r)r) r- isinstancernoderangeZaddBlockr>replaceappendtuple) rDr)r'rCrE attributesZ output_valuesrGZ new_contexts_Z new_blockZ new_contextr"r"r#add_op_with_blockss    rNr&r()rDr)r2r'c s|fdd|D}dd|D}d|kr4d|}tj|||jj|tjd}j||dkrp| St | S) a@Creates an ONNX operator "opname", taking "args" as inputs and attributes "kwargs". The set of operators and the inputs/attributes they take is documented at https://github.com/onnx/onnx/blob/master/docs/Operators.md This function is monkey-patched onto Graph. Args: graph_context: The Torch Graph or Block. opname: The ONNX operator name, e.g., `Abs` or `Add`, or an operator qualified with a namespace, e.g., `aten::add`. args: The inputs to the operator; usually provided as arguments to the `symbolic` definition. outputs: The number of outputs this operator returns. By default an operator is assumed to return a single output. If `outputs` is greater than one, this functions returns a tuple of output `Value`, representing each output of the ONNX operator in order. kwargs: The attributes of the ONNX operator, whose keys are named according to the following convention: `alpha_f` indicates the `alpha` attribute with type `f`. The valid type specifiers are `f` (float), `i` (int), `s` (string) or `t` (Tensor). An attribute specified with type float accepts either a single float, or a list of floats (e.g., you would say `dims_i` for a `dims` attribute that takes a list of integers). Returns: (Union[_C.Value, Tuple[_C.Value, ...]]) The value representing the single output of this operator (see the `outputs` keyword argument for multi-return nodes). csg|]}t|qSr")_const_if_tensor).0argrDr"r# sz_add_op..cSsi|]\}}|dk r||qSrr")rPkvr"r"r# sz_add_op..r4zonnx::)rr7 n_outputsshape_inferencer%) items _create_noderrrrZonnx_shape_inferencerrJoutputrKr')rDr)r'r2r,rErLrGr"rRr#r+s$' r+rRcCs*|dkr |St|tjr|St|d|dS)Nzonnx::Constant)Zvalue_z)rFr Valuer+)rDrQr"r"r#rO s  rOTzUnion[_C.Graph, _C.Block]rdictboolr) graph_or_block domain_oprErLrr7rWrXrcCst|tjr*|}||||} || } ns  rmz torch.TensorxcCs|dkst|dS)z,Convert a scalar tensor into a Python value.r%r)numelrcrnr"r"r#_scalarEsrq)rcCstjtjjkotjSr)rZoperator_export_type_C_onnxZOperatorExportTypesZONNX_ATEN_FALLBACKZ_CAFFE2_ATEN_FALLBACKr"r"r"r#_is_caffe2_aten_fallbackLsrsr)rGrhrircCst|}|dkr"td|d|d|d}}t|rH|d7}|rtrt|tjr| dkrrtdt |}t|t rd}nd }t ||d ||S) z7Initializes the right attribute based on type of value.NzInvalid attribute specifier 'z<' names must be suffixed with type, e.g. 'dim_i' or 'dims_i'r%sz Should not pass tensor attributefirM) _ATTR_PATTERNmatch ValueErrorgrouprmrsrFrkrlrprqfloatr )rGrhrirmrkindr"r"r#rgTs"      rg)rorcCs|tjSr)typeZ isSubtypeOfr TensorTypegetrnr"r"r# _is_tensorosrzOptional[torch.device])rircCs&t|s dSttj|}|Sr)rtypingcastr rrZdevice)riZ tensor_typer"r"r#get_device_from_valuetsrzTuple[str, str])r~rcCsHd|krtd|d|dd\}}d|kr@td|d||fS)z(Parse node kind into domain and Op name.r4z Node kind: z& is invalid. '::' is not in node kind.r%z) is invalid. '::' should only apear once.)rzsplit)r~r5r)r"r"r#parse_node_kind|s r)r5rcCs|dkS) Check if the domain is official.rr"r5r"r"r#is_atensrcCs|dkS)rZprimr"rr"r"r#is_primsrcCs|dkS)rZonnxr"rr"r"r#is_onnxsr)T)-r< __future__rr>rerrrrrrrr r r rkr Ztorch._Cr rrZtorch.onnx._globalsrZtorch.onnx._internalrrcompilerxrf dataclassrrArNr+rOrZrmrqrsrgrrrrrrr"r"r"r#s\ ,    /? '