U T?h @sJddlZddlmZddlmZddlmZeeZ GdddeZ dS)N)Fusion)helper) OnnxModelcs*eZdZedfdd ZddZZS)FusionQuickGelu)modelcst|ddgdS)N QuickGeluMul)super__init__)selfr __class__[/var/www/html/venv/lib/python3.8/site-packages/onnxruntime/transformers/fusion_quickgelu.pyr szFusionQuickGelu.__init__c CsT|jdkrtddS|}|jd}|j|dgdg}|dkrPtddS|d}|j|dgdg}|dkrtddS|d}|j|jd}t|dd krtd dS|jd|krtd dSt j d |g|j dg|j d d } d| _ | jt d|g|j|||g|j| |j|j| j<|d dS)Nrz/fuse_quickgelu: failed to match second Mul noderZSigmoidz,fuse_quickgelu: failed to match Sigmoid nodez.fuse_quickgelu: failed to match first Mul nodegs