U ?h{@s(dZddlmZmZddlZddlZddlmZmZddl m Z m Z m Z ddlm Z mZddlmZeeZdd Zd d Zed d ZddZddZddZddZddZddZddZddZddZd d!Zd"d#Z d$d%Z!d&d'Z"d(d)Z#d*d+Z$d,d-Z%e&d.d/d0Z'dd1d2d3Z(dS)4z& Implement transformation on Numba IR ) namedtuple defaultdictN)compute_cfg_from_blocksfind_top_level_loops)errorsirir_utils)compute_use_defsr) PYVERSIONcsfdd}dd}fdd}tdg}tD]L}td|||r6||r6||r6|jkr6||td |q6|S) zE Returns a list of loops that are candidate for loop lifting csdt}|jD]8}tdd|D}|sszL_extract_loop_lifting_candidates..same_exit_point..zreturn-statement in loop.Fzsame_exit_point=%s (%s))setexits successors_loggerdebuglen)loopZoutedgesksuccsok)cfgr rsame_exit_points    z9_extract_loop_lifting_candidates..same_exit_pointcSst|jdk}td||S)zthere is one entryrz one_entry=%s)rentriesrr)rrr r r one_entry(s z3_extract_loop_lifting_candidates..one_entrycsvt|jt|jBt|jB}tj|D]<}|jD]0}t|tjr4t|j tj r4t ddSq4q*t ddS)z!cannot have yield inside the loopz has yieldFzno yieldT) rbodyrrmap __getitem__ isinstancerAssignvalueYieldrr)rZinsidersblkinstblocksr r cannot_yield.s     z6_extract_loop_lifting_candidates..cannot_yieldzfinding looplift candidatesztop-level loop: %szadd candidate: %s)rinforr entry_pointrappend)rr+rr r, candidatesrr )r+rr _extract_loop_lifting_candidatess      r1cCs||}||}i}|D]}||||<qt} t} t|} | jD] } | | O} qH| jD] } | | O} q`| | B} tt|| @}tt|| @| @}||fS)z7Find input and output variables to a block region. )rr ZusemapvaluesZdefmapsorted)r+livemapcallfromreturntobody_block_idsinputsoutputs loopblocksrZ used_varsZdef_varsZdefsvsZused_or_definedr r rfind_region_inout_varsHs   r<Zloop_lift_infoz%loop,inputs,outputs,callfrom,returntocCst||}g}|D]}|j\}tt|j}t|jdkrL||\\}} n|}t|jt|jBt|jB} t ||||| d\} } t || | ||d} | | q|S)z8 Returns information on looplifting candidates. r)r+r4r5r6r7)rr8r9r5r6) r1rnextiterrrrrr!r<_loop_lift_infor/)rr+r4loops loopinfosrr5Zan_exitr6rZlocal_block_idsr8r9Zllir r r_loop_lift_get_candidate_infoshs,   rBcCs2|j}|j}tj||d}tj|||||d|S)zR Transform calling block from top-level function to call the lifted loop. scopeloc)ZnewblockZcallee label_nextr8r9)rDrErBlockrZfill_block_with_call) liftedloopblockr8r9r6rDrEr(r r r_loop_lift_modify_call_blocksrJcCsh||j}|j}|j}t|d}tjtj||d|j|jd||<tj tj||d|j d||j <dS)z? Inplace transform loop blocks for use as lifted loop. rrC)rIr8rF)rIr9N) r5rDrEminrZfill_callee_prologuerrGr8Zfill_callee_epiloguer9r6)loopinfor+Z entry_blockrDrEZfirstblkr r r_loop_lift_prepare_loop_funcs     rMcsddlm}|j}t|jt|jB} t|jdkr>| |jO} tfdd| D} t || |j | t |j t|j dd} || ||||} t | |j|j |j|j} | D] }|=q| |j<| S)zu Modify the block inplace to call to the lifted-loop. Returns a dictionary of blocks of the lifted-loop. r) LiftedLooprc3s|]}||fVqdSr )copy)r rr*r rrsz+_loop_lift_modify_blocks..T)r+ arg_names arg_countZforce_non_generator)numba.core.dispatcherrNrrr!rrrdictrMderivetupler8rJr5r9r6)func_irrLr+ typingctx targetctxflagslocalsrNrZ loopblockkeysr:Z lifted_irrHZ callblockrr r*r_loop_lift_modify_blockss6     r[cCspt|jdkrdSt|j}|}t}t|}|rd|}||||||h8}||}q2t|dkS)zReturns True if there is more than one exit in the loop. NOTE: "common exits" refers to the situation where a loop exit has another loop exit as its successor. In that case, we do not need to alter it. rF)rrrZpost_dominatorspopadd)rZlpinforZpdom processedremainnoder r r_has_multiple_loop_exitss   racCsZddlm}t|j}|D]}t||r"t||j\}}q"| || |S)z(Canonicalize loops for looplifting. r) PostProcessor) Znumba.core.postprocrbrr+r@r2ra_fix_multi_exit_blocksrZ_reset_analysis_variablesrun)rVrbrZ loop_infoZ _common_keyr r r_pre_looplift_transforms     rec Cst|}|j}t|}t|||jj}g}|rHtdt || |D]"} t || |||||} | | qL|j |d} | |fS)z Loop lifting transformation. Given a interpreter `func_ir` returns a 2 tuple of `(toplevel_interp, [loop0_interp, loop1_interp, ....])` z+loop lifting this IR with %d candidates: %sr*)rer+rOrrBvariable_lifetimer4rrrZdump_to_stringr[r/rT) rVrWrXrYrZr+rrAr@rLZliftedmainr r r loop_liftings,   rhcsftfddfddfdd}ddfd d }|D] }||qTS) z5 Rewrite loops that have multiple backedges. cstdS)Nr)maxkeysr ) newblocksr r new_block_id"sz6canonicalize_cfg_single_backedge..new_block_idcsFd}|jD]6}|}|j}|j|kr |d7}|dkr dSq dS)NrrTF)r! terminator get_targetsheader)rcountrr(edgesr*r rhas_multiple_backedges%s   z@canonicalize_cfg_single_backedge..has_multiple_backedgesc3s$D]}|r |Vq dSr )r@r2)Zlp)rrrr r#yield_loops_with_multiple_backedges2szMcanonicalize_cfg_single_backedge..yield_loops_with_multiple_backedgescsrfdd}t|tjr.replace_target..replace)condtruebrfalsebrrErtrE) r$rBranchryrzr{rEJumprtrnAssertionError)termrwrvrxr rurreplace_target7s   z8canonicalize_cfg_single_backedge..replace_targetcs|j}}|jD]>}|}||jkr|}|j|||jd<||<q|}tj|j|jd}| tj ||jd||<dS)zC Add new tail block that gathers all the backedges rCr|N) ror!rmrnrOrrGrDrEr/r~)rroZtailkeyZblkkeyr(ZnewblkZentryblkZtailblk)rlrkrr rrewrite_single_backedgeFs   zAcanonicalize_cfg_single_backedge..rewrite_single_backedge)rrO)r+rsrrr )r+rrrrlrkrr canonicalize_cfg_single_backedges    rcCst|S)zc Rewrite the given blocks to canonicalize the CFG. Returns a new dictionary of blocks. )rr*r r rcanonicalize_cfgasrc sddlm}dfdd }t|\}}|s8|gfS|||jsPt|j}|j} |j } g} |D]d\} } g}t | | | D]}| |qt | | t || | \}}||| | | |||}| |qn| s|}n || }|| fS)zWith-lifting transformation Rewrite the IR to extract all withs. Only the top-level withs are extracted. Returns the (the_new_ir, the_lifted_with_ir) r)postprocFcsRddlm}m}}|r:d|_d|_d|_d|_|}n|}|||f|S)Nr) LiftedWithObjModeLiftedWithFT)rRrrrOZenable_loopliftZenable_pyobjectZforce_pyobjectZno_cpython_wrapper)rVZ objectmodekwargsrrZmyflagsclsrYrZrXrWr rdispatcher_factoryrsz(with_lifting..dispatcher_factory)F) numba.corerfind_setupwithsrbrdrfrr+rOr_cfg_nodes_in_regionr/_legalize_with_head_get_with_contextmanagermutate_with_bodyrT)rVrWrXrYrZrrwithsZvltr+rZsub_irs blk_startZblk_endZ body_blocksr`ZcmkindextrasubZnew_irr rr with_liftingis6          rcsdfddfdd}jD]L}t|tjr.|j}||\}}t|dsntjdjd||fSq.tjd jdd S) z7Get the global object used for the context manager zIllegal use of context-manager.cs |S)z#Get the definition given a variable)get_definition)varrVr r get_var_dfnsz-_get_with_contextmanager..get_var_dfncs|}t|tjrZ|jdkrZfdd|jD}fdd|jD}||d}|j}nd}t tj |}|tj krt j djd |dkrt j |jd ||fS) zReturn the context-manager object and extra info. The extra contains the arguments if the context-manager is used as a call. callcsg|] }|qSr r )r rrr r szD_get_with_contextmanager..get_ctxmgr_obj..csi|]\}}||qSr r )r rvrr r szD_get_with_contextmanager..get_ctxmgr_obj..)argsrNz*Undefined variable used as context managerrE)rr$rExproprkwsfuncrguardZfind_outer_valueZ UNDEFINEDr CompilerErrorrE)var_refdfnrrrctxobjZ_illegal_cm_msgrr+rVrr rget_ctxmgr_objs    z0_get_with_contextmanager..get_ctxmgr_objrz"Unsupported context manager in userzmalformed with-context usageN) r!r$r EnterWithcontextmanagerhasattrrrrE)rVr+rrstmtrrrr rrrs"    rcCstt}|jD]}|t|d7<q|tjdkrHtjd|j d|tj ddkrjtjd|j d|tj d|rtjd|j ddS)zaGiven *blk*, the head block of the with-context, check that it doesn't do anything else. rz0with's head-block must have exactly 1 ENTER_WITHrrz*with's head-block must have exactly 1 JUMPNz'illegal statements in with's head-block) rintr!typer\rrrrrEr~Del)r(Zcountersrr r rrs& rc sft|g}|rb|}t||}|r t|\}}tfdd|D}|||Oq S)z;Find the set of CFG nodes that are in the given region cs g|]}|kr|kr|qSr r )r r` region_endZ region_nodesr rrsz(_cfg_nodes_in_region..)rr\listrzipextend) rZ region_beginrstackZtosZsucclistrrZnodesr rrrs   rc sdd}j}||}t||dd|D}|D],\}}||j}t|dkr8tdq8|D]H\}}||}t j|jdjrjt dkrtd t |qjfd d|D}t |}|fS) zQFind all top-level with. Returns a list of ranges for the with-regions. c Ss(t|}tt}}|D]<\}}|jD],}t|rD||t|r,||q,qtt}|j |ddD]}gg} } | || rr| }| |||jD]t}t |rt dt|r||kr|||||qt|r|D]} | | kr| | qqqqr|S)NT)reversezBunsupported control flow due to raise statements inside with block)rritemsr!rZ is_setup_withr] is_pop_blockrZ topo_sortr/r\Zis_raiserrremoveZ is_terminatorrn) r+rZ sus_setupsZsus_popslabelrIrZsetup_with_to_pop_blocks_mapZ setup_blockZto_visitseentr r r find_rangess:            z$find_setupwiths..find_rangescSs g|]\}}|t|dfqSr)rr spr r rrMsz#find_setupwiths..rzlunsupported control flow: with-context contains branches (i.e. break/return/raise) that can leave the block r)zDunsupported control flow: due to return statements inside with blockcs(g|] \}}|j|jdfqSr)r+rmrnrrr rrhs) r+consolidate_multi_exit_withsrrmrnrrrrZ is_returnr _rewrite_return_eliminate_nested_withs) rVrr+Zwith_ranges_dictZwith_ranges_tuplerrtargets target_blockr rrr s82       rcCst|j|}|jd}|j|}t|j}|d}|j}tjd|d}tj||d} gg} } | tj } t | dkst t | tj dkst t|jdtj st | d} |j| }| |jd|| t ||j| |j|d| t ||j|j|j}| j||j|j| |j|j| | |j|<t|j|_|S)u:Rewrite a return block inside a with statement. Arguments --------- func_ir: Function IR the CFG to transform target_block_label: int the block index/label of the block containing the POP_BLOCK statement This implements a CFG transformation to insert a block between two other blocks. The input situation is: ┌───────────────┐ │ top │ │ POP_BLOCK │ │ bottom │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ RETURN │ │ │ └───────────────┘ If such a pattern is detected in IR, it means there is a `return` statement within a `with` context. The basic idea is to rewrite the CFG as follows: ┌───────────────┐ │ top │ │ POP_BLOCK │ │ │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ bottom │ │ │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ RETURN │ │ │ └───────────────┘ We split the block that contains the `POP_BLOCK` statement into two blocks. Everything from the beginning of the block up to and including the `POP_BLOCK` statement is considered the 'top' and everything below is considered 'bottom'. Finally the jump statements are re-wired to make sure the CFG remains valid. rrNrr)r+rmrnrZfind_max_labelrErZScoperGZ find_instsZPopBlockrrr~r$r!indexrr/clearZbuild_definitionsZ _definitions)rVZtarget_block_labelrZtarget_block_successor_labelZtarget_block_successor max_labelZ new_labelZ new_block_locZnew_block_scopeZ new_blockZtop_bodyZ bottom_bodyZ pop_blocksZ pb_markerZpb_isZ return_bodyr r rrqs8:            rcCs<g}dd}t|D]"\}}||||s|||fq|S)NcSs(|D]\}}||kr||krdSqdS)NTFr )startend known_rangesabr r rwithin_known_ranges z3_eliminate_nested_withs..within_known_range)r3r/)Z with_rangesrrrer r rrs   r)rcCs@|D]6}||}t|dkrt||tjd\}}|h||<q|S)zGModify the FunctionIR to merge the exit blocks of with constructs. rsplit_condition)rrcrr)rr+rVrr;commonr r rrs   rrc Cs|j}t|j}|j}t|jd}tj|jtjd}|}|d7}|||<tj|jtjd} |} |d7}| || <g} t|D]\} } || }|dk rt|j D]\}}||rqqnd}|j d|}|j |d}| |||_ |j }|j tj tj | |d|jd|d|d|jr(t|j tj|tjdq|dk r`|j | dd|jrlt|j tj| |dg}| D]}| ||d7}q| }tj}t| D]\} }|jd|d}|jd |d}|j tj tj | |d||d|j tj tjjtj|d||d ||d|d\}|j tj|||| |dtj||d }|||| <q|j tj||d||fS) a Modify the FunctionIR to create a single common exit node given the original exit nodes. Parameters ---------- func_ir : The FunctionIR. Mutated inplace. exit_nodes : The original exit nodes. A sequence of block keys. split_condition : callable or None If not None, it is a callable with the signature `split_condition(statement)` that determines if the `statement` is the splitting point (e.g. `POP_BLOCK`) in an exit node. If it's None, the exit node is not split. rrNrz$cp)r&rtrErz $cp_checkz$cp_rhs)fnlhsrhsrErC)r+rKr2rDrirrGZ unknown_loc enumerater!r/rEr%ZConstZ get_or_defineZ is_terminatedrr~ZredefinerZbinopoperatoreqgetrnr})rVZ exit_nodesrr+Zany_blkrDrZ common_blockZ common_labelZ post_blockZ post_labelZ remainingsirr(ptrbeforeafterrEZ remain_blocksr_Z switch_blockZ match_exprZ match_rhsZ jump_targetr r rrcs4          rc))__doc__ collectionsrrloggingrZnumba.core.analysisrrrrrrr Znumba.core.utilsr getLogger__name__rr1r<r?rBrJrMr[rarerhrrrrrrrrrrSrrcr r r rs>  5!'F;9ek