U yht(@sddlZddlZddlmZddlmZddlmZmZm Z ddl m Z ddl m Z ddlmZddlmZeeZeejdd d gZed d eed ddZeeegefe eddddZe ee ee edddZed d eeeddd Zed d Gdd d ZdS)N)Queue)wraps)CallableDictList) GraphModule) compatibility) PassResultpass_result_wrapper this_before_that_pass_constraint PassManagerF)Zis_backward_compatible)fnreturncs:dkr dStfdd}ts6tj|_|S)a+ Wrapper for passes which currently do not return a PassResult. This wrapper makes them return a PassResult containing the modified object and True for the "modified" flag. Args: fn (Callable[Module, Any]) Returns: wrapped_fn (Callable[Module, PassResult]) NcsB|}|dkrt|dSt|tr(|St|tjr>t|dSdS)NT)r isinstancennModule)Zgmresr T/var/www/html/venv/lib/python3.8/site-packages/torch/fx/passes/infra/pass_manager.py wrapped_fn"s   z'pass_result_wrapper..wrapped_fn)rinspect isfunctiontype__name__)r rrrrr s   ) constraintpassesrcCsnt|D]`\}}t||ddD]B\}}|||r8q$td|d|d|d|d|d|d q$qdS) Nz,pass schedule constraint violated. Expected z before z but found z at index z and z at indexz in pass list.) enumerate RuntimeError)rriajbrrr"_validate_pass_schedule_constraint1s (r$)r constraintsrc sFt|dkr|Sdd|D}t|dt}|D]`}|D]@}||krJq<|D],}|||sN||||d7<qNq<|dkr4||q4t|d}g}|s|} || d|| <|| D]2} || s҈| d8<| dkr|| qqtt fdd } t| dkrBd | } t | |S) z Args passes: Passes that we are ordering constraints: Constraints applied on these passes Returns A sorted list of callables and a boolean of if a circular dependency existed rcSsi|] }|gqSrr.0prrr Nsz,_topological_sort_passes..rFTcs |dkS)Nrr)r(Z indegree_maprrmz*_topological_sort_passes..z:Circular dependency detected within the following passes: ) lendictfromkeysrappendputemptygetlistfilterkeysr) rr%graph candidatesr!r#rvisitedZ sorted_passesr(nZ cycle_passeserrorrr*r_topological_sort_passes>s>           r<)thisthatrcsttdfdd }|S)a Defines a partial order ('depends on' function) where `this` must occur before `that`. For example, the following pass list and constraint list would be invalid. ``` passes = [pass_b, pass_a] constraints = [ this_before_that_pass_constraint(pass_a, pass_b) ] ``` Args: this (Callable): pass which should occur first that (Callable): pass which should occur later Returns: depends_on (Callable[[Object, Object], bool] r!r#cs|kr|krdSdS)NFTrr?r>r=rr depends_onsz4this_before_that_pass_constraint..depends_on)r)r=r>rArr@rr tsc@seZdZUdZeeejgefe d<eeeege fe d<dZ e e d<dZ e e d<de e d d d Zed d dZedddZddZddZeddddZejddddZejedddZdS)r ad Construct a PassManager. Collects passes and constraints. This defines the pass schedule, manages pass constraints and pass execution. Args: passes (Optional[List[Callable]]): List of passes. A pass is a callable which modifies an object and returns a PassResult constraint (Optional[List[Callable]]): List of constraints. A constraint is a callable which takes two passes (A, B) and returns True if A depends on B and False otherwise. See implementation of `this_before_that_pass_constraint` for example. steps (int): Max number of times we run the passes (default = 1). run_checks_after_each_pass (bool): Whether to run checks and linting after each pass suppress_check_failures (bool): Whether to raise errors when running checks rr%F _validatedrstepsN)run_checks_after_each_passsuppress_check_failurescCs.|pg|_|pg|_|r||_||_||_dSN)rr%rCrDrE)selfrr%rCrDrErrr__init__s   zPassManager.__init__)_passcCs|j|d|_dS)z> Adds a pass into the current list of passes. FN)rr0rB)rGrIrrradd_passs zPassManager.add_pass)rcCs|j|d|_dS)zI Adds a constraint into the current list of constraints. FN)r%r0rBrGrrrradd_constraints zPassManager.add_constraintcCs,|jr dS|jD]}t||jqd|_dS)z Validates that current pass schedule defined by `self.passes` is valid according to all constraints in `self.constraints` NT)rBr%r$rrKrrrvalidate_constraintss  z PassManager.validate_constraintscCst|j|j|_d|_dS)ab Finds a valid traversal order based on the given constraints and orders the passes based on this order. If a circular dependency exists between the constraints and steps = 1, then we will raise an error because if steps != 1 this means that we will re-run the passes, allowing for circular dependencies. TN)r<rr%rB)rGrrrsolve_constraintss zPassManager.solve_constraints)checkrcCs8t|}tt|jdkr(tdt|d|dS)z Adds a function which takes runs various checks on a given graph module. This function is run before and after each pass if the `run_checks_after_each_pass` flag is enabled. rzEPassManager check function should only take in one variable, a modulerON)r signaturer-r4 parametersvalues TypeErrorsetattr)rGrOsigrrr add_checkss zPassManager.add_checks)modulercCsdSrFr)rGrWrrrrOszPassManager.checkc CsX|js|||d}t|jD]$}d}t|jD]\}}t|rR|j nt |j }t d|zv||}t |tst|dstd|dd|j}|p|j}t |trt d||j||jr||Wq:tk r4} z6dd |jd |D} d |d | } t| | W5d } ~ XYq:Xq:|p@|}|s&qNq&t||S) a} Runs a list of passes in the order based on `self.passes` on the given graph module. Each time a pass is run, checks and linting will be run on the graph module if `run_checks_after_each_pass` is set. If the module is a graph module, we will run the list of passes until the graph stops changing, or until `steps` number of times. FzRunning pass '%s' graph_modulezThe result of the pass z should be type PassResult.z)Please wrap it with pass_result_wrapper()zGraph after pass '%s': %scSs&g|]}t|r|jnt|jqSr)rrrrr&rrr $sz(PassManager.__call__..Nz$An error occurred when running the 'z#' pass after the following passes: )rBrNrOrangerCrrrrrrloggerdebugrr hasattrrSrXmodifiedrr7Z recompilerD Exception) rGrWZoverall_modified_r^r r fn_namereZprev_pass_namesmsgrrr__call__sJ         zPassManager.__call__)NNNFF)r __module__ __qualname____doc__rrrrr __annotations__boolrBrCintrHrJrLrMrNrVrOrdrrrrr s*       )rloggingqueuer functoolsrtypingrrrZtorch.nnrZtorch.fx.graph_modulerZtorch.fx._compatibilityrZtorch.fx.passes.infra.pass_baser getLoggerrr[setLevelWARNING__all__r rir$r<r r rrrrs2           6