U zâhò1ã@s6UddlmZddlZddlZddlZddlZddlZddlmZddlm Z ddl mZmZm Z mZmZmZddlmZddlmZer¢ddlmZmZmZmZdadadagad ed <gZded<da da!ga"d ed<da#dd„Z$eGdd„dƒƒZ%dd„Z&Gdd„dƒZ'iZ(ded<eGdd„dƒƒZ)e) *dddddd d!d"g¡e) *d#d$d%d&g¡e) *d'd(d)ddd*d+d,g¡e) *d-d.d/d0d1d2d3d4d5g¡e) *d6d7d8d9d*d+d:d;dd?d@dAdBdCg¡dDdE„Z+dFdG„Z,dHdI„Z-dJdK„Z.dLdM„Z/dNdO„Z0dPdQ„Z1dRdS„Z2dTdU„Z3dVdW„Z4dXdY„Z5e dZd[œd\d]„ƒZ6d^d_„Z7d`da„Z8dS)bé)ÚannotationsN)Ú dataclass)Ú lru_cache)ÚDictÚListÚSetÚTupleÚ TYPE_CHECKINGÚUnion)Úconfig)Úget_benchmark_name)ÚBaseSchedulerNodeÚExternKernelSchedulerNodeÚNopKernelSchedulerNodeÚ SchedulerNodezYList[Tuple[Union[NopKernelSchedulerNode, SchedulerNode, ExternKernelSchedulerNode], int]]Únodes_num_elemz%List[Tuple[BaseSchedulerNode, float]]Ú node_runtimesz List[int]Ú!cpp_outer_loop_fused_inner_countscCs4dadadat ¡t ¡dadat ¡da dS)Nr) Úgenerated_kernel_countÚgenerated_cpp_vec_kernel_countÚnum_bytes_accessedrÚclearrÚir_nodes_pre_fusionÚcpp_to_dtype_countrÚnum_comprehensive_padding©rrúI/var/www/html/venv/lib/python3.8/site-packages/torch/_inductor/metrics.pyÚreset4s rc@s:eZdZUdZded<ded<ded<ded<ded<dS) ÚCachedMetricsDeltasz] The subset of metrics we want update across cache hits, e.g., the FxGraphCache. ÚintrrrrrN)Ú__name__Ú __module__Ú__qualname__Ú__doc__Ú__annotations__rrrrrHs rcCsdd„t t¡DƒS)NcSsg|] }|j‘qSr©Úname)Ú.0ÚfieldrrrÚ Wsz%get_metric_fields..)ÚdataclassesÚfieldsrrrrrÚget_metric_fieldsVsr,c@s8eZdZdZdd„Zddœdd„Zeddœd d „ƒZdS)ÚCachedMetricsHelperz¯ A helper class to help calculate and apply counter deltas for those metrics we want to save with cache entries (e.g., FxGraphCache) and apply on a cache hit. cCs&i|_tƒD]}tƒ||j|<qdS©N)Úcached_metricsr,Úglobals)ÚselfÚmetricrrrÚ__init__as zCachedMetricsHelper.__init__r©ÚreturncCs2i}tƒD]}tƒ||j|||<q tf|ŽSr.)r,r0r/r)r1Z delta_metricsr2rrrÚ get_deltasfs zCachedMetricsHelper.get_deltas)ÚdeltacCs(tƒD]}tƒ|t||ƒ7<qdSr.)r,r0Úgetattr)r7r2rrrÚapply_deltasms z CachedMetricsHelper.apply_deltasN)r r!r"r#r3r6Ústaticmethodr9rrrrr-Zs r-zDict[str, MetricTable]ÚREGISTERED_METRIC_TABLESc@sVeZdZUded<ded<dZded<dd „Zd d„Zdd „Zdd„Ze dd„ƒZ dS)ÚMetricTableÚstrÚ table_namez List[str]Úcolumn_namesrrÚnum_rows_addedcs¨|jtƒkrdS|ƒ‰t|jƒtˆƒksDtt|jƒ›dtˆƒ›ƒ‚t|jƒtˆ ¡ƒksztt|jƒ›dtˆ ¡ƒ›ƒ‚tƒg}|‡fdd„|jDƒ7}| |¡dS)Nz v.s. csg|]}ˆ|‘qSrr)r'Zcolumn_name©Zrow_dictrrr)Œsz'MetricTable.add_row..) r>Úenabled_metric_tablesÚlenr?ÚAssertionErrorÚsetÚkeysrÚ _write_row)r1Zrow_fnÚrowrrArÚadd_row}s" ÿþ ÿþÿzMetricTable.add_rowcCsd|j›dS)NZ metric_table_z.csv)r>)r1rrrÚoutput_filenameszMetricTable.output_filenamec CsB| ¡}t|dƒ&}tj|dd}| dg|j¡W5QRXdS)NÚwÚ ©ÚlineterminatorZ model_name)rJÚopenÚcsvÚwriterÚwriterowr?)r1ÚfilenameÚfdrQrrrÚwrite_header’szMetricTable.write_headerc Cs¦| ¡}|jdkr&tj |¡s&| ¡|jd7_t|ƒD]6\}}t|tƒrX|d›}n|dkrfd}n|}|||<qps&ÿñz%log_kernel_metadata..N) rur—r†r…r|r”rÚget_metric_tablerI)rfrgrzr—rr˜rÚlog_kernel_metadata\s ÿr›cCsFt ¡D]8\}}|tƒkr| ¡}tj |¡r8t |¡| ¡qdS)z» Purge the old log file at the beginning when the benchmark script runs. Should do it in the parent process rather than the child processes running each individual model. N) r;ÚitemsrBrJrYrZr[ÚunlinkrU)r&rarSrrrÚpurge_old_log_files†s ržzSet[str]r4cCsPtj}tƒ}| d¡D]4}| ¡}|s(q|tks@td|›dƒ‚| |¡q|S)NrŒzMetric table name z is not registered)rrBrErÚstripr;rDÚadd)Z config_strZenabledr&rrrrB•sÿ þrBcCs |tƒkSr.)rBr%rrrÚis_metric_table_enabled¥sr¡cCs |tkstd|›dƒ‚t|S)Nz Metric table z is not defined)r;rDr%rrrrš©srš)9Ú __future__rrPr*rwrYrrÚ functoolsrÚtypingrrrrr r Ztorch._inductorrZtorch._inductor.utilsrZtorch._inductor.schedulerr rrrrrrrr$rrrrrrrr,r-r;r<rbr|rr…r†r‰r‘r”r•r–r›ržrBr¡ršrrrrÚsÔ û ;ùþýþùþøþìþ *