U Mh.@sddlZddlZddlZddlZddlZddlmZddlZddlm Z ddl m Z ddZ ddZ d Zd d Zd"d dZdZd#ddZddZdZd$ddZdZddZddZdd Zed!kredS)%N)Dict)profiler) get_env_infocCs|ddtjdd<dSN)sysargv)Znew_argvrQ/var/www/html/venv/lib/python3.8/site-packages/torch/utils/bottleneck/__main__.py redirect_argvsr cCs|jrd|jSdS)Nzcompiled w/ CUDA znot compiled w/ CUDA)Zcuda_compiled_version)Zsysinforrr compiled_with_cudas r a\ -------------------------------------------------------------------------------- Environment Summary -------------------------------------------------------------------------------- PyTorch {pytorch_version}{debug_str} {cuda_compiled} Running with Python {py_version} and {cuda_runtime} `{pip_version} list` truncated output: {pip_list_output} cCstdt}i}d}|jr d}d}|jrB|j}|dk rFd|}nd}|j}|j}|dkr^d}||jt|t j ddt j d |||d }t j f|S) NzRunning environment analysis...z DEBUGzCUDA zCUDA unavailablezUnable to fetchr.) debug_strZpytorch_versionZ cuda_compiled py_versionZ cuda_runtime pip_versionpip_list_output) printrZis_debug_buildZis_cuda_availableZcuda_runtime_versionrZ pip_packagesZ torch_versionr r version_info env_summaryformat)inforesultrZ cuda_availcudarrrrr run_env_analysis$s2  rFcCs0tdt}|t||d||S)Nz!Running your script with cProfile)rcProfileZProfileenableexecdisable)codeglobsZlaunch_blockingprofrrr run_cprofileHs  r"z -------------------------------------------------------------------------------- cProfile output -------------------------------------------------------------------------------- tottimecCs&ttt||}||dSr)r cprof_summarypstatsZStatsZ sort_statsZ print_stats)r!sortbytopkZcprofile_statsrrr print_cprofile_summaryXsr)csNdfdd }td|ddg}tjr@||ddn |d|S)NFc s(tj|d}tdW5QRX|S)Nuse_cuda)rZprofiler)r+r!rr rr run_prof_sz#run_autograd_prof..run_profz1Running your script with the autograd profiler...r*T)F)rtorchr is_availableappend)rr r-rrr,r run_autograd_prof^s   r1z -------------------------------------------------------------------------------- autograd profiler output ({mode} mode) -------------------------------------------------------------------------------- {description} {cuda_warning} {output} cpu_timec sdddddg}|kr,d}t|d|dkr:d}nd }t|jfd d d d }|d|}|d|dtjj||d} ttjf| dS)Nr2Z cuda_timecpu_time_totalZcuda_time_totalcountzWARNING: invalid sorting option for autograd profiler results: {} Expected `cpu_time`, `cpu_time_total`, or `count`. Defaulting to `cpu_time`.CUDAz Because the autograd profiler uses the CUDA event API, the CUDA time column reports approximately max(cuda_time, cpu_time). Please ignore this output if your code does not use CUDA. r cs t|Sr)getattr)xr'rr z-print_autograd_prof_summary..T)keyreverseztop z events sorted by )mode descriptionoutput cuda_warning) rrsortedfunction_eventsr.ZautogradZ profiler_utilZ _build_tableautograd_prof_summary) r!r=r'r(Z valid_sortbywarnr@Z sorted_eventsZ topk_eventsrrr8r print_autograd_prof_summaryxs&   rEa `bottleneck` is a tool that can be used as an initial step for debugging bottlenecks in your program. It summarizes runs of your script with the Python profiler and PyTorch's autograd profiler. Because your script will be profiled, please ensure that it exits in a finite amount of time. For more complicated uses of the profilers, please see https://docs.python.org/3/library/profile.html and https://pytorch.org/docs/main/autograd.html#profiler for more information. cCs8tjtd}|jdtdd|jdttjdd|S)N)r> scriptfilezGPath to the script to be run. Usually run with `python path/to/script`.)typehelpargsz2Command-line arguments to be passed to the script.)rGnargsrH)argparseArgumentParserdescript add_argumentstr REMAINDER parse_args)parserrrr rQs  rQcCstdd|jDS)Ncss|] }|jVqdSr)r3).0eventrrr sz!cpu_time_total..)sumrB)Z autograd_profrrr r3sr3c CsRt}|j}|jdkrgn|j}|d|d}d}d}d}t|tjdtj|t |d}t | |d}W5QRX|dddd} t t t} tjrtjt|| } t|| \} } t | t| ||tjst| d ||dSt| }t| jdkr@t| }|||}t|d kr@t| d ||t| d ||dS) Nrr#r$r3rbr__main__)__file____name__ __package__ __cached__ZCPUg?r5)rQrFrIinsertr rpathosdirnameopencompilereadrrMrr.rr/initr"r1r)rEr3lenrBabs)rIrFZ scriptargsZcprofile_sortbyZ cprofile_topkZautograd_prof_sortbyZautograd_prof_topkstreamrr rZ cprofile_profZautograd_prof_cpuZautograd_prof_cudaZcuda_prof_exec_timeZcpu_prof_exec_timeZpct_diffrrr mainsF        rhrX)F)r#r$)r2r$)rKrr&rr_typingrr.Ztorch.autogradrZtorch.utils.collect_envrr r striprrr"r%r)r1rCrErMrQr3rhrZrrrr s0    $    3