U yh@shddlZddlmZddlmZddlmZddlmZddl m Z ddl Z GdddeZ d d ZdS) N)CapabilityBasedPartitioner)OperatorSupport)CALLABLE_NODE_OPS)FakeTensorProp)_pytreec@s eZdZejjedddZdS)CudaGraphsSupport)nodereturncs|jtkrdS|jtjjjjfkr&dS|jtj fkr8dSddd}fdd}|j D]}t |||j qVt |||j  S)NFTcSsd|kr|dS|dS)NvalZ fake_result)metar r U/var/www/html/venv/lib/python3.8/site-packages/torch/fx/passes/backends/cudagraphs.pymeta_fksz4CudaGraphsSupport.is_node_supported..meta_fkcs t|tjr|jjdkrddS)NcudaT) isinstancetorchZTensorZdevicetype)tZfound_not_cudar r find_not_cudasz:CudaGraphsSupport.is_node_supported..find_not_cuda)oprtargetrZopsZatenZembedding_dense_backwarddefaultoperatorgetitemZall_input_nodespytreeZ tree_map_r )selfZ submodulesrrrnr rr is_node_supported s   z#CudaGraphsSupport.is_node_supportedN)__name__ __module__ __qualname__rZfxNodeboolrr r r r r srcCs8t|j|t}t||dd}|}||}|S)z Partition an FX graph into sub-GraphModules that can be validly run under CUDA graphs. For a subgraph to be runnable under CUDA, all of the operations must involve CUDA tensors only/ T)Zallows_single_node_partition)r propagaterrZpropose_partitionsZfuse_partitions)ZgminputsZ supported_opsZ partitionerZ partitionsZ fused_graphr r r partition_cudagraphs+s  r&)rZ!torch.fx.passes.infra.partitionerrZ torch.fx.passes.operator_supportrZtorch.fx.passes.tools_commonrZ torch.fx.passes.fake_tensor_proprZ torch.utilsrrrrr&r r r r s