U Mâhk<ã @stUdZddlZddlZddlmZddlmZmZmZm Z m Z mZmZddl Z ddlZ ddlmZddlmZmZdd lmZdd lmZmZdae ¡Ze ¡Zgae eegdfe efe d<e!e j"d dd„ƒZ#eeee$dfZ%eƒa&dZ'ee j"j(e d<e)dœdd„Z*e*ƒr2e j"j+Z+e j"j,Z-e j"j.Z/n(edƒZ+e$e$dœdd„Z-e$e$dœdd„Z/edde$dœdd„ƒZ0e)dœdd„Z1d d!„Z2d"d#„Z3d$d%„Z4d&d'„Z5d(d)„Z6Gd*d+„d+ƒZ7Gd,d-„d-ƒZGd.d/„d/eƒZ8e%ddœd0d1„Z9dce e%edœd2d3„Z:edƒdde e%eeefdœd4d5„ƒZ;dee e%e+dœd6d7„ZGde?d?œd@dA„Z@dBdC„ZAedDœdEdF„ZBdfe e%edœdGdH„ZCdge%ddœdIdJ„ZDddœdKdL„ZEe je j"j(dœdMdN„ZFdhe$ee$ee jfddPœdQdR„ZGdiee$ee jfe$dœdSdT„ZHddUlITdVdWd=d9dHdd-d/ddLd5d3d7dXdYdZd'd[dd!d#d\d]d^d_d1d`dadFdAdbdJg ZJdS)jzó This package introduces support for the XPU backend, specifically tailored for Intel GPU optimization. This package is lazily initialized, so you can always import it, and use :func:`is_available()` to determine if your system supports XPU. éN)Ú lru_cache)ÚAnyÚCallableÚDictÚListÚOptionalÚTupleÚUnioné©Údevice)Ú_dummy_typeÚ_LazySeedTrackeré)Ú_get_device_index)ÚEventÚStreamFÚ _queued_callsZ_xpu_isInBadForkcCsdS©NF©rrrúD/var/www/html/venv/lib/python3.8/site-packages/torch/xpu/__init__.pyÚórrÚdefault_generators)ÚreturncCstjjS)z(Return true if compile with XPU support.)ÚtorchÚ_CZ_has_xpurrrrÚ_is_compiled!srÚ_XpuDeviceProperties)rrcCstdƒ‚dS©Nz(PyTorch was compiled without XPU support©ÚNotImplementedErrorrrrrÚ_exchange_device.sr"cCstdƒ‚dSrr rrrrÚ_maybe_exchange_device1sr#)ÚmaxsizecCstƒs dStj ¡S)z*Return the number of XPU device available.r)rrrZ_xpu_getDeviceCountrrrrÚdevice_count5sr%cCs tƒdkS)z7Return a bool indicating if XPU is currently available.r)r%rrrrÚis_available=sr&cCsdS)zKReturn a bool indicating if the current XPU device supports dtype bfloat16.TrrrrrÚis_bf16_supportedCsr'cCsto tƒS)z8Return whether PyTorch's XPU state has been initialized.)Ú_initializedÚ_is_in_bad_forkrrrrÚis_initializedHsr*cKs`tƒr|ƒnN| dd¡r,t |t ¡¡n0| dd¡rJt |t ¡¡nt |t ¡f¡dS)NÚseed_allFÚseed) r*ÚgetÚ_lazy_seed_trackerZqueue_seed_allÚ tracebackÚformat_stackZ queue_seedrÚappend)ÚcallableÚkwargsrrrÚ _lazy_callMsr4cCs tƒdS)z×Initialize PyTorch's XPU state. This is a Python API about lazy initialization that avoids initializing XPU until the first time it is accessed. Does nothing if the XPU state is already initialized. N)Ú _lazy_initrrrrÚinit[sr6cCsútƒsttdƒrdStØtƒr.W5QR£dStƒrés z)get_device_capability..)reÚdirrrrmrÚget_device_capabilityÚs ÿrqcCs4tƒt|dd}|dks$|tƒkr,tdƒ‚t|ƒS)zêGet the properties of a device. Args: device (torch.device or int or str): device for which to return the properties of the device. Returns: _XpuDeviceProperties: the properties of the device Tr[rzInvalid device index)r5rr%r=Z_get_device_propertiesrrrrreîs recCstƒtj ¡S)z0Return the index of a currently selected device.)r5rrZ_xpu_getDevicerrrrÚcurrent_deviceÿsrrcCs0t|tƒrt |¡}nt|tƒr,t d|¡}|S)zŒReturn the torch.device type object from the passed in device. Args: device (torch.device or int or str): selected device. rN)Ú isinstancer@rrrZrrrrÚ_get_devices rtc@sJeZdZUdZeded<eddœdd„Zdd„Zeeed œd d„Z dS) Ú StreamContextaContext-manager that selects a given stream. All XPU kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. útorch.xpu.StreamÚ cur_stream©ÚstreamcCs&||_tddƒ|_|jdkr"d|_dS)NTrG)ryrrH)rJryrrrrKs zStreamContext.__init__c Csn|j}|dks|jdkrdStj d¡|_|jj|jkr^t|jƒtj |j¡|_W5QRXtj |¡dSrF) ryrHrrNÚcurrent_streamÚsrc_prev_streamrÚdst_prev_streamÚ set_stream)rJrwrrrrP%szStreamContext.__enter__rQcCsJ|j}|dks|jdkrdS|jj|jkr8tj |j¡tj |j¡dSrF)ryrHr{rrrNr}r|)rJrRrSr/rwrrrrV1szStreamContext.__exit__N) rWrXrYr]rÚ__annotations__rKrPrrVrrrrrus rurv)ryrcCst|ƒS)z³Wrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. )rurxrrrry<srycCstjj|||ddS)aset stream specified by the stream id, device index and device type Args: stream_id (int): not visible to the user, used to assigned to the specific stream. device_index (int): selected device index. device_type (int): selected device type. ©Ú stream_idÚdevice_indexÚdevice_typeN)rrZ_xpu_setStreamrrrrÚ_set_stream_by_idEs ýrƒrxcCs*|dkrdStƒt|j|j|jddS)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. Nr)r5rƒr€rr‚rxrrrr}Ss ýr}cCs4tƒtj t|dd¡}t|d|d|ddS)aRReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Tr[rrr r)r5rrZ_xpu_getCurrentStreamrr)rZ streamdatarrrrzfs ÿÿrzcCstƒt|dd}tj |¡S)a*Wait for all kernels in all streams on a XPU device to complete. Args: device (torch.device or int, optional): device for which to synchronize. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Tr[)r5rrrZ_xpu_synchronizerrrrÚsynchronizexsr„cCstƒrtj ¡dS)aZRelease all unoccupied cached memory currently held by the caching allocator so that those can be used in other XPU application. .. note:: :func:`~torch.xpu.empty_cache` doesn't increase the amount of XPU memory available for PyTorch. However, it may help reduce fragmentation of XPU memory in certain cases. N)r*rrZ_xpu_emptyCacherrrrÚempty_cache…s r…cCs |j}|dkrtƒ}tjj|S)zuReturn the XPU Generator object for the given device. Args: device (torch.device): selected device. N)rErrrrNr)rrHrrrÚ_get_generator’sr†rN)Úoffsetrrcs"t|ƒ‰‡‡fdd„}t|ƒdS)a$Set the random number generator state offset of the specified GPU. Args: offset (int): The desired offset device (torch.device or int, optional): The device to set the RNG state. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). cstˆƒ}| ˆ¡dSrL)r†Z set_offset)Údefault_generator©Úfinal_devicer‡rrÚcbªsz!_set_rng_state_offset..cbN)rtr4)r‡rr‹rr‰rÚ_set_rng_state_offsetžs rŒcCstƒt|ƒ}t|ƒ}| ¡S)aLReturn the random number generator state offset of the specified GPU. Args: device (torch.device or int, optional): The device to return the RNG state offset of. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). .. warning:: This function eagerly initializes XPU. )r5rtr†Z get_offset)rrŠrˆrrrÚ_get_rng_state_offset±s r)Ú*rrZ get_rng_stateZget_rng_state_allÚ get_streamZinitial_seedZmanual_seedZmanual_seed_allr,r+Z set_rng_stateZset_rng_state_allÚstreams)N)N)N)N)N)rN)rN)Kr]Ú threadingr/Ú functoolsrÚtypingrrrrrrr rZtorch._Cr8rZ_deviceZ_utilsr rrrrrr(Úlocalr:ÚLockr;rr@r~rjrr)rZZ _device_tr.rÚ GeneratorÚboolrrZ_xpu_exchangeDevicer"Z_xpu_maybeExchangeDevicer#r%r&r'r*r4r6r5rDr^rdrgrqrerrrtruryrƒr}rzr„r…r†rŒrÚrandomÚ__all__rrrrÚsÀ$þÿ * * ÿþà