U
h} @ s| d dl Zd dlmZ d dlmZmZmZmZm Z m
Z
d dl Z d dl
mZ ddlmZmZmZ ddlmZ G dd d eZdS )
N)Path)AnyCallablecastOptionalTupleUnion)Image )check_integrity download_and_extract_archiveverify_str_arg)
VisionDatasetc s. e Zd ZdZdZdZdZdZdZdZ dd gd
d gd d
ggZ
ddgddggZ dZ d-e
eef eee ee ee edd fdd
Zee ee dddZeeeef d d d Zed d d!Zd.eee eejeej f d"d#d$Z ed d%d&Z dd d'd(Z ed d)d*Z ee ddd+d,Z Z!S )/STL10a `STL10 `_ Dataset.
Args:
root (str or ``pathlib.Path``): Root directory of dataset where directory
``stl10_binary`` exists.
split (string): One of {'train', 'test', 'unlabeled', 'train+unlabeled'}.
Accordingly, dataset is selected.
folds (int, optional): One of {0-9} or None.
For training, loads one of the 10 pre-defined folds of 1k samples for the
standard evaluation procedure. If no value is passed, loads the 5k samples.
transform (callable, optional): A function/transform that takes in a PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
download (bool, optional): If true, downloads the dataset from the internet and
puts it in root directory. If dataset is already downloaded, it is not
downloaded again.
Z stl10_binaryz9http://ai.stanford.edu/~acoates/stl10/stl10_binary.tar.gzzstl10_binary.tar.gzZ 91f7769df0f17e558f3565bffb0c7dfbzclass_names.txtzfold_indices.txtz train_X.binZ 918c2871b30a85fa023e0c44e0bee87fz train_y.binZ 5a34089d4802c674881badbb80307741zunlabeled_X.binZ 5242ba1fed5e4be9e1e742405eb56ca4z
test_X.binZ 7f263ba9f9e0b06b93213547f721ac82z
test_y.binZ 36f9794fa4beb8a2c72628de14fa638e)traintrain+unlabeled unlabeledtestr NF)rootsplitfolds transformtarget_transformdownloadreturnc s t j|||d t|d| j| _| || _|r<| n| sLt d| | jdkr|
| j d d | j d d \| _ | _
ttj| j
| _
| | n| jdkr>|
| j d d | j d d \| _ | _
ttj| j
| _
| | |
| j d d \}}t| j |f| _ t| j
td g|jd f| _
nj| jd
kr|
| j d d \| _ }td g| j jd | _
n(|
| jd d | jd d \| _ | _
tj| j| j| j} tj | rt | }
|
| _ W 5 Q R X d S ) N)r r r zHDataset not found or corrupted. You can use download=True to download itr r r
r r )!super__init__r
splitsr
_verify_foldsr r _check_integrity RuntimeError_STL10__loadfile
train_listdatalabelsr npndarray_STL10__load_foldsZ concatenateZasarrayshape test_listospathjoinr base_folderclass_names_fileisfileopenread
splitlinesclasses) selfr r r r r r Zunlabeled_data_Z
class_filef __class__ L/var/www/html/venv/lib/python3.8/site-packages/torchvision/datasets/stl10.pyr / s6
( (
& (
zSTL10.__init__)r r c C sT |d kr |S t |tr:|tdkr&|S d}t||nd}t|t|d S )N
zDValue for argument folds should be in the range [0, 10), but got {}.z>Expected type None or int for argument folds, but got type {}.)
isinstanceintrange
ValueErrorformattype)r6 r msgr; r; r< r [ s
zSTL10._verify_folds)indexr c C sx | j dk r&| j| t| j | }}n| j| d }}tt|d}| jdk r\| |}| jdk rp| |}||fS )z
Args:
index (int): Index
Returns:
tuple: (image, target) where target is index of the target class.
N)r
r r ) r& r% r? r Z fromarrayr' transposer r )r6 rE Zimgtargetr; r; r< __getitem__g s
zSTL10.__getitem__)r c C s | j jd S )Nr )r% r* r6 r; r; r< __len__ s z
STL10.__len__) data_file labels_filer c C s d }|rFt j| j| j|}t|d}tj|tjdd }W 5 Q R X t j| j| j|}t|d.}tj|tjd}t |d}t
|d}W 5 Q R X ||fS )Nrb)dtyper
)r ` rP )r r
rO r ) r, r- r. r r/ r2 r' fromfileZuint8ZreshaperF ) r6 rK rL r& Zpath_to_labelsr8 Z path_to_dataZ
everythingZimagesr; r; r< Z
__loadfile s zSTL10.__loadfilec C s> | j | j D ],\}}tj| j| j|}t||s dS q dS )NFT)r$ r+ r, r- r. r r/ r )r6 filenamemd5Zfpathr; r; r< r! s
zSTL10._check_integrityc C s8 | rtd d S t| j| j| j| jd | d S )Nz%Files already downloaded and verified)rR rS )r! printr urlr rR tgz_md5rI r; r; r< r s
zSTL10.downloadc C s dj f | jS )NzSplit: {split})rB __dict__rI r; r; r<
extra_repr s zSTL10.extra_reprc C s |d kr d S t j| j| j| j}t|^}| | }t j
|t j dd}| j |d d d d d d f | _ | j
d k r| j
| | _
W 5 Q R X d S )N )rN sep)r, r- r. r r/ folds_list_filer2 r3 r4 r'
fromstringZint64r% r& )r6 r Z
path_to_foldsr8 Zstr_idxZlist_idxr; r; r< Z __load_folds s
zSTL10.__load_folds)r NNNF)N)"__name__
__module__ __qualname____doc__r/ rU rR rV r0 r[ r$ r+ r r strr r r? r boolr r r r rH rJ r' r( r# r! r rX r)
__classcell__r; r; r9 r< r sF
, (r )os.pathr, pathlibr typingr r r r r r numpyr' ZPILr utilsr r r
Zvisionr r r; r; r; r< s