*#h v d dl Z d dlZd dlmZmZmZ d dlmZ d dlm Z m
Z
m Z m Z ddl
mZ e G d d Zy) N)InitVar dataclassfield)Path)AnyDictOptionalUnion )configc e Zd ZU dZdZeeeef e d< dZ
e e d< dZ e e d< dZ
e e d< dZee e d< dZee e d < dZe e d
< dZe e d < dZe e d < d
Ze e d< dZee e d< dZee d< dZeeee f e d< dZeeeee f e d< dZe e d< e e Z eee f e d< dZ ee e d< d Z!d dZ" fdZ# xZ$S ) DownloadConfiga
Configuration for our cached path manager.
Attributes:
cache_dir (`str` or `Path`, *optional*):
Specify a cache directory to save the file to (overwrite the
default cache dir).
force_download (`bool`, defaults to `False`):
If `True`, re-dowload the file even if it's already cached in
the cache dir.
resume_download (`bool`, defaults to `False`):
If `True`, resume the download if an incompletely received file is
found.
proxies (`dict`, *optional*):
user_agent (`str`, *optional*):
Optional string or dict that will be appended to the user-agent on remote
requests.
extract_compressed_file (`bool`, defaults to `False`):
If `True` and the path point to a zip or tar file,
extract the compressed file in a folder along the archive.
force_extract (`bool`, defaults to `False`):
If `True` when `extract_compressed_file` is `True` and the archive
was already extracted, re-extract the archive and override the folder where it was extracted.
delete_extracted (`bool`, defaults to `False`):
Whether to delete (or keep) the extracted files.
use_etag (`bool`, defaults to `True`):
Whether to use the ETag HTTP response header to validate the cached files.
num_proc (`int`, *optional*):
The number of processes to launch to download the files in parallel.
max_retries (`int`, default to `1`):
The number of times to retry an HTTP request if it fails.
token (`str` or `bool`, *optional*):
Optional string or boolean to use as Bearer token
for remote files on the Datasets Hub. If `True`, or not specified, will get token from `~/.huggingface`.
use_auth_token (`str` or `bool`, *optional*):
Optional string or boolean to use as Bearer token
for remote files on the Datasets Hub. If `True`, or not specified, will get token from `~/.huggingface`.
`use_auth_token` was deprecated in favor of `token` in version 2.14.0 and will be removed in 3.0.0.
ignore_url_params (`bool`, defaults to `False`):
Whether to strip all query parameters and fragments from
the download URL before using it for caching the file.
storage_options (`dict`, *optional*):
Key/value pairs to be passed on to the dataset file-system backend, if any.
download_desc (`str`, *optional*):
A description to be displayed alongside with the progress bar while downloading the files.
N cache_dirFforce_downloadresume_downloadlocal_files_onlyproxies
user_agentextract_compressed_file
force_extractdelete_extractedTuse_etagnum_proc max_retriestoken
deprecateduse_auth_tokenignore_url_params)default_factorystorage_options
download_descc |dk7 r%t j d| dt || _ d| j vr+| j t
j d| j d< y y )Nr z'use_auth_token' was deprecated in favor of 'token' in version 2.14.0 and will be removed in 3.0.0.
You can remove this warning by passing 'token=z
' instead.hfr endpoint)warningswarn
FutureWarningr r! r HF_ENDPOINT)selfr s ^/var/www/html/sandstorm/venv/lib/python3.12/site-packages/datasets/download/download_config.py
__post_init__z DownloadConfig.__post_init__R si \ ) MMAAO@PPZ\
(DJ t++ +37::6K]K])^D & , c | j di | j j D ci c] \ }}|t j | c}}S c c}}w )N ) __class____dict__itemscopydeepcopy)r+ kvs r, r4 zDownloadConfig.copy] sC t~~X ATATAV WADMM!$4!4 WXX Ws Ac |dk( rht | dd [d| j vr!|t j d| j d< n,t | j d dd || j d d< t | || y )Nr r! r$ r% )getattrr! r r* super __setattr__)r+ namevaluer1 s r, r; zDownloadConfig.__setattr__` s 7?wt-> E Q4///7<&J\J\-]$$T*--d3WdCK6;$$T*73
D%(r. )returnr )%__name__
__module__ __qualname____doc__r r r
strr __annotations__r boolr r r r r r r r r r intr r r r r r dictr! r r" r- r4 r;
__classcell__)r1 s @r, r r
s 2h -1Ixc4i()0 ND !OT! "d" "GXd^" $J
$$)T) M4 "d"Hd "Hhsm"K(,E8E#t)$ %,:FNGHU39%5 67F #t#&+D&AOT#s(^A#'M8C=' _Y) )r. r )r4 r' dataclassesr r r pathlibr typingr r r r
r r r0 r. r, rM s9 1 1 - - [) [) [)r.