Ig(ddlZddlZddlZddlZddlmZddlmZmZm Z m Z ddl Z ddl m Z ddlmZddlmZddlmZGdd Zy) N)Path)AnyDictListOptional)snapshot_download)RepositoryNotFoundError)logger)tqdmc .eZdZedeeeeffdZededeeeffdZ eddedede defdZ e dd ed e ed e eed e def dZ eded efdZe ddeded ed e def dZe ddeeefd ededefdZy )ModelManagementreturnct)zLists the supported models. Returns: List[Dict[str, Any]]: A list of dictionaries containing the model information. )NotImplementedError)clss ^/var/www/html/answerous/venv/lib/python3.12/site-packages/fastembed/common/model_management.pylist_supported_modelsz%ModelManagement.list_supported_modelss "## model_namec|jD]*}|j|djk(s(|cStd|d|jd)a Gets the model description from the model_name. Args: model_name (str): The name of the model. raises: ValueError: If the model_name is not supported. Returns: Dict[str, Any]: The model description. modelzModel z is not supported in .)rlower ValueError__name__)rrrs r_get_model_descriptionz&ModelManagement._get_model_descriptionsa..0 E!U7^%9%9%;;  6*-B3<<.PQRSSrurl output_path show_progresscTtjj|r|Stj|d}|j dk(r t dt|jj dd}|dk(rtd|dt|xr|}t|d d| 5}t|d 5}|jd D]0}|s|jt||j!|2 dddddd|S#1swYxYw#1swY|SxYw)ap Downloads a file from Google Cloud Storage. Args: url (str): The URL to download the file from. output_path (str): The path to save the downloaded file to. show_progress (bool, optional): Whether to show a progress bar. Defaults to True. Returns: str: The path to the downloaded file. T)streamizhAuthentication Error: You do not have permission to access this resource. Please check your credentials.zcontent-lengthrzGWarning: Content-length header is missing or zero in the response from riB)totalunit unit_scaledisablewbi) chunk_sizeN)ospathexistsrequestsget status_codePermissionErrorintheadersprintboolr open iter_contentupdatelenwrite) rrrrresponsetotal_size_in_bytes progress_barfilechunks rdownload_file_from_gcsz&ModelManagement.download_file_from_gcs-s7 77>>+ & <<D1   3 &!1  "("2"2"6"67G"KL ! # [\_[``ab c0B]C %%%  * k4( *D%22d2C*E$++CJ7 5)* * *  * * *s*+ D8D-D?DD DD'Nhf_source_repo cache_dirextra_patternslocal_files_onlyc Pgd}||j|td||||d|S)aD Downloads a model from HuggingFace Hub. Args: hf_source_repo (str): Name of the model on HuggingFace Hub, e.g. "qdrant/all-MiniLM-L6-v2-onnx". cache_dir (Optional[str]): The path to the cache directory. extra_patterns (Optional[List[str]]): extra patterns to allow in the snapshot download, typically includes the required model files. local_files_only (bool, optional): Whether to only use local files. Defaults to False. Returns: Path: The path to the model directory. )z config.jsonztokenizer.jsonztokenizer_config.jsonzspecial_tokens_map.jsonzpreprocessor_config.json)repo_idallow_patternsr@rB)extendr)rr?r@rArBkwargsrEs rdownload_files_from_huggingfacez/ModelManagement.download_files_from_huggingface\sG(   %  ! !. 1  ")-     r targz_pathctjj|st|d|j dst|d t j |d5}|j|ddd|S#1swY|SxYw#t j$r/}d|vrtj|td|d |d}~wwxYw) a Decompresses a .tar.gz file to a cache directory. Args: targz_path (str): Path to the .tar.gz file. cache_dir (str): Path to the cache directory. Returns: cache_dir (str): Path to the cache directory. z! does not exist or is not a file..tar.gzz is not a .tar.gz file.zr:gz)r*Ntmpz&An error occurred while decompressing z: ) r)r*isfilerendswithtarfiler4 extractallTarErrorshutilrmtree)rrJr@tares rdecompress_to_cachez#ModelManagement.decompress_to_cachesww~~j) |+LMN N""9- |+BCD D Yj&1 S"   Y ! i(Ej\QSTUSVWX X  Ys6B$B7BB B BC!*C  C source_urlc d|jdd}t|dz }||z }t||z }|jr(tt |j ddkDr|S|jrt j||jddt||d z } | jr| j|s|j|t|  |jt| t| |js Jd |d || j|j||Stjd|dt!d|d)Nzfast-/rM*rT)parentsexist_okrL)r)rJr@zCould not find z in z(Could not find the model tar.gz file at z and local_files_only=True.)splitrr+r7listglobrSrTmkdirunlinkr>strrWrenamer errorr) rrrXr@rBfast_model_name cache_tmp_dir model_tmp_dir model_dir model_tar_gzs rretrieve_model_gcsz"ModelManagement.retrieve_model_gcss"*"2"23"7";!<=Y%/ %7 Oo5     #d9>>#+>&?"@1"D     ! MM- (D48IO+ FE>E99E>#F'&F')T)NNF)F)rt)r __module__ __qualname__ classmethodrrrdrrrr3r>rrIrWrrlr0r{rFrrr r s$d4S>&:$$TTS#XTT&,,3,t,_b,,\$(.2!& # # C=# !c+ #  #  # # J"S"S""HX]***-*:=*QU* **XDELTcNLT/3LT>ALT LTLTrr )r)rwrSrPpathlibrtypingrrrrr,huggingface_hubrhuggingface_hub.utilsr logurur r r rFrrrs7 ,,-9RTRTr