+#h'ddlmZ ddlZddlmZddedeeeffdZded edefd Z ded ed ed ededef dZ dded edededed ed edefdZ y#e$r edwxYw))TupleN)IndexzYou need to install FAISS library to perform ANN/KNN. Please check the official doc: https://github.com/facebookresearch/faiss/blob/main/INSTALL.mdmax_gpu_devicesreturnctj}|dkD}|dkDr|rt||}||fS|dk(r|r|}||fSd}d}||fS)a! Determine which device we should use Args: max_gpu_devices: an integer value, define how many GPUs we'll use. -1 means all devices. 0 means there are no GPUs. Default is 0. Returns: number of devices and is it allowed to use CUDA device (True if yes) rF)faiss get_num_gpusmin)rn_devices_totalis_gpu num_devicess P/var/www/html/sandstorm/venv/lib/python3.12/site-packages/dsp/utils/ann_utils.pydetermine_devicesr st((*O q Fv/?;   B 6%      emb_dim dist_typec|jdk(rtj|}|S|jdk(rtj|}|St d|)Nipl2z*Wrong distance type for FAISS Flat Index: )lowerr IndexFlatIP IndexFlatL2 ValueError)rrindexs r_get_brute_indexr#seD !!'* L  d "!!'* LEi[QRRr n_objectsin_list_dist_typecentroid_dist_typeencode_residualsctd|dzz}|jdk(rtj|}n7|jdk(rtj|}nt d||jdk(rtj }n2|jdk(rtj}nt d|tj|||tjj||}|S)Ng?rrz)Wrong distance type for FAISS quantizer: z%Wrong distance type for FAISS index: ) intrr rrrMETRIC_INNER_PRODUCT METRIC_L2IndexIVFScalarQuantizerScalarQuantizerQT_fp16) rrrr r!n_list quannizercentroid_metricrs r_get_ivf_indexr-.si3&' (F D(%%g.  "d *%%g. DEVDWXYY!T)44  ! ! #t +//@AS@TUVV  ) ) %%  E Lrn_probec |dkrt||}nt|||||}||_t|\}} | rDt j } d| _t j|| tt|}|S)a6 Create IVF index (with IP or L2 dist), without adding data and training Args: emb_dim: size of each embedding n_objects: size of a trainset for index. Used to determine optimal type of index and its settings (will use bruteforce if `n_objects` is less than 20_000). n_probe: number of closest IVF-clusters to check for neighbours. Doesn't affect bruteforce-based search. max_gpu_devices: maximum amount of GPUs to use for ANN-index. 0 if run on CPU. encode_residuals: whether or not compute residuals. The residual vector is the difference between a vector and the reconstruction that can be decoded from its representation in the index. in_list_dist_type: type of distance to calculate simmilarities within one IVF. Can be `IP` (for inner product) or `L2` distance. Case insensetive. If the index type is bruteforce (`n_objects` < 20_000), this variable will define the distane type for that bruteforce index. `centroid_dist_type` will be ignored. centroid_dist_type: type of distance to calculate simmilarities between a query and cluster centroids. Can be `IP` (for inner product) or `L2` distance. Case insensetive. Returns: untrained FAISS-index i N)rr)rrrr r!T) rr-nproberr GpuMultipleClonerOptionsshardindex_cpu_to_gpus_listlistrange) rrr.rr!rr rrrcloner_optionss rcreate_faiss_indexr7Qs<6!r?ss5d3C,cce          L!!"3 333 3  3  33 3W  I s AA#