+#h ddlmZddlZddlZdededeefdZdeededeefdZ d deeded e deefd Z y) )IterableNquerykreturnc tjjs tdtjj|fd|i|}t |t s|g}|Dcgc]}|j }}tjjrMtjj||}tj|ddd}|Dcgc]}|| }}|Scc}wcc}w)zLRetrieves passages from the RM for the query and returns the top k passages.No RM is loaded.rN) dspsettingsrmAssertionError isinstancer long_textrerankernpargsort)rrkwargspassagespsgpassages_cs_scorespassages_cs_scores_sortedidxs R/var/www/html/sandstorm/venv/lib/python3.12/site-packages/dsp/primitives/search.pyretrievers <F^^=MNkdEE"D)NHN &x >r B CWQD CC(;hO CsE' E'E, !E1 E7by_probc tjjs tdtjjr t ||S|Dcgc]}|s| }}t |dk(rt|d|fi|Si}|D]}tjj|fd|dzi|D]q}|r7|j|jd|jz||j<<|j|jd|jz||j<s|jDcgc] \}}||f }}}t|dd |}|D cgc]\} }| }} }|Scc}wcc}}wcc}} w) zRetrieves passages from the RM for each query in queries and returns the top k passages based on the probability or score. rrrrgTrN)r r r r rr)lenrr rprobr'r!r#) rrr*rr$rrr&r'r(s rretrieveEnsembler/-s^ <r8s~$ CCd3i&DDID#D49D$d3iC$SWX[S\r7