:QgE4UdZddlmZddlZddlZddlZddlmZm Z m Z m Z m Z ddl mZddlmZddlmZddlmZdd lmZmZed ZGd d e Zdd ZddZddZej:dGddZeeeedZde d<y)zHandles dispatch of elements to a chunking-strategy by name. Also provides the `@add_chunking_strategy` decorator which is the chief current user of "by-name" chunking dispatch. ) annotationsN)AnyCallableIterableOptionalProtocol) ParamSpec)chunk_elements)chunk_by_title)Element)get_call_args_applying_defaults lazyproperty_Pc$eZdZdZ ddZy)Chunkerz*Abstract interface for chunking functions.cy)aA chunking function must have this signature. In particular it must minimally have an `elements` parameter and all chunkers will have a `max_characters` parameter (doesn't need to follow `elements` directly). All others can vary by chunker. N)selfelementsmax_characterss [/var/www/html/answerous/venv/lib/python3.12/site-packages/unstructured/chunking/dispatch.py__call__zChunker.__call__s N)rIterable[Element]rz Optional[int]return list[Element])__name__ __module__ __qualname____doc__rrrrrrs"4  )  >K    rrcjr;djjvr#djvrxjdz c_tjdfd }|S)zDecorator for chunking text. Chunks the element sequence produced by the partitioner it decorates when a `chunking_strategy` argument is present in the partitioner call and it names an available chunking strategy. chunking_strategya chunking_strategy Strategy used for chunking text into larger or smaller elements. Defaults to `None` with optional arg of 'basic' or 'by_title'. Additional Parameters: multipage_sections If True, sections can span multiple pages. Defaults to True. combine_text_under_n_chars Combines elements (for example a series of titles) until a section reaches a length of n characters. Only applies to 'by_title' strategy. new_after_n_chars Cuts off chunks once they reach a length of n characters; a soft max. max_characters Chunks elements text and text_as_html (if present) into chunks of length n characters, a hard max.cx|i|}tg|i|}|jdd}||St||fi|S)z1The decorated function is replaced with this one.r"N)r popchunk)argskwargsr call_argsr"funcs rwrapperz&add_chunking_strategy..wrapperEs^ ((4DJ4J6J %MM*=tD  $OX0>I>>r)r&z_P.argsr'z _P.kwargsrr)r __code__ co_varnames functoolswraps)r)r*s` radd_chunking_strategyr/'sd ||t}}888=PX\XdXd=d  < "__T??" Nrc tj|}|tdt||j Dcic]\}}||j vs||}}}|j |fi|Scc}}w)zQDispatch chunking of `elements` to the chunking function for `chunking_strategy`.zunrecognized chunking strategy )_chunker_registryget ValueErrorrepritems kw_arg_nameschunker)rr"r' chunker_speckvchunking_kwargss rr%r%Zs$(():;L:4@Q;R:STUU)/ Y1!|?X?X:Xq!tYOY <   z,_ChunkerSpec.kw_arg_names..{sHScZ6GSHs )inspect signaturer7tuple parameters)rsigs rr6z_ChunkerSpec.kw_arg_namests-  -HCNNHHHrN)rztuple[str, ...])rrrr __annotations__rr6rrrr=r=ms") NIIrr=)basicby_titlezdict[str, _ChunkerSpec]r1)r)Callable[_P, list[Element]]rrO)rrr"strr'rrr)r>rPr7rrNone)!r __future__r dataclassesdcr-rGtypingrrrrrtyping_extensionsr unstructured.chunking.basicr unstructured.chunking.titler unstructured.documents.elementsr unstructured.utilsr rrrr/r%r? dataclassr=r1rLrrrr\s #>>'663Lt_  h  0f =4 T I I I". )^,.*r