bIgR-ddlmZddlZddlZddlZddlZddlZddlmZm Z m Z m Z m Z GddZ d d dZ d dZ d dZy) ) annotationsN) FunctionProto ModelProto NodeProto TensorProtoValueInfoProtoceZdZd dZedZdZddZddZ ddZ ddZ dZ dd Z dd Z dd Zy ) Extractorc*tjj||_|jj|_|j |jj |_|j |jj|_ yN) onnxshape_inference infer_shapesmodelgraph_build_name2obj_dict initializerwmap value_infovimap)selfrs G/var/www/html/answerous/venv/lib/python3.12/site-packages/onnx/utils.py__init__zExtractor.__init__sc))66u= ZZ%% --djj.D.DE ..tzz/D/DE cB|Dcic]}|j|c}Scc}wr )name)objsobjs rrzExtractor._build_name2obj_dicts)-.## ...scj|}t|}t|}||z}||z }|Dcgc]}|| } }| jfd|Dj| } |Dcgc]}| | c}Scc}wcc}w)Nc3<K|]}j|ywr )r).0rrs r z1Extractor._collect_new_io_core..#sO4djj.Os)rsetextend) r original_ioio_names_to_extractoriginal_io_maporiginal_io_namess_io_names_to_extractio_names_to_keepnew_io_names_to_addrnew_io_tensorsnew_io_tensors_maps ` r_collect_new_io_corezExtractor._collect_new_io_cores33K@0 #$7 803DD36GG%,BUBU.UE  * +J MM* %   z * + * Jj)// 00+UI{   s BBc t|}t|jj}t}tt t |}|D]}|j |||||t|Dcgc]}|| }}|Scc}wr )r#listrnoderangelenr:sorted) r input_names output_names _input_namesr=r>r?rrBs r_collect_reachable_nodesz"Extractor._collect_reachable_nodesUs ;' TZZ__%!e #E#e*$5 6   D  , ,lE9k   6.find_referred_funcs..ss866T\\1ahh$++6Ms>A)nextr functionsappendr$rE)r=referred_local_functions new_nodesmatch_functionrErs @rfind_referred_funcszHExtractor._collect_referred_local_functions..find_referred_funcsnstI :!%!%!5!5  ""nset[int]r?r|rvrw)rIrxrJrxrvr{)r=r{rvz.tuple[list[TensorProto], list[ValueInfoProto]])r=r{roryrpryrzlist[TensorProto]rryrqzlist[FunctionProto]rvr)rIrxrJrxrvr)__name__ __module__ __qualname__r staticmethodrr.r3r6r:rLr[rersrurZrrr r sF // JBC$$$$ $  $  $ $L   "(B'' 8'055%5& 5 ' 5 ) 5-5 5,   rr ctjj|std||s td|s tdtj j |t j|}t|}|j||}t j|||r tj j |yy)a5Extracts sub-model from an ONNX model. The sub-model is defined by the names of the input and output tensors *exactly*. Note: For control-flow operators, e.g. If and Loop, the _boundary of sub-model_, which is defined by the input and output tensors, should not _cut through_ the subgraph that is connected to the _main graph_ as attributes of these operators. Arguments: input_path (str | os.PathLike): The path to original ONNX model. output_path (str | os.PathLike): The path to save the extracted ONNX model. input_names (list of string): The names of the input tensors that to be extracted. output_names (list of string): The names of the output tensors that to be extracted. check_model (bool): Whether to run model checker on the extracted model. zInvalid input model path: z%Output model path shall not be empty!z'Output tensor names shall not be empty!N) ospathexistsr_r checker check_modelloadr rusave) input_path output_pathrIrJrre extracteds rrurus, 77>>* %5j\BCC @AA BCCLLZ( IIj !E%A \:IIIi%   -rcg}|D]}tjj||j}tjj |}tjj |}|j |st d|d|js|jrt d|d|j||S)zCheck that the content of ``tar`` will be extracted safely Args: tar: The tarball file base: The directory where the tarball will be extracted Returns: list of tarball members zThe tarball member z^ in downloading model contains directory traversal sequence which may contain harmful payload.zP in downloading model contains symbolic links which may contain harmful payload.) rrjoinrabspath startswith RuntimeErrorissymislnkrU)tarbaseresultmember member_pathabs_base abs_members r_tar_members_filterrsFggll45 77??4(WW__[1 $$X.%k]3RS \\^v||~%k]3DE   f Mrctj|5}ttdr|j|dn|j|t ||dddy#1swYyxYw)aQSafely extracts a tar file to a specified directory. This function ensures that the extraction process mitigates against directory traversal vulnerabilities by validating or sanitizing paths within the tar file. It also provides compatibility for different versions of the tarfile module by checking for the availability of certain attributes or methods before invoking them. Args: model_tar_path: The path to the tar file to be extracted. local_model_with_data_dir_path: The directory path where the tar file contents will be extracted to. data_filterdata)rfilter)rmembersN)tarfileopenhasattr extractallr)model_tar_pathlocal_model_with_data_dir_pathmodel_with_data_zippeds r_extract_model_safer sp n % )? 7M * " - -3F .  # - -3+*,J .    s AA!!A*)T) rstr | os.PathLikerrrIrxrJrxrboolrvrw)rztarfile.TarFilerrrvzlist[tarfile.TarInfo])rrrrrvrw) __future__rrr onnx.checkerr onnx.helperonnx.shape_inferencerrrrrr rurrrZrrrs# RRttx %.!%."%.%. %.  %.  %.P  1>%GX r