bIg9ddlmZddlZddlmZmZmZmZm Z m Z m Z ddl m Z mZmZmZmZmZmZmZmZddlmZ d dZ d dZ d dZ d dd Zy)) annotationsN)AttributeProto FunctionProto GraphProto ModelProto NodeProtoSparseTensorProto TensorProto) make_attribute make_function make_graph make_model make_node make_tensormake_tensor_value_infoset_model_propstensor_dtype_to_np_dtype) from_arrayc |jdk7rtd|jd|jD]3}|jdk(rt d|jd|jdk(r|j }|jd}|j }tj|}||kr|gcSttjt|tj | }t|j} tdg|g| } td |g|j ttj|g|  } | | gcSt d |j|gS)zReplaces a Constant node with a large tensor (with more than threshold elements) by a sequence of nodes that produces a dummy constant of same shape as original tensor.Constantz!Node type must be 'Constant' not . sparse_valuezEThis feature is not yet implemented for a sparse constant (node name=).value__SHAPEdtypenamerConstantOfShapez'Replacement of constant with attribute )op_type TypeError attributerNotImplementedErrortdimsnpprodrarraylistint64r data_typeroutput) node thresholdvalue_constant_of_shapeattrnew_namer'sizeinitr node_shapenew_nodes Y/var/www/html/answerous/venv/lib/python3.12/site-packages/onnx/tools/replace_constants.py_replace_constantr9s_ ||z!;DLL;K1MNN~~  88~ %%"ii]".  88w EEE**W-H::D774=Dy v bhhtDzBRD,U__=E"  J !!   +B*C5!QR H ) )!5chh\ B  9 > 6Mc t|trt|j}n>t|trt|j}nt dt |dt|D]2}t|jzt|jz4fd}tdg|dgd}tdg|dgd }i}t|D]|\}}|jd k7r|jd}td |g||d g} td |jd| jd|jdg||dg} t|jd k(r$|jdjj } nt"j$} td| jdg||dg| } td| jdg||dg| } td| jd| jdg||dg}td|jd|g|j}| | | | ||g||<t'|j)dD] \}}||||d z|j+d||j+d |t|trEt-||j.|j|j|j0|j2}|St|trEt5|j6|j.|j|j||j8}|St dt |d)zReplaces all *ConstantOfShape* by node *Range* to avoid constant tensors. The function is not recursive. The recursivity is done by *replace_initializer_by_constant_of_shape*. Not implemented for type rc|vrj||Sd} |d|}|vrj||S|dz }$)N_)add RuntimeError)prefixirexisting_namess r8 _find_namez9_replace_constant_of_shape_with_range.._find_name[s^  '   v &M XQqc?D>)""4( FA r:rzeror) value_intoner@r! ReduceProd_NRange_RANGECast_RANGEf)to_NfDiv_FLATReshapeT)reverse initializersparse_initializer opset_imports) isinstancerr+r/rr#typesetinputr.r enumerater"lenr$r&r-r FLOATsorteditemsinsertr rrWrXr domain opset_import)onxnodesr/rFcst0cst1updateinodeshapenarPaccldreshupgraphnew_onxrEs @r8%_replace_constant_of_shape_with_rangerwGs:#z"SXX C 'SXX3DI;a@AAUN+#djj/)#dkk**+ N Zj&8%9Q GD Zj&7%8A FD F '0 t <<, ,  1  lUGjE7".F-G H   [[^QXXa[$++a. 9 5'( ) *  t~~ ! #"$$..B""B v }zUG7:K/L.MRT U v }zUG3-/H.Ib Q  BIIaL"))A,/*we_2M1N QXXa[%$8$++FAr2q$/u +0.FLLND9& r#%eeai & LLD LLD#z"  HH II JJ"55   #}% JJ HH II JJ **   /S {!< ==r:ct|trt|j}n>t|trt|j}nt dt |dt}|D]2}|t|jz}|t|jz}4i}t|D]\}}|jdk7r|jdj}t|j|j dg|g}t#d|j|j} t%|jdj|} | jj'| | ||<|j)D] \}} | ||< t|trEt+||j|j|j|j,|j.} | St|trEt1|j2|j|j|j||j4} | St dt |d) z7Replaces all fill value of all nodes *ConstantOfShape*.r<rr!rr@r rVrY)r[rr+r/rr#r\r]r^r.r_r"r$r&rrr-rr appendrcr rWrXr rerf)rgr1rhrEr/rkrltensor new_tensorr7r2rtrurvs r8 _replace_constant_of_shape_valuer|s#z"SXX C 'SXX3DI;a@AAUN+#djj/)#dkk**+F ' ! t <<, , "$$ KK))A31H0I . DKKHT^^A.33:F!!#& u  !\\^ re #z"  HH II JJ"55   #}% JJ HH II JJ **   /S {!< ==r:c Dt|trd}g}|jD]Q}|jdk(r/t |||}t |dk(rd}|j |A|j|S|rct|j|j|j|j||j} |r t| S|dk7r t| |S| S|r t|S|dk7r t||S|St|t rt#|j$|xs |j&|||} |j(D cgc] } t#| ||xs |j&||"} } t+| | |j,|j.|xs |j&|j0|j|j2 } t |j4d kDr:|j4Dcic]}|j6|j8}}t;| || jd d =|jD]}| jj=}|jd k(r*|j>d kr|rtAd|j>d|jd k(r(|j>dkrtAd|j>d|j|_ |j>|_| St|tBstEdtG|dd }g}tI}g}g}|jJD]Z}tM|jN}tQjR|}||kr|j|E|dz }|jd}|jtUtQjVtY|tPjZ|t]|j^}tad|g|jgtUtQjVdg|}|j||j=|j| |dks'|jtc|tdjft |g]g}|jhD]|}tM|jN}tQjR|}||kr|j|Dtkd|jljd|jnjd|jD]c}|jdk(r2t |||}t |dk(r|dz }|j |Ed}g}|jpD]}|jFtrjtk(rktw|dr_|jxSt#|jx||||} t{| t{|jxk7rd}t}|j| }|j||r^ta|j|j|j}!|!jpj ||j|!|dz }S|j|f|d kDrot||j|jD"cgc]}"|"j|vs|"c}"|z|j||}#|r t|#S|dk7r t|#|S|#S|r t|S|dk7r t||S|Scc} wcc}wcc}"w)aReplace initializers or constant node by nodes *ConstantOfShape* to reduce the size. This reduce the cost to write a unit test about a specific graph structure. Args: onx: ModelProto threshold: every initializer under this threshold is not impacted ir_version: initializer must be specified as input for `ir_version <= 3`, this must be specified if onx is :class:`FunctionProto` or :class:`GraphProto` use_range: if uses operator *Range* instead of *ConstantOfShape* to avoid constant tensors value_constant_of_shape: value to use as a value for all nodes *ConstantOfShape*, a high value may produce nan or inf predictions Returns: onx, modified ModelProto The function is designed so that the function can be reapplied on a modified model and either replace *ConstantOfShape* with *Range* operators, either replace the fill value for every *ConstantOfShape*. Frr>TrYr@) ir_versionr0 use_ranger1)r0r~rr1) functions producer_nameproducer_versionr~ doc_stringre model_versionrN z.Range was introduced in opset 11 but opset is r z7ConstantOfShape was introduced in opset 9 but opset is z-onx should be a GraphProto at this stage not rrrr!?r zKThis feature is not yet implemented for a sparse initializer (indices.name=z, values.name=rgrV)@r[rr/r"r9r`extendryr rerr^r.rfrwr|r(replace_initializer_by_constant_of_shaperur~rrrrrrmetadata_propskeyrrrAversionrBrr#r\r]rWtupler'r(r)rr*r+r,rr-rrr INT64rXr%indicesvaluesr$rGRAPHhasattrridr r )$rgr0r~rr1modified new_nodesr/ cst_nodesrv new_graphf new_functionsmodelproimpop_setn_modificationsremovedadditional_inputs new_initsr5r'r4r3rnew_sparse_initssp_init shape_nodesattsr2rr7rDrus$ r8rrs>#}%%' HH #D||z)-dI?VW y>Q&#H  +   T " # #   !.. G<!KKFM!\\FN * c: &GS {RSTUUOIeG#%ITYYwwt} 9    T " 1ii[( rxxT "((;( K )8  J YYKRXXse59:    DII  !jAo  $ $&x1B1BSYKP +213))  W\\"wwt} 9   # #G , !$__1145">>..1 5    # <<: %+D)=TUK;1$1$   [ ) >> CN000C%EE%<EE')',C a5BsuuI%#H(15C KK ! "  tzz4;;GH    % %d +   X & q O   T "A #D  HH ;1QVV7%:Q ;>O O JJ!/   8? ? "a '3E;RS S 4S99!#/5LMM JW  *BP rs#   )% % #%>C%%PU> #U>U>p4> #4>>C4>4>r!%( S 0SSS S # Sr: