:Qg bddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z dde de dedejfdZdde de ded ede f d Zdde de ded ede f d Zde dee fd Zde dee fd Zde dee fdZde dee fdZde deejfdZde fdZdefdZde dee fdZy)N)ListOptional)EMAIL_ADDRESS_PATTERNEMAIL_DATETIMETZ_PATTERNIMAGE_URL_PATTERNIP_ADDRESS_NAME_PATTERNIP_ADDRESS_PATTERN_REMAPI_ID_PATTERNUS_PHONE_NUMBERS_REtextpatternindexreturnct|tr|dkrtd|dd}tt j ||D] \}}||k(s |}|td|dd|S)Nrz The index is z'. Index must be a non-negative integer.zResult with index z& was not found. The largest index was .) isinstanceint ValueError enumeraterefinditer)r r r regex_matchiresults Z/var/www/html/answerous/venv/lib/python3.12/site-packages/unstructured/cleaners/extract.py_get_indexed_matchrs eS !UQY=/VWXXKr{{7D9:! 6 : K!-eW4Z[\Z]]^_`` stripctt|||}|j\}}|d|}|r|jS|S)aExtracts texts that occurs before the specified pattern. By default, it will use the first occurrence of the pattern (index 0). Use the index kwarg to choose a different index. Input ----- strip: If True, removes trailing whitespace from the extracted string N)rspanrstrip)r r rrrstart_ before_texts rextract_text_beforer%sE%T7E:K!HE1v,K#(;   9k9rctt|||}|j\}}||d}|r|jS|S)aExtracts texts that occurs before the specified pattern. By default, it will use the first occurrence of the pattern (index 0). Use the index kwarg to choose a different index. Input ----- strip: If True, removes leading whitespace from the extracted string N)rr lstrip)r r rrrr#endr$s rextract_text_afterr).sE%T7E:K    FAsst*K#(;   9k9rcRtjt|jSN)rfindallrlowerr s rextract_email_addressr/=s ::+TZZ\ ::rc6tjt|Sr+)rr,r r.s rextract_ip_addressr1As ::+T 22rc6tjt|Sr+)rr,rr.s rextract_ip_address_namer3Es ::-t 44rctjt|}|Dcgc]}|jdd}}|Scc}w)N;)rr,r replace)r mapi_idsmids rextract_mapi_idr:Is:zz/40H089 C$9H9 O:s<ctjt|}t|dkDr#tjj |ddSy)Nrz%a, %d %b %Y %H:%M:%S %z)rr,rlendatetimestrptime)r date_extractionss rextract_datetimetzr@OsEzz":DA q   ))*:1*=?YZZrctj|}|y|j\}}|||}|jS)aExtracts a US phone number from a section of text that includes a phone number. If there is no phone number present, the result will be an empty string. Example ------- extract_phone_number("Phone Number: 215-867-5309") -> "215-867-5309" r6)r searchr r)r rr"r( phone_numbers rextract_us_phone_numberrDWsI&,,T2K!!#JE3c?L    rchd\}}}}|j}td|dvd|dvgr|||fStjd|d}|ds|d=t|ddkDr|||fS|^}}|r, |^}}}d j |}|rd j |nd }|||fS#t$r|}Y8wxYw) aExtracts the start of bulleted text sections bullets accounting numeric and alphanumeric types. Output ----- tuple(section, sub_section, sub_sub_section): Each bullet partition is a string or None if not present. Example ------- This is a very important point -> (None, None, None) 1.1 This is a very important point -> ("1", "1", None) a.1 This is a very important point -> ("a", "1", None) )NNNNrrz..z[\.])r stringr6N)splitanyrr<rjoin)r abctemptext_spbulletr#s rextract_ordered_bulletsrRhs+MAq!TjjlG Cwqz !471:#5 67!Qw XXggaj 9F ": 2J 6!9~!QwHA  HAq1 GGAJBGGAJ a7N  A s3B## B10B1c6tjt|Sr+)rr,rr.s rextract_image_urls_from_htmlrTs ::' ..r)r)rT)r=rtypingrrunstructured.nlp.patternsrrrrr r r strrMatchrboolr%r)r/r1r3r:r@rDtuplerRrTrrr\s> ! S 3 s 288  :c :C : : :X[ : :S :3 :s :t :WZ :;;S ;3S3T#Y35#5$s)5#$s) SXh.?.?%@ # "#U#L/s/tCy/r