[;j/~dZddlZejeeeeddlmZddlmZmZm Z eZ GddZ y) z3 Python Lexical Analyser Scanning an input stream N)BOLEOLEOF NOT_FOUND)Errors)rrrceZdZdZddZdZdZdZdZe jdZ d e fd Z d Zd Zdd ZdZedZy)Scannera A Scanner is used to read tokens from a stream of characters using the token set specified by a Plex.Lexicon. Constructor: Scanner(lexicon, stream, name = '') See the docstring of the __init__ method for details. Methods: See the docstrings of the individual methods for more information. read() --> (value, text) Reads the next lexical token from the stream. position() --> (name, line, col) Returns the position of the last token read using the read() method. begin(state_name) Causes scanner to change state. produce(value [, text]) Causes return of a token value to the caller of the Scanner. Ncd|_d|_d|_d|_d|_d|_d|_d|_d|_d|_ d|_ ||_ ||_ ||_ g|_d|_|j!dd|_d|_d|_t$|_d|_||d|d c|_|_yy)a Scanner(lexicon, stream, name = '') |lexicon| is a Plex.Lexicon instance specifying the lexical tokens to be recognised. |stream| can be a file object or anything which implements a compatible read() method. |name| is optional, and may be the name of the file being scanned or any other identifying string. rr)r rrN)tracebuffer buf_start_posnext_poscur_poscur_line start_poscurrent_scanner_position_tuplelast_token_position_tupletext state_namelexiconstreamnamequeue initial_statebegincur_line_startrcur_char input_state)selfrrr initial_poss ]G:\00. PROJECTS\API\Inventory\templateJSON\kerjaOCR\Lib\site-packages\Cython/Plex/Scanners.py__init__zScanner.__init__Js     .8+)3&     ! 2     "1::;;;!3!33 t1113D&> !||t~~-==(DMMS,@%**4A Ar&c |j}|j}|j}|j}|j}|j }|j }|j}|j} t|} d\} } } }}}}|j} |rtd|d||t|fz|d}||||||||f\} } } }}}}|}|j|t}|tur|xr|jd}|r|rtd|dz|}|dk(r|}|| z }|| kr ||}|dz }nn|j| z }|j j#d }|j|d|z}||_| |z } | |_t|} ||z}|r ||}|dz }nd }|d k(r t$}d }nd|s t$}d }nY|}nV|d k(rd }d}nL|dk(r|dz }|x}}t&}d}n5|d k(r t(}d}n'd }n$|r td| | | | ||||f\}}}}}}}nd}n||_||_||_||_||_||_|r|td|z|S)z; Inlined version of run_machine for speed. )Nrrrr rrrzState %d, %d/%d:%s -->numberr,NelsezState %dir  r blockedzDoing %s)rrrrr r!rrrlenrr<reprgetrrrr/rrr)r"staterrrr r!rrrbuf_lenb_action b_cur_pos b_cur_lineb_cur_line_start b_cur_char b_input_state b_next_posrr,c new_state buf_indexdiscarddatas r$r;zScanner.run_machine_inlineds ((%)\\&*mm,0,?,?==#'#3#3 &*mmkk+/+=+= %([ $ a)Z)9:}V`"ZZ.(O['4>2KKL8_F!GX~xV^^i)Z1A:}^hA !Y/II%3%))F"3 *y'::;!!#&G (= 8I 7*"9- A "&..="@#{{//7!%WX!6!=&, %0 -:*"%f+!W,  &y 1A$MH "ADy#&&' #&&' #$ A%#H"#K A%MH/77NW"H"#K A%"H"#K!H)$'"9j:J#]J@6VWh{H"F[`   ,  &  !j6)* r&returnc|jS)am Return a tuple (name, line, col) representing the location of the last token read using the read() method. |name| is the name that was provided to the Scanner constructor; |line| is the line number in the stream (1-based); |col| is the position within the line of the first character of the token (0-based). rr7s r$r3zScanner.positions---r&c"|jS)zX Python accessible wrapper around position(), only for error reporting. )r3r7s r$ get_positionzScanner.get_position$s}}r&cR|jj||_||_y)z8Set the current state of the scanner to the named state.N)rget_initial_staterr)r"rs r$rz Scanner.begin*s% LL * *: 6 $r&cr| |j}|jj||f|jfy)a Called from an action procedure, causes |value| to be returned as the token value from read(). If |text| is supplied, it is returned in place of the scanned text. produce() can be called more than once during a single call to an action procedure, in which case the tokens are queued up and returned one at a time by subsequent calls to read(), until the queue is empty, whereupon scanning resumes. N)rrappendr)r"r-rs r$r)zScanner.produce0s3 <99D E4=$*M*MNOr&cy)z_ Override this method if you want something to be done at end of file. Nr7s r$r*z Scanner.eof?s r&c |jdS)NrrYr7s r$ start_linezScanner.start_lineFs--a00r&r:r6)__name__ __module__ __qualname____doc__r%r/r4r8r(cythonfinalr;tupler3r[rr)r*propertyrcrar&r$r r stp&QP*93B2 \\oob .% . % P 11r&r ) rgrhdeclareobjectr rRegexpsrrrrr rar&r$ros? 6v6VD"" H w1w1r&