[;jk ddlmZddlmZddlmZddlmZddlmZmZddl m Z ddl m Z ddl m Z dd l m Z dd l mZd:d ZGd d eZdZdddddZdZdZdZdZdZdZdZdZdZd;dZGddZdZd Zd!Z d"Z!d#Z"d$Z#d%Z$d&Z%d'Z&d(Z'd)Z(d*Z)d+Z*d,Z+d-Z,d?.>&1*.>?@ K@s A c8eZdZdZdZfdZdZdZdZxZ S)IntroduceBufferAuxiliaryVarsFct|tsJd|_t||}|j rt |j|S)Nr) isinstancermax_ndimsuper__call__buffers_existsuse_bufstruct_declare_codescope)selfnoderesult __class__s rr!z%IntroduceBufferAuxiliaryVars.__call__sC$ +++ !$'    &tzz 2 c jj}|Dcgc]\}}|jjs| }}}t |dkDr|j dd|_|Dcgc]\}}|jjs| }}}t |dkDrd|_|D].\dk(s tjts'd|_ n~ttr$t |dkDrtjd|D]Ajjj rtjdj"j}|j$t&j(kDr'tjdt&j(z|j$|j*kDr|j$|_fd } t,j.t0j2ft,j4t0j6ff} | D cgc]\} } | | | c} } \} }t9j:| |_D|_|_ ycc}}wcc}}wcc} } w) Nrc|jSN)name)entrys rz;IntroduceBufferAuxiliaryVars.handle_scope..2s5::r))keyT memoryviewz'Buffer vars not allowed in module scopez-Buffers with pointer types not yet supported.z1Buffer ndims exceeds Options.buffer_max_dims = %dcj|}jd||j}jrd|_|S)N)r-cnametypeposT)mangle declare_varr5is_argused)r4prefixr3aux_varr.r-r&r$s rdecvarz9IntroduceBufferAuxiliaryVars.handle_scope..decvarPsI VT2++U15488,E<<#'GLr))!entriesitemsr4 is_bufferlensortr"is_memoryviewslicerutility_code_definitionrusing_memoryviewrrr5dtypeis_ptrr-ndimr buffer_max_dimsrr c_pyx_buffer_nd_typer pybuffernd_prefixc_pyx_buffer_typepybufferstruct_prefixr BufferAux buffer_auxbuffer_entriesr$)r%r&r$ scope_itemsr-r.bufvarsmemviewslicevarsbuftyper<auxvarsr4r: pybufferndrcbuffers `` `` r handle_scopez)IntroduceBufferAuxiliaryVars.handle_scope+smm))+ ,7PK[T55::;O;O5KP w.assert_bools2 KK !T"y,*=> >#r)rdre)buffer_defaultsr interpret_compiletime_optionsr@buffer_positional_options_countrERR_BUF_TOO_MANYr>buffer_optionsERR_BUF_OPTION_UNKNOWNzip ERR_BUF_DUPKeyErrorERR_BUF_MISSINGrois_extension_type ERR_BUF_DTYPErint ERR_BUF_NDIM ERR_BUF_MODE)rrenvposargsdictargsdefaults need_completer-valuer5rErGrcrtrss` @ranalyse_buffer_optionsr|s"#AAC<AGX 7|5572;q>+;<<G&nn.luc ~ %s$:T$AB B / ".':luc ~ %s$:T$AB B 7?sK$$67 7 ; w  J (  KK E ((9m44 ;;v D Zc*dQh9l33 ;;v D T@@9l33? "# N1 J &y/D2HII! Js-FF>=F>c6eZdZdZdZdZdZdZdZdZ y) BufferEntryc||_|j|_|jjj|_d|jz|_|jj |_|jy)Nz%s.rcbuffer->pybuffer.buf) r.r4rNbuflocal_nd_varr3buf_ptrbuffer_ptr_type buf_ptr_typeinit_attributes)r%r.s r__init__zBufferEntry.__init__s[ JJ %%55;; 2TZZ? !JJ66 r)c|j|_|j|_|j |_yr,)get_buf_shapevarsshapeget_buf_stridevarsstridesget_buf_suboffsetvars suboffsetsr%s rrzBufferEntry.init_attributess2++- ..0 446r)c$|jdS)Nz%s.diminfo[%d].suboffsets _for_all_ndimrs rrz!BufferEntry.get_buf_suboffsetvarss!!"=>>r)c$|jdS)Nz%s.diminfo[%d].stridesrrs rrzBufferEntry.get_buf_stridevarss!!":;;r)c$|jdS)Nz%s.diminfo[%d].shaperrs rrzBufferEntry.get_buf_shapevarss!!"899r)ct|jjDcgc]}||j|fzc}Scc}wr,)ranger4rGr3)r%sis rrzBufferEntry._for_all_ndims6-2499>>-BC-BTZZO#-BCCCs=c g}|jj}|jj}|dk(rqt||j |j D]9\}}}|j ||j ||j |;d|z} t} ny|dk(r d|z} t} n$|dk(r d|z} t} n|dk(r d|z} t} nJt||j D]'\}}|j ||j |)| |jjvrO|jjj| |jd } |jd } | | | | | |jj} | d | d |j d d j#|d}|S)Nrfz__Pyx_BufPtrFull%ddrkz__Pyx_BufPtrStrided%ddrlz__Pyx_BufPtrCContig%ddrmz__Pyx_BufPtrFortranContig%ddutility_code_protoutility_code_def)r-nd(, ))r4rGrcr{rrappendbuf_lookup_full_codebuf_lookup_strided_codebuf_lookup_c_codebuf_lookup_fortran_code globalstate utility_codesaddrempty_declaration_coderr)r%code index_cnamesparamsrrcrrofuncnamefuncgen protocodedefcodebuf_ptr_type_codeptrcodes rgenerate_buffer_lookup_codez'BufferEntry.generate_buffer_lookup_codes YY^^yy~~ 6>|#668#99;=1a a  a  a = -r1H*Gy 3b813b8+"9B>1uL$*A*A*CD1 a  a E 4++99 9    * * . .x 8(()=>I&&'9:G IwX" = --DDF&.0A4<<&*ii&79r)N) r_r`rarrrrrrrr)rrrs&7 ?<:D*r)rcd}|j}|dk(r|dz }n#|dk(r|dz }n|dk(r|dz }n |dk(r|d z }nJ|jr|d z }|S) N PyBUF_FORMATrfz| PyBUF_INDIRECTrkz| PyBUF_STRIDESrlz| PyBUF_C_CONTIGUOUSrmz| PyBUF_F_CONTIGUOUSz| PyBUF_WRITABLE)rcwritable_needed)rN buffer_typeflagsrcs r get_flagsrsy E   D v~ ##   ""  ''   ''u!!5,>#>5 Lr)c`|j}d|j_d|j_yNT)rNrr9 rcbuf_var)r.rNs rused_buffer_aux_varsrs)!!J&*J# $Jr)c v|j|jj}}|jj}ddg}|dk(r|j dg}t |jjD]#}|D]}|j d||||||fz%|jdj|y)Nrrrfrz1%s.diminfo[%d].%s = %s.rcbuffer->pybuffer.%s[%d];r) rNr4rcrr3rrrGputlnr) buf_entryrrNrcpybuffernd_structfldnameslnrfldnames r put_unpack_buffer_aux_into_scopers!++Y^^-@-@J"22887#H v~ % B 9>>&& 'G III!1g!7AM  (  JJsxx|r)c|j}|jj}|jj}|j d|z|j d|z|j d|z|j |d|dy)Nz%s.pybuffer.buf = NULL;z%s.refcount = 0;z%s.data = NULL;z .rcbuffer = &;)rNrr3rr)r.rbufauxrpybuffer_structs r put_init_varsr0s{   F..44&&,,OJJ(?:;JJ!O34 JJ #445JJ'8/JKr)cp|j}t||j||j}|j d|j d|jj j z|j |jd|z||j dt||y)N{'__Pyx_BufFmt_StackElem __pyx_stack[%d];%s == -1}) rNget_getbuffer_callr3r4rrEstruct_nesting_depth error_goto_ifr)r.rr5rN getbuffers rput_acquire_arg_bufferr>s!!J"4j%**MI JJsOJJ85::;K;K;`;`;bbcJJt!!*y"8#>?JJsO%UD1r)c|jjt|jd|jj j zy)N0__Pyx_SafeReleaseBuffer(&%s.rcbuffer->pybuffer);)ruse_utility_codeacquire_utility_coderrNrr3)rr.s rput_release_buffer_coderLs;%%&:;JJAEDTDTDdDdDjDjjkr)c |j}t|j}t||}|jj }t ||j}|jjtdtzS)Nz__Pyx_GetBufferAndValidate(&%(pybuffernd_struct)s.rcbuffer->pybuffer, (PyObject*)%(obj_cname)s, &%(dtype_typeinfo)s, %(flags)s, %(ndim)d, %(cast)d, __pyx_stack)) rGrrerrr3get_type_information_cnamerErrrlocals) r obj_cnamerNrrGrerrdtype_typeinfos rrrQsv   D { D j+ .E"2288/k6G6GHN%%&:; %'-x 01r)c f|j|j}}|jj}t ||} j dj d|j jztd||} |rj d|zjjtjd} j | d| |zdj d jd | zztfd td D} j d | zj d jd| |zzzj d| zj j#t$j dj dj d| zj dj d| z| D]} jj'| j dt)|j j+| |jj'| nj d jd| |zzzj |dtj,|tj.dd|dj j1|j3dt)|j dj dy)aJ Generate code for reassigning a buffer variables. This only deals with getting the buffer auxiliary structure and variables set up correctly, the assignment itself and refcounting is the responsibility of the caller. However, the assignment operation may throw an exception so that the reassignment never happens. Depending on the circumstances there are two possible outcomes: - Old buffer released, new acquired, rhs assigned to lhs - Old buffer released, new acquired which fails, reaqcuire old lhs buffer (which may or may not succeed). rrz%srF manage_refz = r if (%s) {%s < 0c3tK|]/}jjtjd1yw)FrN) funcstate allocate_tempr py_object_type).0_rs r z'put_assign_to_buffer..s4-#+a..66z7P7P]b6c#+s58zPyErr_Fetch(&%s, &%s, &%s);rz/Py_XDECREF(%s); Py_XDECREF(%s); Py_XDECREF(%s);z!__Pyx_RaiseBufferFallbackError();z} else {zPyErr_Restore(%s, %s, %s);rz%s = %s = %s = 0;Py_Nonez; __Pyx_INCREF(Py_None); z.rcbuffer->pybuffer.buf = NULL;N)rNr4rr3rrrErrrrr c_int_typeunlikelytuplerrrraise_buffer_fallback_code release_temprerror_goto_if_negtypecastr error_gotoput) lhs_cname rhs_cnameris_initializedr5rrNrrrr retcode_cname exc_tempsts ` rput_assign_to_bufferr _s (22INN J"2288 j+ .EJJsOJJ8;;L;L;a;a;ccd"4z;GI EHYYZ44Z5J5JW\4]   I0EFG ;$--=0H"IJK -#(8--  09<= ;zY=R/S!TTU DyPQ ))*DE 67 : /);< 3 &23A NN ' ' * 3(D9 4))-=> ##M2 ;zY=R/S!TTU '' Z5N5NPYZ%' ( 4??3'( (D9 3JJsOr)c |dxr|}|dr|jjtjd}|j d|zt t |||jD]\} \} } } | dk7r~|j d| z|rA|j | d| d |j d |jd | z|| fzn|j d || fz|jd | dk7rd} nd} |j d |j| d| | || fz|r"|jjtd}n!|jjtd}|j d|jd|zz|j |d|d|j |j||j d|jj|nG|rEt |||jD]'\} } } | dk7s |j d| d| d| d )|j!||S)ae Generates code to process indices and calculate an offset into a buffer. Returns a C string which gives a pointer which can be read from or written to at will (it is an expression so caller should store it in a temporary if it is used more than once). As the bounds checking can have any number of combinations of unsigned arguments, smart optimizations etc. we insert it directly in the function body. The lookup however is delegated to a inline function that is instantiated once per ndim (lookup with suboffsets tend to get quite complicated). entry is a BufferEntry wraparound boundscheckFrz%s = -1;rz if (%s < 0) {z += rzif (%s) %s = %d;rz%s = %d;z} else z(size_t)z >= __Pyx_RaiseBufferIndexErrorNogil__Pyx_RaiseBufferIndexErrorrz%s != -1r);rzif (z < 0) )rrr rr enumerater{rrrrrraise_indexerror_nogilraise_indexerror_coderrr)r. index_signedsr directivesr5rrdin_nogil_contextfailed_dim_tempdimsignedr3rrefuncs rput_buffer_lookup_coders1",/D4D- ..66z7L7LY^6_ :/0+4S V[VmVmVo5p+q 'C'&%{ ?U23#JJeU;<JJ1 h&67'5. ./JJz_c,BBC#{! JJ) eT5AB-&& '#,r*     - -.D E5D    - -.C D0D ;zO/K!LLM o67 4??3'( 3 ##O4 $' |UE\E\E^$_ FE5{ eUEJK%`  , ,T< @@r)c.|jtyr,)rbuffer_struct_declare_code)rs rr#r#s34r)c djt|Dcgc] }d|||fz c}}|jd|d|d|d|d djt|Dcgc] }d|||fz c}}|jd |d |d |jtd ||fzd jt|Dcgc]}td||||fzc}zdzycc}wcc}wcc}w) Generates a buffer lookup function for the right number of dimensions. The function gives back a void* at the right location. rz i%d, s%d, o%d#define (type, buf, z ) (type)(z _imp(buf, z))z.Py_ssize_t i%d, Py_ssize_t s%d, Py_ssize_t o%dzstatic CYTHON_INLINE void* z_imp(void* buf, rzf static CYTHON_INLINE void* %s_imp(void* buf, %s) { char* ptr = (char*)buf; r zX ptr += s%d * i%d; if (o%d >= 0) ptr = *((char**)ptr) + o%d; z return ptr; }N)rrrr)protodefinr-rr macroargsfuncargss rrrs#  b J 1?aAY6 JKI KKtYX\^ghiyy`efh`ij`i[\JaQRTUYV`ijkH KKtXVW KK  h #%''&+2Y+0&/,23 , 1a|,&/+0#    Kk +0sC/%C4C9c djt|Dcgc] }d||fz c}}djt|Dcgc] }d||fz c}}|jd|d|d|dy cc}wcc}w) rri%d, s%d + i%d * s%dr r!z) (type)((char*)buf + rN)rrrr"r#r-rrargsoffsets rrrst 9959=9ajAq6)9= >D ZZuRyAy!1v-yA BF KKtTSYZ[>As A7A<c<|dk(r|jd|zydjt|Dcgc] }d||fz c}}djt|dz Dcgc] }d||fz c}}|jd||||dz fzycc}wcc}w) z Similar to strided lookup, but can assume that the last dimension doesn't need a multiplication as long as. Still we keep the same signature for now. r.#define %s(type, buf, i0, s0) ((type)buf + i0)rr'r(r)9#define %s(type, buf, %s) ((type)((char*)buf + %s) + i%d)Nrrrr*s rrr s  Qw DtKLyyuRyAy!*1v-yAB5a=I=a[Aq61=IJ OSWY]_egilmgmRnnoBIs B#Bc2|dk(r|jd|zy djt|Dcgc] }d||fz c}}djtd|Dcgc] }d||fz c}}|jd|||dfzy cc}wcc}w) zB Like C lookup, but the first index is optimized instead. rr.rr'r(r)r/rNr0r*s rrrs Qw DtKLyyuRyAy!*1v-yAB5B<Hrd}nB|j@rd}n3|jrd}|jBrd}n|jDrd}nJ|d}|||| djG|Dcgc] }t7|c}xsdt'||||f }|j-||zd |Scc} wcc}w)ar Output the run-time type information (__Pyx_TypeInfo) for given dtype, and return the name of the type info struct. Structs with two floats of the same size are encoded as complex numbers. One can separate between complex numbers declared as struct or with native encoding by inspecting to see if the fields field of the type is filled in. z__Pyx_TypeInfo_%sz__Pyx_StructFields_%szrtypeinfoNULLrz'static const __Pyx_StructField %s[] = {T)safez {&z, "z ", offsetof(rz)},z {NULL, NULL, 0}z};0z__PYX_IS_UNSIGNED(%s)z'H'z%s ? 'U' : 'I'z'C'z'R'z'S'__PYX_BUF_FLAGS_PACKED_STRUCTz'O'zRstatic const __Pyx_TypeInfo %s = { "%s", %s, sizeof(%s), { %s }, %s, %s, %s, %s };)$r:is_errorrrrris_arrayrsize base_typer8can_be_complexris_simple_buffer_dtype is_structr$is_cv_qualifiedbase_type_scope var_entriesr@rr4r cv_base_typer{r-r3strr c_char_typeis_int is_complexis_floatpackedr6r)rrEmaxdepth namesuffixr-structinfo_nametypecode arraysizescomplex_possibledeclcode struct_scopefieldsftypes struct_typer<repr is_unsigned typegrouprtups rrr5s#5)J  +D- :O ~~iE$>$>$@1}u 4##111 &&**40##J/ >>..!!%**-..!33N8L8L8N//1  ' ' )$O __ ;;L$$+;; !--Fv;? "?$&$0affhlK$ & NNDV]aN b$$#00GGI #::< "651 8 (!&&+qww HNRT 2 NN.TN : NN4dN + 5%j J** *1Hrxso$" *1U?UtGf$PUV"#6,3  l 4 B ' >JDDN % & L 2l 1EP?AD5 *\ p k 4]~^ // 001FPWX12GH,,>?,-DE01FG*+A7S./BGT//ABr)