[;jUpdZddlZddlZddlZddlZddlZddlZddlZddl Z ejZ ddl Z ddl mZmZddlmZddlmZddlmZddlmZmZmZ ddlmZdd lmZd d lm Z!d d l"m#Z#d dl$m%Z%m&Z&d dl'm(Z(d dl)m*Z*m+Z+ddggdddgdgddZ,e,de,d<eGddeZ-ej]ee-j^jjaddee-jJjee-jbjZy#e$r ddlmZYwxYw)uA ===================== Cython related magics ===================== Magic command interface for interactive work with Cython .. note:: The ``Cython`` package needs to be installed separately. It can be obtained using ``easy_install`` or ``pip``. Usage ===== To enable the magics below, execute ``%load_ext cython``. ``%%cython`` {CYTHON_DOC} ``%%cython_inline`` {CYTHON_INLINE_DOC} ``%%cython_pyximport`` {CYTHON_PYXIMPORT_DOC} Author: * Brian Granger Code moved from IPython and adapted by: * Martín Gaitán Parts of this code were taken from Cython.inline. N) Distribution Extension) build_ext)display)magic_arguments)Magics magics_class cell_magic)get_ipython_cache_dir)dedent) __version__) CompileError) cython_inline load_dynamic) cythonize) captured_fdprint_capturedz-fprofile-generate-fprofile-dir={TEMPDIR})z -fprofile-usez-fprofile-correctionr)genusez -prof-genz -prof-use)gcciccrmingw32ceZdZfdZdZedZedZejejddddd d ejd dd d d ejdddddejddddddejddddddejddddd ejd!d"d#gd$ejd%d#gd&ejd'd(d#gd)ejd*d+d,-ejd.d/d0d#gd12ejd3d4d#gd5ejd6d7d#gd8ejd9d:ddd;<ejd=d>d?d@dA<edBZ dCZ dKdDZ dLdEZ dFZedGZdHZddddefdIZedKdJZxZS)M CythonMagicscNt||i|_i|_d|_y)NF)super__init___reloads _code_cache_pyximport_installed)selfshell __class__s bG:\00. PROJECTS\API\Inventory\templateJSON\kerjaOCR\Lib\site-packages\Cython/Build/IpythonMagic.pyr zCythonMagics.__init__`s'  $)!c|j}d|vr|d}n!|Dcgc]}|jdr|}}|D]#} |jj|||i%ycc}w#t$rd|z}t |wxYw)N__all___z%'module' object has no attribute '%s')__dict__ startswithr%pushKeyErrorAttributeError)r$modulemdictkeyskmsgs r' _import_allzCythonMagics._import_allfs  #D$>u!ALL,=AuD>A * E!H .?  *=A$S)) *sA!A! A&&Bcv|jj}|jj}t|||S)aCompile and run a Cython code cell using Cython.inline. This magic simply passes the body of the cell to Cython.inline and returns the result. If the variables `a` and `b` are defined in the user's namespace, here is a simple example that returns their sum:: %%cython_inline return a+b For most purposes, we recommend the usage of the `%%cython` magic. )localsglobals)r%user_global_nsuser_nsr)r$linecelllocsglobss r'rzCythonMagics.cython_inlinets1zz(( ""T$>>r(c|j}|s td|dz}t|dd5}|j|ddddtj vs |j sddl}|jd |_||jvr|j|}n-t|tj |}||j|<|j|y#1swYxYw) a)Compile and import a Cython code cell using pyximport. The contents of the cell are written to a `.pyx` file in the current working directory, which is then imported using `pyximport`. This magic requires a module name to be passed:: %%cython_pyximport modulename def f(x): return 2.0*x The compiled module is then imported and all of its symbols are injected into the user's namespace. For most purposes, we recommend the usage of the `%%cython` magic. zmodule name must be given.pyxwutf-8encodingN pyximportrT) strip ValueErroropenwritesysmodulesr#rFinstallr! __import__r6)r$r<r= module_namefnamefrFr1s r'cython_pyximportzCythonMagics.cython_pyximports jjl 89 9f$ %w /1 GGDM0 ckk )1J1J     (,D % $-- ']];/F { #[[-F)/DMM+ &  #0 /s C!!C*z-az --annotate store_constdefaultannotatez/Produce a colorized HTML version of the source.)actionconstdesthelpz--annotate-fullcfullczZProduce a colorized HTML version of the source which includes entire generated C/C++-code.z-+z--cplus store_trueFz Output a C++ rather than C file.)rVrTrYz-3language_levelNzSelect Python 3 syntax.)rXrVrWrTrYz-2r zSelect Python 2 syntax.z-fz--forcezWForce the compilation of a new module, even if the source has been previously compiled.z-cz--compile-argsappendzoExtra flags to pass to compiler via the `extra_compile_args` Extension flag (can be specified multiple times).z --link-argszjExtra flags to pass to linker via the `extra_link_args` Extension flag (can be specified multiple times).z-lz--libzNAdd a library to link the extension against (can be specified multiple times).z-nz--namez%Specify a name for the Cython module.)rYz-L library_dirsdirzPAdd a path to the list of library directories (can be specified multiple times).)rXmetavarrVrTrYz-Iz --includezPAdd a path to the list of include directories (can be specified multiple times).z-Sz--srczFAdd a path to the list of src files (can be specified multiple times).z--pgopgozEnable profile guided optimisation in the C compiler. Compiles the cell twice and executes it in between to generate a runtime profile.)rXrVrTrYz --verbosequiet store_falseTz_Print debug information like generated .c/.cpp file location and exact gcc/g++ command invoked.cTtj|j|}|jdr|n|dz}tj j td}||tjtjtf}tj j|st j||jr|dz }|jr|t!j fz }|j"rt%|j"}n>dt'j(t%|j+dj-z}tj j ||dz}tj j |||j.z} tj j1| } |jxs| } |j2r!tj j1|sd} d} | re|j5|||||j6 } | yt9| d k(sJ| d } ||j:|<|jr|j=| |d }dx}} t?d 5}t?d 5}|jA| ||jrdnd|j6dddddd|||tjLtO|| }|jQ||j2rK tS|d5}|jU}dddtWjX|j[Sy#1swYxYw#1swYxYw#tBjDjFtBjDjHf$r%|||tjJYywxYw#1swYxYw#t\$r@}t_dtjJt_|tjJYd}~yd}~wwxYw)aCompile and import everything from a Cython code cell. The contents of the cell are written to a `.pyx` file in the directory returned by `get_ipython_cache_dir()/cython` using a filename with the hash of the code. This file is then cythonized and compiled. The resulting module is imported and all of its symbols are injected into the user's namespace. The usage is similar to that of `%%cython_pyximport` but you don't have to pass a module name:: %%cython def f(x): return 2.0*x To compile OpenMP codes, pass the required `--compile-args` and `--link-args`. For example with gcc:: %%cython --compile-args=-fopenmp --link-args=-fopenmp ... To enable profile guided optimisation, pass the ``--pgo`` option. Note that the cell itself needs to take care of establishing a suitable profile when executed. This can be done by implementing the functions to optimise, and then calling them directly in the same cell on some realistic training data like this:: %%cython --pgo def critical_function(data): for item in data: ... # execute function several times to build profile from somewhere import some_typical_data for _ in range(100): critical_function(some_typical_data) In Python 3.5 and later, you can distinguish between the profile and non-profile runs as follows:: if "_pgo_" in __name__: ... # execute critical code here  cython)rb_cython_magic_rCz.htmlTN)rcrrc8t||dt||dy)NzContent of stdout: zContent of stderr: )r)stdoutstderrwheres r'print_compiler_outputz2CythonMagics.cython..print_compiler_outputIs 65*@ A 65*@ Ar(r r) pgo_step_namercrDzICython completed successfully but the annotated source could not be read.file)0rparse_argstringrgendswithospathjoinr rK version_info executablecython_versionexistsmakedirsrbforcetimenamestrhashlibsha256encode hexdigestso_extisfilerU _cythonizerclenr"_profile_pgo_wrapperr_build_extension distutilserrorsr LinkErrorrkrjrr6rIreadrHTMLclean_annotated_htmlOSErrorprint)r$r<r=argscodelib_dirkeyrO html_file module_path have_moduleneed_cythonize extension extensionsrm get_stderr get_stdoutr1rQannotated_htmles r'rgzCythonMagics.cythons;d..t{{DA}}T*tt '',,46AT3++S^^^Lww~~g& KK 88 8OC :: DIIK> !C 99dii.K*W^^CHOOG>),!% dGTQUQ[Q[\J!z?a' ''"1 I$/D  S !xx)))W= B #'& Z Q: ^z))!7488%QU]a]g]g*i$  jlJL#**Ek;7  == O)g6!%&VVXN7||D$=$=n$MNN $^   --y/?/?/I/IJ  !*, cjj I 76 * 28; Dacjj)) *ss/ M3: M'.M4M'<M3 OO.OM$ M''M0,M33AOOOO P''6P""P'c tj|}|j}d|z}tjj ||dz}t |dd5}|j tjd||dzddd|j|gz|_ ||_|j||d tjj |||jz}t||y#1swYsxYw) a Generate a .c file for a separate extension module that calls the module init function of the original module. This makes sure that the PGO profiler sees the correct .o file of the final module, but it still allows us to import the module under a different name for profiling, before recompiling it into the PGO optimised module. Overwriting and reimporting the same shared library is not portable. _pgo_z.crBrCrDa1 #include "Python.h" extern PyMODINIT_FUNC PyInit_%(module_name)s(void); PyMODINIT_FUNC PyInit_%(pgo_module_name)s(void); /*proto*/ PyMODINIT_FUNC PyInit_%(pgo_module_name)s(void) { return PyInit_%(module_name)s(); } )rOpgo_module_nameNr)rn) copyr}rsrtrurIrJtextwrapr sourcesrrr)r$rrrOrpgo_wrapper_c_filerQso_module_paths r'rz!CythonMagics._profile_pgo_wrappernsIIi( nn !K/WW\\'?T3IJ $cG < GGHOO%#./R%ST U=&--1C0DD (  iFg/LM_n5#= c tjj||dz}|j}t t t |j}d|vr#ddl} |j| jt|dd5} | j|dddt||g|z||j|j|j |j"|j$rdnd } t'||j(d t+d t,j.d } |j0|j0d vsJ|j0| d<t3| gfi| S#1swYxYw#t4$rYywxYw)NrAnumpyrrBrCrDzc++c)r}r include_dirsr_extra_compile_argsextra_link_args librarieslanguageTr])rcrUr{r\)r r]r\)rsrtruincludelistmapr~srcrr^ get_includerIrJrr_ compile_args link_argslibcplusdictrUminrKrvr\rr) r$rOrrrrcpyx_filec_include_dirs c_src_filesrrQroptss r'rzCythonMagics._cythonizesO77<<v)=>3sDHH-. d?   ! !%"3"3"5 6 (C' 2a GGDM3J,'**#00 NNhh"jjUc   "1c&6&6q&9: D "".**f444)-)<)<%&i[1D1 1-3 2.  sE0A+E(E%( E43E4cd|j||||}d} |s7tjjtjj}|j |s#| tjj|yyy#|s#| tjj|wwwxYw)N)rtemp_dirrn)_get_build_extensionrlog set_thresholdDEBUGrun)r$rrrrnrcbuild_extension old_thresholds r'rzCythonMagics._build_extensions33 w4X  ; ) ; ;IMM> F "*33??LL(G|A,F ' ,&%<?*B % ,&%<?*B % ,&%<?*B %  . i6)9? 9JK9JAQXXhX/9JEK,77 !!9#?#?AZAZ"[\/8/K/Ke/S ,,5,E,E,M )8 iYfgzz #LsD1c |jS#t$r3|jjd|_|jcYSwxYw)z*The extension suffix for compiled modules.)_so_extr0rget_ext_filename)r$s r'rzCythonMagics.so_extsE <<  446GGKDL<<  s 9A  A cP ddlm}|jy#t$rYywxYw)zzclear distutils mkpath cache prevents distutils from skipping re-creation of dirs that have been removed r) _path_createdN)distutils.dir_utilrclear ImportError)r$rs r'_clear_distutils_mkpath_cachez*CythonMagics._clear_distutils_mkpath_caches,  " 8    !   s  %%cv |jt}|j} |jd|j |s||j r| G fdd|}||}|jr|_|r||_ ||g|_ |S#t$rYvwxYw)Nz setup.cfgceZdZfdZy)5CythonMagics._get_build_extension.._build_extc<|j|y)N)build_extensions)r$ add_pgo_flagsbase_build_extrnrs r'rzFCythonMagics._get_build_extension.._build_ext.build_extensionss!$ x@"33D9r(N)__name__ __module__ __qualname__r)rrrnrsr' _build_extrs ::r(r) rrfind_config_filesremoverHparse_config_filesrfinalize_options build_temp build_libr) r$rrrrnrdist config_filesrrrs `` @@r'rz!CythonMagics._get_build_extensions **,~--/      ,  -H++ 'N : :Z : %T*((* )1O & (/O %  *3O &/   sB,, B87B8cg}|rGtjd|tjtjz}|j |tj d|tjtjzj d}tjd}|jD]%}|j|r|j|'dj|S)aYClean up the annotated HTML source. Strips the link to the generated C or C++ file, which we do not present to the user. Returns an HTML snippet (no , , or ), containing only the style tag(s) and _contents_ of the body, appropriate for embedding multiple times in cell output. zz]*>(.+)rz&

Raw output: (.*)rf) refindall MULTILINEDOTALLextendsearchgroupcompile splitlinesmatchr^ru)html include_stylechunksstylesbodyrr<s r'rz!CythonMagics.clean_annotated_html s ZZ 2D",,:RSF MM& !yy %tR\\BII-E %( JJ? @OO%D774= d#&yy  r()T)NNT)rrrr r6r rrRrargumentrgrrrrpropertyrrrr staticmethodr __classcell__)r&s@r'rr]s* *??"$!$!L%_$$&_ l= >_=j; _ i e /_ #MD &_ #MD &_ i e$ _ xB _hB _ gh  _ h 4_ >52  _ k(B  _ gh  _eL%b _'-3 wO               'PwOr6@ D ;8   ".24$+/I@!!r(rz -+, --cplusz --cplus ) CYTHON_DOCCYTHON_INLINE_DOCCYTHON_PYXIMPORT_DOC)2__doc__iorsrrKr|r distutils.logrrgetfilesystemencoding IO_ENCODINGrdistutils.corerrdistutils.command.build_extr IPython.corerrIPython.core.magicrr r IPython.pathsr rIPython.utils.pathIPython.utils.textr ShadowrrxCompiler.ErrorsrInlinerr DependenciesrUtilsrrrrrrgreplacerRr(r'r s8$\ 'c'') 21 (??93&2*/#/ %&?@S  }}   #5) 9I!6I!I!V ..l))11#*7=-#HJ\77??@ = = E EF  M989sD'' D54D5