ó î–+[c@€s±dZddlmZddlZddlZddlZddlZyddlZWne k ruddlZnXddl Z ddl Z ddl Z ddl Z yddlZWn;e k róyddlZWne k rïeZnXnXddlmZddlmZmZmZddlmZmZddlmZdd lmZmZd Zd „Z d e!fd „ƒYZ"defd„ƒYZ#defd„ƒYZ$dS(so A context object for caching a function's return value each time it is called with the same input arguments. iÿÿÿÿ(twith_statementNi(thash(t get_func_codet get_func_namet filter_args(tLoggert format_time(t numpy_pickle(tmkdirpt rm_subdirss # first line:cC€s^|jtƒrN|jdƒ}t|dttƒƒ}dj|dƒ}nd}||fS(sZ Extract the first line information from the function code text if available. s iiiÿÿÿÿ(t startswithtFIRST_LINE_TEXTtsplittinttlentjoin(t func_codet first_line((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pytextract_first_line9s tJobLibCollisionWarningcB€seZdZRS(sF Warn that there might be a collision between names of functions. (t__name__t __module__t__doc__(((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRFst MemorizedFunccB€s­eZdZddeddd„Zd„Zd„Zed„Z d„Z d„Z dd „Z ed „Z d „Zd „Zd „Zd„Zd„Zd„Zd„ZRS(s" Callable object decorating a function for caching its return value each time it is called. All values are cached on the filesystem, in a deep directory structure. Methods are provided to inspect the cache or clean it. Attributes ---------- func: callable The original, undecorated, function. cachedir: string Path to the base cache directory of the memory context. ignore: list or None List of variable names to ignore when choosing whether to recompute. mmap_mode: {None, 'r+', 'r', 'w+', 'c'} The memmapping mode used when loading from cache numpy arrays. See numpy.load for the meaning of the arguments. compress: boolean Whether to zip the stored data on disk. Note that compressed arrays cannot be read by memmapping. verbose: int, optional The verbosity flag, controls messages that are issued as the function is revaluated. ic C€stj|ƒ||_||_||_||_||_|rb|dk rbtj dddƒn|dkr}t j ƒ}n||_ |dkr›g}n||_ t |jƒytj||ƒWnnXtj|ƒrtjƒj|ƒjdddƒ}n |j}d||_dS( sU Parameters ---------- func: callable The function to decorate cachedir: string The path of the base directory to use as a data store ignore: list or None List of variable names to ignore. mmap_mode: {None, 'r+', 'r', 'w+', 'c'}, optional The memmapping mode used when loading from cache numpy arrays. See numpy.load for the meaning of the arguments. verbose: int, optional Verbosity flag, controls the debug messages that are issued as functions are revaluated. The higher, the more verbose timestamp: float, optional The reference time from which times in tracing messages are reported. s&Compressed results cannot be memmappedt stacklevelis s isMemoized version of %sN(Rt__init__t_verbosetcachedirtfunct mmap_modetcompresstNonetwarningstwarnttimet timestamptignoreRt functoolstupdate_wrappertinspectt isfunctiontpydoctTextDoctdocumenttreplaceR( tselfRRR$RRtverboseR#tdoc((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRms2               c O€su|j||Ž\}}|jddƒo9tjj|ƒs|jdkr}t|jƒ\}}|jd|||fƒn|j ||ŽSyt j ƒ}|j |ƒ}|jdkrt j ƒ|} t|jƒ\}}d|t | ƒf} t ddt| ƒƒd | GHn|SWnQtk rp|jd ||tjƒfƒtj|d tƒ|j ||ŽSXdS( NRii s3Computing func %s, argument hash %s in directory %sis%s cache loaded - %siiPt_s<Exception while loading results for (args=%s, kwargs=%s) %st ignore_errors(tget_output_dirt_check_previous_func_codetostpathtexistsRRRR!tcallR"t load_outputRtmaxRt Exceptiont tracebackt format_exctshutiltrmtreetTrue( R-targstkwargst output_dirt argument_hashR0tnamett0touttttmsg((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt__call__Ÿs,  #  cC€s1|j|j|j|j|j|j|jffS(s¤ We don't store the timestamp when pickling, to avoid the hash depending from it. In addition, when unpickling, we run the __init__ (t __class__RRR$RRR(R-((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt __reduce__¿scC€sQt|jƒ\}}|j|ƒtjj|j|Œ}|rMt|ƒn|S(sT Get the directory corresponding to the cache for the function. (RRtappendR4R5RRR(R-tmkdirtmoduleRDtfunc_dir((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt _get_func_dirËs   cO€sa|jdk }tt|j|j||ƒd|ƒ}tjj|j |jƒ|ƒ}||fS(sÊ Returns the directory in which are persisted the results of the function corresponding to the given arguments. The results can be loaded using the .load_output method. t coerce_mmapN( RRRRRR$R4R5RRP(R-R@RARQRCRB((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR2Ös   cC€s<dt||f}t|dƒ}|j|ƒWdQXdS(s= Write the function code and the filename to a file. s%s %i %stwN(R topentwrite(R-tfilenameRRRF((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt_write_func_codeäsic C€s_t|jƒ\}}}|jƒ}tjj|dƒ}y1t|ƒ}t|jƒƒ\}} WdQXWn%t k r‘|j |||ƒt SX||kr¢t S| |ko¹dknr't |jdt dt ƒ\} } |dksd| ||f} n| } tjtd| ƒd|ƒn| |k r|dk rtjj|ƒrt |jdt ƒ\} } t|jd ƒƒ} t|ƒjƒ| d | d | d !}d j|ƒ}|jƒ|jƒkrtjtd | || | ||fƒd|ƒqn|jd krKt |jdt ƒ\} } |jd| |fƒn|jdt ƒt S(s€ stacklevel is the depth a which this function is called, to issue useful warnings to the user. s func_code.pyNiÿÿÿÿt resolv_aliastwin_characterss %s (%s:%i)s/Cannot detect name collisions for function '%s'Rs itsHPossible name collisions between functions '%s' (%s:%i) and '%s' (%s:%i)i s'Function %s (stored in %s) has changed.R!(RRRPR4R5RRSRtreadtIOErrorRVtFalseR?RR R!RRR6RR tfilet readlinestrstripRtclear(R-RRt source_fileRROtfunc_code_filetinfilet old_func_codetold_first_lineR0t func_nametfunc_descriptiont num_lineston_disk_func_code((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR3ësR "          cC€s«|jdtƒ}|jr5|r5|jd|ƒntjj|ƒr]tj|dt ƒnt |ƒt |j ƒ\}}}tjj |dƒ}|j|||ƒdS(s% Empty the function's cache. RMsClearing cache %sR1s func_code.pyN(RPR\RR!R4R5R6R=R>R?RRRRRV(R-R!RORR0RRb((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR`.s c O€sÎtjƒ}|j||Ž\}}|jrA|j||ŽGHn|j||Ž}|j||ƒtjƒ|}|jrÊt|jƒ\}} d| t|ƒf} tddt | ƒƒd| GHn|S(sq Force the execution of the function with the given arguments and persist the output values. s%s - %siiPR0( R"R2Rt format_callRt_persist_outputRRR9R( R-R@RAt start_timeRBRCtoutputtdurationR0RDRH((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR7;s   #cO€s9|j|j||Ž\}}ddd||f}|S(sq Returns a nicely formatted statement displaying the function call with the given arguments. s%s [Memory] Calling %s... %siPR0(tformat_signatureR(R-R@tkwdsR5t signatureRH((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRjMscO€sNt|ƒ\}}g|D]}|r|^q}|rV|j|ƒdj|ƒ}n|}tƒ}d} xx|D]p} |j| ddƒ} t| ƒdkr°d| d } n| dkrÉd | } nt| ƒ} |j| ƒqrW|jg|jƒD]%\} } d | |j| ƒf^qùƒd j|ƒ}d ||f} || fS( Nt.itindentiiÜs%s...i¼iPs %ss%s=%ss, s%s(%s)(RRLRtlisttformatRtextendt iteritems(R-RR@RpRNRDtmt module_pathtarg_strtprevious_lengthtargtvtiRq((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRoXs*       6cC€soyWt|ƒtjj|dƒ}tj||d|jƒ|jdkrVd|GHnWntk rjnXdS(s: Persist the given output tuple in the directory. s output.pklRi sPersisting in %sN( RR4R5RRtdumpRRtOSError(R-RmtdirRU((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRkus  cO€sŠt|j|j||ƒ}td„|jƒDƒƒ}tdk r†y6t|ƒtj|t t j j |dƒdƒƒWq†q†Xn|S(sa Save a small summary of the call using json format in the output directory. cs€s'|]\}}|t|ƒfVqdS(N(trepr(t.0tkR}((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pys ˆssinput_args.jsonRRN( RRR$tdictRwtjsonRRRR]R4R5R(R-RBR@RAt argument_dictt input_repr((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt_persist_inputs   #cC€s¯|jdkr„tjƒ|j}|jdkrYdt|ƒ|j|jƒdfGHq„dt|ƒ|j|jƒd|fGHntjj|dƒ}t j |d|j ƒS(se Read the results of a previous calculation from the directory it was cached in. ii s[Memory]% 16s: Loading %s...is![Memory]% 16s: Loading %s from %ss output.pklR( RR"R#RRoRR4R5RRtloadR(R-RBRGRU((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR8–s    cC€s#d|jj|jt|jƒfS(Ns%s(func=%s, cachedir=%s)(RJRRR‚R(R-((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyt__repr__±s N(RRRRR\RRIRKR?RPR2RVR3R`R7RjRoRkR‰R8R‹(((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRNs"1   C    tMemorycB€s\eZdZdedd„Zddded„Zed„Zd„Z d„Z d„Z RS( sø A context object for caching a function's return value each time it is called with the same input arguments. All values are cached on the filesystem, in a deep directory structure. see :ref:`memory_reference` icC€s tj|ƒ||_||_tjƒ|_||_|r_|dk r_tj dddƒn|dkrwd|_ n%t j j |dƒ|_ t|j ƒdS(s; Parameters ---------- cachedir: string or None The path of the base directory to use as a data store or None. If None is given, no caching is done and the Memory object is completely transparent. mmap_mode: {None, 'r+', 'r', 'w+', 'c'}, optional The memmapping mode used when loading from cache numpy arrays. See numpy.load for the meaning of the arguments. compress: boolean Whether to zip the stored data on disk. Note that compressed arrays cannot be read by memmapping. verbose: int, optional Verbosity flag, controls the debug messages that are issued as functions are revaluated. s&Compressed results cannot be memmappedRitjoblibN(RRRRR"R#RRR R!RR4R5RR(R-RRRR.((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRÉs        cC€s·|dkr"tj|jd|ƒS|jdkr5|S|dkrM|j}n|tkre|j}nt|t ƒr€|j }nt |d|jd|d|d|j d|d|j ƒS(s{ Decorates the given function func to only compute its return value for input arguments not cached on disk. Parameters ---------- func: callable, optional The function to be decorated ignore: list of strings A list of arguments name to ignore in the hashing verbose: integer, optional The verbosity mode of the function. By default that of the memory object is used. mmap_mode: {None, 'r+', 'r', 'w+', 'c'}, optional The memmapping mode used when loading from cache numpy arrays. See numpy.load for the meaning of the arguments. By default that of the memory object is used. Returns ------- decorated_func: MemorizedFunc object The returned object is a MemorizedFunc object, that is callable (behaves like a function), but offers extra methods for cache lookup and management. See the documentation for :class:`joblib.memory.MemorizedFunc`. R$RRRR.R#N( RR%tpartialtcacheRRR\Rt isinstanceRRRR#(R-RR$R.R((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRës        cC€s'|r|jdƒnt|jƒdS(s- Erase the complete cache directory. sFlushing completely the cacheN(R!R R(R-R!((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR`scO€s2|jdkr|||ŽS|j|ƒ||ŽS(s Eval function func with arguments `*args` and `**kwargs`, in the context of the memory. This method works similarly to the builtin `apply`, except that the function is called only if the cache is not up to date. N(RRR(R-RR@RA((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyteval s  cC€sd|jjt|jƒfS(Ns%s(cachedir=%s)(RJRR‚R(R-((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyR‹1s cC€sD|jdk r|jd nd}|j||j|j|jffS(s¤ We don't store the timestamp when pickling, to avoid the hash depending from it. In addition, when unpickling, we run the __init__ iùÿÿÿN(RRRJRRR(R-R((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRK7s" N( RRRRR\RRR?R`R‘R‹RK(((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyRŒ¼s"  -   (%Rt __future__RR4R=R"R)tcPickletpicklet ImportErrorR%R;R R'R†t simplejsonRthashingRt func_inspectRRRtloggerRRRYRtdiskRR R Rt UserWarningRRRŒ(((sU/home/psgendb/BIRCHDEV/install/quast-5.2.0/quast_libs/site_packages/joblib2/memory.pyts>            ÿo