\d'dZddlmZmZddlmZddlmZddl m Z m Z ddl m Z ddlmZddlmZeZGd d Zd S) z twisted.python.threadpool: a pool of threads to which we dispatch tasks. In most cases you can just use C{reactor.callInThread} and friends instead of creating a thread pool directly. )Threadcurrent_thread)List)pool)contextlog) deprecated)Failure)Versionc >eZdZdZdZdZdZdZdZe Z e e e dddd d eZe eZdd Zed ZedZedZedZeZdZdZdZdZdZdZdZdZdZ ddZ!dZ"dS) ThreadPoola This class (hopefully) generalizes the functionality of a pool of threads to which work can be dispatched. L{callInThread} and L{stop} should only be called from a single thread. @ivar started: Whether or not the thread pool is currently running. @type started: L{bool} @ivar threads: List of workers currently running in this thread pool. @type threads: L{list} @ivar _pool: A hook for testing. @type _pool: callable compatible with L{_pool} FNTwistedrzthreading.current_thread)version replacementc|dks Jd||ks Jd|_|_|_g_fd}fd}||_dS)ac Create a new threadpool. @param minthreads: minimum number of threads in the pool @type minthreads: L{int} @param maxthreads: maximum number of threads in the pool @type maxthreads: L{int} @param name: The name to give this threadpool; visible in log messages. @type name: native L{str} rminimum is negativeminimum is greater than maximumc~j|di|}j||S)Nname) threadFactory _generateNamethreadsappend)akwthreadselfs 9lib/python3.11/site-packages/twisted/python/threadpool.pytrackingThreadFactoryz2ThreadPool.__init__..trackingThreadFactoryLsS'T'++--13F L   ' ' 'Mc$jsdSjS)Nr)startedmaxr!sr" currentLimitz)ThreadPool.__init__..currentLimitSs< q8Or$N)minr'rr_pool_team)r! minthreads maxthreadsrr#r)s` r"__init__zThreadPool.__init__8sQ 5Z''')J''' %'            ZZ .CDD r$cR|j}|j|jzS)a For legacy compatibility purposes, return a total number of workers. @return: the current number of workers, both idle and busy (but not those that have been quit by L{ThreadPool.adjustPoolsize}) @rtype: L{int} )r, statisticsidleWorkerCountbusyWorkerCount)r!statss r"workerszThreadPool.workersZs( %%''$u'<<.NotAQueuec@jjS)a Pretend to be a Python threading Queue and return the number of as-yet-unconsumed tasks. @return: the amount of backlogged work not yet dispatched to a worker. @rtype: L{int} )r,r1backloggedWorkCount)qr!s r"qsizez*ThreadPool._queue..NotAQueue.qsizesz,,..BBr$N)__name__ __module__ __qualname__r@r(sr" NotAQueuer<s5 C C C C C C Cr$rD)r!rDs` r"_queuezThreadPool._queue}sM C C C C C C C C C Cy{{r$cd|_d|_||jj}|r|j|dSdS)z' Start the threadpool. FTN)joinedr&adjustPoolsizer,r1r>grow)r!backlogs r"startzThreadPool.startsf   *''))=  % JOOG $ $ $ $ $ % %r$c:|jddS)z Increase the number of available workers for the thread pool by 1, up to the maximum allowed by L{ThreadPool.max}. rN)r,rJr(s r" startAWorkerzThreadPool.startAWorkers r$cDd|jpt|d|jS)z Generate a name for a new pool thread. @return: A distinctive name for the thread. @rtype: native L{str} z PoolThread--)ridr5r(s r"rzThreadPool._generateNames*DTY2"T((CCT\CCCr$c:|jddS)zn Decrease the number of available workers by 1, by quitting one as soon as it's idle. rN)r,shrinkr(s r" stopAWorkerzThreadPool.stopAWorkers !r$ctt|d|t||j|jdS)N__dict__)setattrr r/r*r'r!states r" __setstate__zThreadPool.__setstate__s6j%(((D$(DH55555r$c2i}|j|d<|j|d<|S)Nr*r')r*r'rXs r" __getstate__zThreadPool.__getstate__s"xe xe  r$c*|jd|g|Ri|dS)a Call a callable object in a separate thread. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword args to be passed to C{func} N)callInThreadWithCallback)r!funcargsrs r" callInThreadzThreadPool.callInThreads/ &%dD>4>>>2>>>>>r$c|jrdStjjdfdfd_|_|jdS)a$ Call a callable object in a separate thread and call C{onResult} with the return value, or a L{twisted.python.failure.Failure} if the callable raises an exception. The callable is allowed to block, but the C{onResult} function must not block and should perform as little work as possible. A typical action for C{onResult} for a threadpool used with a Twisted reactor would be to schedule a L{twisted.internet.defer.Deferred} to fire in the main reactor thread using C{.callFromThread}. Note that C{onResult} is called inside the separate thread, not inside the reactor thread. @param onResult: a callable with the signature C{(success, result)}. If the callable returns normally, C{onResult} is called with C{(True, result)} where C{result} is the return value of the callable. If the callable throws an exception, C{onResult} is called with C{(False, failure)}. Optionally, C{onResult} may be L{None}, in which case it is not called at all. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword arguments to be passed to C{func} Nc }d}n #t$rt}d}YnwxYwd_j||d_dS|st j|dSdS)NTF)theWork BaseExceptionr onResultrerr)resultok inContexts r"rkz6ThreadPool.callInThreadWithCallback..inContexts "**,,      !%I !-""2v...%) """   s 77c0tjgRiS)N)rcall)r`ctxr_rsr"z5ThreadPool.callInThreadWithCallback..s2GL % % % % "% % r$) rHrtheContextTrackercurrentContextcontextsrergr,do)r!rgr_r`rrnrks ```@@r"r^z#ThreadPool.callInThreadWithCallbacks< ;  F'6688A"E $       &  i     r$cd|_d|_|j|jD]}|dS)z9 Shutdown the threads in the threadpool. TFN)rHr&r,quitrjoin)r!r s r"stopzThreadPool.stop sN   l  F KKMMMM  r$cx||j}||j}|dks Jd||ks Jd||_||_|jsdS|j|jkr'|j|j|jz |j|jkr)|j|j|jz dSdS)z Adjust the number of available threads by setting C{min} and C{max} to new values. @param minthreads: The new value for L{ThreadPool.min}. @param maxthreads: The new value for L{ThreadPool.max}. Nrrr)r*r'r&r5r,rSrJ)r!r-r.s r"rIzThreadPool.adjustPoolsizes  J  JQ 5Z''')J'''|  F <$( " " J  dlTX5 6 6 6 <$( " " JOODHt|3 4 4 4 4 4 # "r$ctjd|jtjd|jtjd|jdS)zw Dump some plain-text informational messages to the log about the state of this L{ThreadPool}. z waiters: z workers: ztotal: N)rmsgr9r7rr(s r" dumpStatszThreadPool.dumpStats2s[ *DL**+++ *DL**+++ ($,(()))))r$)rrN)NN)#rArBrC__doc__r*r'rHr&rrr staticmethodr r r currentThreadr+r/propertyr5r7r9rFr?rLrNrrTrZr\rar^rwrIr{rEr$r"r r s C C FG DM L GIr1a002      M L  E E E E ED = =X =@@X@ @ @X @X, A % % %DDD666 ? ? ?9!9!9!v5555:*****r$r N)r| threadingrrtypingrtwisted._threadsrr+twisted.pythonrrtwisted.python.deprecater twisted.python.failurer twisted.python.versionsr object WorkerStopr rEr$r"rs -,,,,,,,******''''''''//////******++++++ VXX a*a*a*a*a*a*a*a*a*a*r$