g,ddlmZddlmZddlmZmZmZmZddl m Z ddl m Z ddl m Z ddlmZmZd ZGd d eZdd Zy )) Interface)Lock) merge_withtopk accumulatepluck)add)bisect) defaultdict)QueueEmptycyNrr,lib/python3.12/site-packages/partd/buffer.pyzeror s rcTeZdZd dZdZdZd dZd dZd dZd dZ dZ d Z dd Z y )Bufferct|_||_||_||_t t |_d|_tj|yr) rlockfastslowavailable_memoryr rlengths memory_usager__init__)selfrrrs rrzBuffer.__init__sCF   0"4( 4 rcv|j|j|j|j|jdS)Nrrrrrr!rs r __getstate__zBuffer.__getstate__s3  $ 1 1<<$($9$9 ; ;rctj||t|_|jj |yN)r __setstate__rr__dict__update)rstates rr&zBuffer.__setstate__s-tU+F  U#rc ^|r|jj |jD]C\}}|j|xxt |z cc<|xj t |z c_E|j j|fddi||j |jkDrCt|jdd}|j||j |jkDrC|r|jjyy#|r|jjwwxYw)NrF皙?)maxcount) racquireitemsrlenrrappendr keys_to_flushflushrelease)rdatarkwargskvkeyss rr1z Buffer.append#s ""$ ) 1 Q3q6)!!SV+!% DII  T 8 8 8##d&;&;;$T\\3D 4 ##d&;&;; TYY&&(ttTYY&&(ts CD D,c \|r|jj ttt|j j |d|jj |d}|r|jj|S#|r|jjwwxYwNFr) rr.listmapr rgetrr4)rr9rr6results r_getz Buffer._get2s ""$ )#c499==E=#B#'99==E=#BDEFTYY&&( TYY&&(ts AB B+c|r|jj |jj||d|r|jj yy#|r|jj wwxYw)z Idempotent set Fr<N)rr.risetr4)rkeyvaluers r_isetz Buffer._iset;sX ""$ ) IINN3EN 2TYY&&(ttTYY&&(ts AA9c0|r|jj |jj|d|jj|d|r|jj yy#|r|jj wwxYwr;)rr.rdeleterr4)rr9rs r_deletezBuffer._deleteCsp ""$ ) II  T  . II  T  .TYY&&(ttTYY&&(ts :A66Bc|jj|jj|jjyr%) _iset_seenclearrdroprr"s rrMz Buffer.dropKs.   rc$|jyr%)rM)rargss r__exit__zBuffer.__exit__Ps  rNc b|t|j}|jjt t ||j j||j j||D]1}|xj|j|zc_ |j|=3y)a Flush keys to disk Parameters ---------- keys: list or None list of keys to flush block: bool (defaults to None) Whether or not to block until all writing is complete If no keys are given then flush all keys N) r=rrr1dictziprr?rHr)rr9blockrDs rr3z Buffer.flushSs < %D c$ d(;<=> C   c!2 2  S!r)geA)T)NN) __name__ __module__ __qualname__rr#r&r1rArFrIrMrPr3rrrrr s4!;$ ))) "rrcfttt|dzd|jd}t |j }t |tdtttttd|||z}|d|Dcgc]\}}| }}}|sJ|Scc}}w)z Which keys to remove >>> lengths = {'a': 20, 'b': 10, 'c': 15, 'd': 15, ... 'e': 10, 'f': 25, 'g': 5} >>> keys_to_flush(lengths, 0.5) ['f', 'a'] r)rDN) rmaxr0r/sumvaluesminr r=rr r ) rfractionr-toptotalcutoffr7r8r@s rr2r2ks s3w<1$a(}} C  !E 3q$z#uQ}=>(*,-.F L )LDAqaLF ) M6 M*s B-N)r+i)corer threadingrtoolzrrrr operatorr r collectionsr queuer rrrr2rrrrhs655# ["Y["|r