python (3.11.7)
eC t g d Z ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl
m Z ddl m
Z
ddlmZmZmZ ddl mZ dd l mZ dd
l mZ dd l mZ dd l mZ d
Ze d n
# e$ r dZY nw xY wd Z ej ej e d dD Z d Z e D ]Z ej e e [ [ G d de Z di fdZ!d Z" G d de# Z$d Z%d Z& G d d e Z' G d d e Z(e
j) e
j* fe
j+ e
j, fd!Z- G d" d#e Z. G d$ d%e/ Z0 G d& d'e Z1d( Z2i fd)Z3 dcd*Z4 G d+ d,e Z5 G d- d.e Z6ddd/Z7 G d0 d1e1 Z8 G d2 d3e1 Z9 G d4 d5e9 Z: G d6 d7e1 Z; G d8 d9e1 Z< G d: d;e1 Z= G d< d=e1 Z> e3d>d? Z? G d@ dAe? Z@ e3dBdC ZAdDdEieA_B e3dFdG ZC e3dHdI ZDdJdJdJdEdEdKeD_B G dL dHeD ZE G dM dNe. ZFeF dOejG eF dPejG eF dQejH e; eF dRejI e9 eF dSejJ e9 eF dTejK e9 eF dUejL e9 eF dVejM e: eF dWejN e< eF dXejO eE eF dYePe@ eF dZeQeA eF d.e6e> eF d[e7eC eF d,e5e= eF dEe8d\ eF dJd] er+ G d^ d_ ZR G d` dae' ZS G db de. ZTdS dS )e) BaseManager SyncManager BaseProxyToken N)getpid)
format_exc )
connection) reductionget_spawning_popen ProcessError)pool)process)util) get_context)
shared_memoryTSharedMemoryManagerFc P t j | j | ffS N)arraytypecodetobytes)as L/BuggyBox/python/3.11.7/bootstrap/lib/python3.11/multiprocessing/managers.py reduce_arrayr / s ;QYY[[1 11 c X g | ]'}t t i | (S )typegetattr.0names r
<listcomp>r$ 3 s3
N
N
NDd$72t$$&&''
N
N
Nr )itemskeysvaluesc 0 t t | ffS r )listobjs r rebuild_as_listr, 4 s $s)) r c . e Zd ZdZdZd Zd Zd Zd ZdS )r z3
Type to uniquely identify a shared object
typeidaddressidc 2 |||c| _ | _ | _ d S r r. )selfr/ r0 r1 s r __init__zToken.__init__D s 06,dlDGGGr c * | j | j | j fS r r. r3 s r __getstate__zToken.__getstate__G s T\4733r c 0 |\ | _ | _ | _ d S r r. r3 states r __setstate__zToken.__setstate__J s /4,dlDGGGr c P | j j d| j d| j d| j dS )Nz(typeid=z
, address=z, id=)) __class____name__r/ r0 r1 r6 s r __repr__zToken.__repr__M s4 '''dlllDGGGM Mr N) r?
__module__ __qualname____doc__ __slots__r4 r7 r; r@ r r r r r > si ,IE E E4 4 45 5 5M M M M Mr r r c | ||||f | \ }}|dk r|S t || )zL
Send a message to manager using connection `c` and return response
#RETURN)sendrecvconvert_to_error)cr1
methodnameargskwdskindresults r dispatchrP U sP FFB
D$ '(((6688LD& y
4
(
((r c 8 | dk r|S | dv rmt |t s1t d || t | | dk rt d|z S t | S t
d | S )N#ERROR)
#TRACEBACK#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrT zUnserializable message: %s
z Unrecognized message type {!r})
isinstancestr TypeErrorformatr RemoteError
ValueError)rN rO s r rI rI _ s x
2 2 2&#&& 1@GGD$v,,0 01 1
1 $ $ $ = FGG G v&& &:AA$GGHHHr c e Zd Zd ZdS )rY c B dt | j d z dz S )NzM
---------------------------------------------------------------------------
r zK---------------------------------------------------------------------------)rV rL r6 s r __str__zRemoteError.__str__o s $s49Q<'8'886ABr N)r? rA rB r] r r r rY rY n s( C C C C Cr rY c g }t | D ]6}t | | }t | r| | 7|S )z4
Return a list of names of methods of `obj`
)dirr callableappend)r+ tempr# funcs r all_methodsrd v sS DC sD!! D>> KK Kr c 4 d t | D S )zP
Return a list of names of methods of `obj` which do not start with '_'
c * g | ]}|d dk |S )r _r r! s r r$ z"public_methods.<locals>.<listcomp> s! @ @ @TaC D r )rd r* s r public_methodsrh s! A @[ - - @ @ @@r c e Zd ZdZg dZd Zd Zd Zd Zd Z d Z
d Z d
Z d Z
e e
e d Zd
Zd Zd Zd Zd Zd Zd Zd Zd ZdS )ServerzM
Server class which runs in a process controlled by a manager object
) shutdowncreateaccept_connection get_methods
debug_infonumber_of_objectsdummyincrefdecrefc t |t s0t d |t | || _ t
j | | _ t | \ }} ||d | _
| j
j | _ ddi| _ i | _
i | _ t j | _ d S )Nz&Authkey {0!r} is type {1!s}, not bytes )r0 backlog0Nr )rU bytesrW rX r registryr AuthenticationStringauthkeylistener_clientlistenerr0 id_to_objid_to_refcountid_to_local_proxy_obj threadingLockmutex)r3 rz r0 r|
serializerListenerClients r r4 zServer.__init__ s '5)) -8??T']], ,- -
- !
3G<< *:6& !"===
}, z* %'" ^%%
r c ^ t j | _ | t j _ t j | j }d|_ | | j
s3| j d | j
3n# t t f$ r Y nw xY wt j t j k r@t# j d t j t _ t j t _ t j d dS # t j t j k r@t# j d t j t _ t j t _ t j d w xY w)z(
Run the server forever
)targetTr zresetting stdout, stderrr N)r Event
stop_eventr current_process_manager_serverThreadaccepterdaemonstartis_setwaitKeyboardInterrupt
SystemExitsysstdout
__stdout__r debug
__stderr__stderrexit)r3 r s r
serve_foreverzServer.serve_forever sP $/++48 !!1 't}===H "HO NN
/0022 ,O((+++ /0022 ,%z2
zS^++
5666 ^
^
HQKKKKK zS^++
5666 ^
^
HQKKKKs1 5D< (A B5 4D< 5C D< C D< <A0F,c | j }n# t $ r Y (w xY wt j | j |f }d|_ | c)NTr rL )r~ acceptOSErrorr r handle_requestr r )r3 rJ ts r r zServer.accepter st
M((**
(;1$GGGAAH
GGIII s
**c d } t j || j t j || j | }|\ }}}}|| j v s
J d|z t
| | } ||g|R i |}d|f} n@# t $ r dt f} Y n$w xY w# t $ r dt f} Y nw xY w | | d S # t $ r}
| dt f n# t $ r Y nw xY wt j d| t j d| t j d|
Y d }
~
d S d }
~
ww xY w)Nz%r unrecognizedrF rS zFailure to send message: %rz ... request was %r ... exception was %r) r
deliver_challenger| answer_challengerH publicr Exceptionr rG r info) r3 rJ requestignorefuncnamerL rM rc rO msges r _handle_requestzServer._handle_request s * (DL 9 9 9 '4< 8 8 8ffhhG+2 (FHdDt{***,=,H***4**D
* a/$///$// !&)
3
3
3#Z\\2
3 / / / .CCC / 2
FF3KKKKK 2 2 2
jll34444
I3S 9 9 9 I+W 5 5 5 I-q 1 1 1 1 1 1 1 1 1 2s[ A5B+ : B B('B(+CC C# #
E,.#DE'
D E' D AE''E,c | | n# t $ r Y nw xY w| dS # | w xY w)z)
Handle a new connection
N)r r closer3 conns r r zServer.handle_request sc & & & & D
JJLLLLLDJJLLLLs >
%> %> Ac B t j dt j j |j }|j }| j }| j s dx}} | }|\ }}} }
|| \ }} } n:# t $ r-}
| j | \ }} } n# t $ r |
w xY wY d}
~
nd}
~
ww xY w|| vr%t d|dt | d| t || } || i |
}| o| |d }|r7| ||| \ }}t# || j | }d||ff}n d|f}n# t& $ r}d|f}Y d}~nd}~ww xY wn# t $ rX |d t) f}nB | j | } || |||g| R i |
}d|f}n # t& $ r d t) f}Y nw xY wY nit, $ rB t j d
t j j t/ j d Y n t& $ r d t) f}Y nw xY w || n)# t& $ r |d t) f Y nw xY wn# t& $ r}t j d
t j j t j d| t j d| | t/ j d Y d}~nd}~ww xY w| j dS dS )zQ
Handle requests from the proxies in a particular process/thread
z$starting server thread to service %rNzmethod z of z object is not in exposed=#PROXYrF rR rS z$got EOF -- exiting thread serving %rr rT z exception in thread serving %rz ... message was %rr r )r r r current_threadr# rH rG r r r KeyErrorr AttributeErrorr r getrl r r0 r r fallback_mappingEOFErrorr r r r )r3 r rH rG r rK r+ r identrL rM exposed gettypeidkefunctionresr/ ridentrexposedtokenr r
fallback_funcrO s r serve_clientzServer.serve_client sD
9 +--2 4 4 4 yyN /((** D 5
3#''
S $&&07-z4!.7.>+C)) ! ! !! 6u = 0Wii# ! ! ! ! '0iiii! W,,(.#T#YYYY9
#3
33 /"(D1D11C ' J9==T+J+JF /+/;;tVS+I+I( %fdlF C C '(E): ; (# . ! ( ( (#Q-CCCCCC( "
;
;
; %' 6CC;(,(=j(I
!. $s" 59" " " =A" " )& 1$ ; ; ; +Z\\ :;
A$355:< < <
3
3
3#Z\\2
3
<DIIII < < <D+Z\\:;;;;;<
:!02279 9 9 /555 11555
} /((** D D D D D s E- 2 A? >E- ?
B6
B B1
B))B1,E- 1B66<E- 3E ;AE-
E)E$ E- $E))E- - H4 F,+H4,G H4G H4AH4H43H49 I I/ #I+(I/ *I++I/ /
L 9A=K;;L c |S r r r3 r r r+ s r fallback_getvaluezServer.fallback_getvalue? s
r c t | S r rV r s r fallback_strzServer.fallback_strB s
3xxr c t | S r )reprr s r
fallback_reprzServer.fallback_reprE s Cyyr )r] r@ #GETVALUEc d S r r r3 rJ s r rq z Server.dummyN s r c
| j 5 g }t | j }| |D ]W}|dk rO| d|d| j | dt
| j | d dd Xd | cddd S # 1 swxY w Y dS ) zO
Return some info --- useful to spot problems with refcounting
rw z z: refcount=z
r NK
) r r) r r& sortra rV r join)r3 rJ rO r& r s r ro zServer.debug_infoQ s%
Z % %F+002233D IIKKK
H
HC<<MMM#(55$*=e*D*D*D#&t~e'<Q'?#@#@"#E#E#G H H H 99V$$ % % % % % % % % % % % % % % % % % %s B+C CCc * t | j S )z*
Number of shared objects
)lenr r s r rp zServer.number_of_objectsa s
4&'''r c t j d | d n # ddl}| Y nxY w| j dS # | j w xY w)z'
Shutdown this process
z!manager received shutdown messagerF Nr N)r r rG traceback print_excr set)r3 rJ r s r rk zServer.shutdownh s " J: ; ; ;
FF$ % % % % " ! ! ! ! ! O ! ! ! ! !DO ! ! ! !s ), A& AA& &Bc | j 5 | j | \ }}}}|-|st | dk rt d |d } n ||i |} |t | }|dt |t s0t d |t | t | t | z }dt | z }
t j
d||
| t | |f| j |
< |
| j vr
d| j |
< ddd n # 1 swxY w Y | ||
|
t% | fS )z>
Create a new shared object and return its id
Nr z4Without callable, must have one non-keyword argumentr z,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)r rz r rZ rh rU dictrW rX r r) r1 r r r r r rr tuple) r3 rJ r/ rL rM r` r method_to_typeid proxytyper+ r s r rl z
Server.createu s Z / /mF+
;Hg / PCIINN$NP P P1g h---(-- +!"2D99 G#FMM ,d3C.D.DF FG G G w--$/?*@*@@2c77NE J? O O O%(#g,,8H$IDN5 !D ///-.#E*7 / / / / / / / / / / / / / / /:
Au eGnn$$s DD**D.1D.c L t | j |j d S )zL
Return the methods of the shared object indicated by token
r )r r r1 )r3 rJ r s r rn zServer.get_methods s T^EH-a0111r c |t j _ | d | | dS )z=
Spawn a new thread to serve this connection
r N)r r r# rG r )r3 rJ r# s r rm zServer.accept_connection sB +/ ""' !!! ! r c D | j 5 | j |xx dz
cc< nh# t $ r[}|| j v rFd| j |< | j | | j |< | j | \ }}}t j d| n|Y d }~nd }~ww xY wd d d d S # 1 swxY w Y d S )Nr z&Server re-enabled tracking & INCREF %r)r r r r r r r )r3 rJ r r r+ r r s r rr z
Server.incref s(
Z
#E***a/****
D 66612D'. 259 N5).2nU.C+C)J GOOOO H POOOO
s7 B B
BAB ;B BBB Bc , || j vr || j v rt j d| d S | j 5 | j | dk r:t d || j | | j | | j |xx dz cc< | j | dk r| j |= d d d n # 1 swxY w Y || j vrId| j |< t j d| | j 5 | j |= d d d d S # 1 swxY w Y d S d S )NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr Nzdisposing of obj with id %r)r r r r r AssertionErrorrX r )r3 rJ r s r rs z
Server.decref s + + + T/ / / J2E : : : F
Z / /"5)Q..$AHH t~e 4 +E24 45 5 5
& & &! + & & &"5)Q..'. / / / / / / / / / / / / / / / + + + %5DN5 ! J4e < < <
*
*N5)
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
* , +s$ A:B77B;>B;1 DD D N)r? rA rB rC r r4 r r r r r r r r r rq ro rp rk rl rn rm rr rs r r r rj rj s] N N NF& & &$ , 2 2 2<
O O O b %
% % % ( ( ( " " ""% "% "%H2 2 2 $* * * * *r rj c e Zd ZdgZdZdZdZdS )Statevaluer r N)r? rA rB rD INITIALSTARTEDSHUTDOWNr r r r r s$ IGGHHHr r )pickle xmlrpclibc e Zd ZdZi ZeZ ddddZd Zd Z dd
Z
e dd Z d Z
dd
Zd Zd Zd Zd Zed Zed Ze dd ZdS )r z!
Base class for managers
Nr g ?)shutdown_timeoutc F |t j j }|| _ t j | | _ t
| _ t j | j _ || _
t | \ | _ | _
|p
t | _ || _ d S r )r r r| _addressr{ _authkeyr _stater r _serializerr} _Listener_Clientr _ctx_shutdown_timeout)r3 r0 r| r ctxr s r r4 zBaseManager.__init__ s ? -//7G
4W==
gg !M %'6z'B$ (;== !1 r c ~ | j j t j k r~| j j t j k rt d | j j t j k rt d t d | j j t | j | j
| j | j S )zX
Return server object with serve_forever() method and address attribute
Already started serverManager has shut downUnknown state {!r})
r r r r r r
r rX rj _registryr r r r6 s r
get_serverzBaseManager.get_server s ;
- -{ EM11"#;<<<"en44"#:;;;"(// 0ABBD D DdndmmT%57 7 7r c t | j \ }} || j | j }t |dd t
j | j _ dS )z>
Connect manager object to the server process
r| Nrq ) r} r r r rP r r r r )r3 r r r s r connectzBaseManager.connect sR +4+;<&vdmT];;;tW%%% !M r r c
b | j j t j k r~| j j t j k rt d | j j t j k rt d t d | j j | t | st d t j d \ }}| j
t | j | j | j | j | j |||f | _ d d
| j j D }t | j d z |z | j _ | j | | | _ | t j | j _ t9 j | t | j | j | j | j | j | j | j fd
| _! dS )z@
Spawn a server process for this manager object
r r r Nz initializer must be a callableF)duplexr :c 3 4 K | ]}t | V d S r r )r" is r <genexpr>z$BaseManager.start.<locals>.<genexpr>1 s( AAAQAAAAAAr -r rL exitpriority)"r r r r r r
r rX r` rW r
Piper Processr _run_serverr r r r _processr _identityr? r# r r rH r Finalize_finalize_managerr r rk )r3 initializerinitargsreaderwriterr s r r zBaseManager.start s ;
- -{ EM11"#;<<<"en44"#:;;;"(// 0ABBD D D "8K+@+@ " <== = $ 666 ))::).$- "FKC *
AA )@AAAAA !$ZZ 0C 7% ?
"M
$t**.-
t{, 68
r c N t j t j t j | || | |||| }| |j | t j d|j | dS )z@
Create a server, report its address and run it
Nzmanager serving at %r)
signalSIGINTSIG_IGN_ServerrG r0 r r r r ) clsrz r0 r| r r r r servers r r zBaseManager._run_serverC s
fmV^444 " K " " XwDD FN###
)6>::: r c N | j j t j k s
J d | | j | j } t |dd|f|z | \ }}| n# | w xY wt || j | |fS )zP
Create a new shared object; return the token and exposed tuple
zserver not yet startedr Nrl )
r r r r r r r rP r r )r3 r/ rL rM r r1 r s r _createzBaseManager._createZ s { EM1113K111||DM4=|AA "4x&4 NNKB JJLLLLDJJLLLLVT]B//88s A6 6B c | j <| j | | j s d| _ dS dS dS )zC
Join the manager process (if it has been spawned)
N)r r is_aliver3 timeouts r r zBaseManager.joinf sU = $ M w ' ' '=))++
% $
% $
%
%r c | | j | j } t |dd | S # | w xY w)zS
Return some info about the servers shared objects and connections
r Nro r r r rP r r s r _debug_infozBaseManager._debug_infoo sR ||DM4=|AA D$ 55 JJLLLLDJJLLLL A A c | | j | j } t |dd | S # | w xY w)z5
Return the number of shared objects
r Nrp r* r s r _number_of_objectsz BaseManager._number_of_objectsy sS ||DM4=|AA D$(;<< JJLLLLDJJLLLLr, c | j j t j k r| | j j t j k r~| j j t j k rt
d | j j t j k rt
d t
d | j j | S )NzUnable to start serverr r ) r r r r r r r
r rX r6 s r __enter__zBaseManager.__enter__ s ;
- - JJLLL ;
- -{ EM11"#;<<<"en44"#:;;;"(// 0ABBD D D r c . | d S r )rk r3 exc_typeexc_valexc_tbs r __exit__zBaseManager.__exit__ s
r c | j r,t j d ||| } t |dd | n# | w xY wn# t
$ r Y nw xY w | j | | j rt j d t | d rut j d | j | j | | j r2t j d | j | j t j |_ t j |= dS # t $ r Y dS w xY w)
zQ
Shutdown the manager process; will be registered as a finalizer
z#sending shutdown message to managerr Nrk )r( zmanager still alive terminatez'trying to `terminate()` manager processz#manager still alive after terminate)r& r r rP r r r hasattrr8 killr r r r _address_to_localr )r r0 r| r: r r r s r r z BaseManager._finalize_manager s 7 ' I; < < <
ww888! T4444JJLLLLDJJLLLLL
GL!1 2 2 2 2 w !!
' /0007K00 'I GHHH%G%''' GL)9::::'w')) ' "GHHH$ $ n +G444 DD s:
A4 A A4 A00A4 4
B B
E
E,+E,c | j S r )r r6 s r r0 zBaseManager.address s
} r Tc d| j vr | j | _ t |pt dd }|pt dd }|rmt | D ]K\ }}t | t u s
J d|z t | t u s
J d|z L|||f| j < |r fd} | _ t | | dS dS )z9
Register a typeid with the manager type
r N _exposed__method_to_typeid_z%r is not a stringc t j d | j g|R i |\ }} || j | | j | }| |j | j }t |d d|j f |S )Nz)requesting creation of a shared %r objectmanagerr| r r rs ) r r r$ r r r r0 rP r1 ) r3 rL rM r expproxyr r r/ s r rb z"BaseManager.register.<locals>.temp s
FOOO )T\& @4 @ @ @4 @ @
s! 4+T M3 ||EM4=|IItX{;;; r ) __dict__r copy AutoProxyr r) r% r rV r? setattr)
r! r/ r` r r r
create_methodkeyr rb s
` ` r registerzBaseManager.register sV cl * * M . . 0 0CM !IBWY T B B+ J"9.BDII H "#3#9#9#;#; < <
H
H
UCyyC''')=)C'''E{{c)))+?%+G))))
g /!
f '
#DM C & & & & & ' 'r )NNr Nrx r )NNNNT)r? rA rB rC r rj r r4 r r r classmethodr r$ r r+ r. r0 r6 staticmethodr propertyr0 rK r r r r r sc IG>F 2/2 2 2 2 2 2
7
7
7 * * *) ) ) )V /1 [ ,
9
9
9% % % % \ D X EI6:%' %' %' [%' %' %'r r c e Zd Zd Zd ZdS )ProcessLocalSetc 2 t j | d d S )Nc * | S r )clearr* s r <lambda>z*ProcessLocalSet.__init__.<locals>.<lambda> s 399;; r )r register_after_forkr6 s r r4 zProcessLocalSet.__init__ s '>'>?????r c $ t | dfS rx )r r6 s r
__reduce__zProcessLocalSet.__reduce__ s Dzz2~ r N)r? rA rB r4 rW r r r rP rP s5 @ @ @ r rP c e Zd ZdZi Z ej Z ddZd Z di fdZ
d Z d
Z e
d Zd Zd
Zd Zd Zd ZdS )r z.
A base for proxies of shared objects
NTFc t j 5 t j |j d }|5t j t f}|t j |j < d d d n # 1 swxY w Y |d | _ |d | _ || _
| j
j | _ || _
|| _ t | d | _ || _ |t% j | | _ n6| j
| j
j | _ n t% j j | _ |r| t j | t j d S )Nr r )r _mutexr; r r0 r ForkAwareLocalrP _tls_idset_tokenr1 _id_managerr r} r _owned_by_managerr r{ r r r| _increfrU _after_fork) r3 r r rB r| r rr
manager_owned tls_idsets r r4 zBaseProxy.__init__ s
G G!377
tLLI / 1 1?3D3D D =F +EM: G G G G G G G G G G G G G G G aL
l ;>
%&z215 "/ # 8 A ADMM
]
& M 2DMM # 3 5 5 =DM LLNNN y'<=====s A A66A:=A:c \ t j d t j j }t j j dk r |dt j j z z
}| | j j | j
}t |d d|f || j _
d S )Nz making connection to manager
MainThread|r rm )r r r r r# r r r r^ r0 r rP r\ r
)r3 r# r s r _connectzBaseProxy._connect s
1222&((- # % % *l : : C)24499 9D||DK / |GGt 04'::: # r r c | j j }n[# t $ rN t j dt j j | | j j }Y nw xY w| | j
|||f | \ }}|dk r|S |dk r|\ }}| j j
|j d } | j j |_ | || j | j | j | }
| |j | j }t) |dd|j f |
S t- || ) zV
Try to call a method of the referent and return a copy of the result
z#thread %r does not own a connectionrF r rA r Nrs )r\ r
r r r r r r# ri rG r_ rH r` r r/ r^ r0 r r r rP r1 rI ) r3 rK rL rM r rN rO r r r rD s r _callmethodzBaseProxy._callmethod) sV (9'DD ( ( ( J< /116
8
8
8 MMOOO9'DDD (
48Zt4555yy{{ f 9 M
X
#NGU
/ =bAI K /EM It'
w E <<
t}<EED T4EH; 7 7 7L tV,,,s AA'&A'c , | d S )z9
Get a copy of the value of the referent
r rl r6 s r _getvaluezBaseProxy._getvalueG s ,,,r c
| j r!t j d| j j d S | | j j | j }t |d d| j f t j d| j j | j
| j | j o | j j
}t j | t j | j | j || j | j
| j fd | _ d S )Nz%owned_by_manager skipped INCREF of %rr rr z INCREF %r
r )ra r r r^ r1 r r0 r rP r_ r] addr` r r r _decrefr\ _close)r3 r r: s r rb zBaseProxy._increfM s ! J> O O O F||DK / |GGtX{333
; /// !!!
6$-"6m )#+t}e)T[$,8 r c 8 | | j ||j t j k rr t j d| j || j | }t |d d| j f nF# t $ r }t j d| Y d }~n"d }~ww xY wt j d| j |sXt |d rJt j dt j j
|j |`d S d S d S )Nz DECREF %rr rs z... decref failed %sz%DECREF %r -- manager already shutdownr
z-thread %r has no more proxies so closing conn)discardr1 r r r r r r0 rP r r9 r r r# r
r )r r| r: tlsidsetr r r s r rs zBaseProxy._decrefa s?
eh =EK5= 8 8
6
;111 wu}g>>>tX{;;;;
6
6
6
1155555555
6
J> I I I l33 JF /116
8
8
8 N " " " s AA8 8
B!B B!c d | _ | d S # t $ r"}t j d|z Y d }~d S d }~ww xY w)Nzincref failed: %s)r` rb r r r )r3 r s r rc zBaseProxy._after_forkz sf
/ LLNNNNN / / / I)A- . . . . . . . . . /s
A AA c i }t
| j |d< t | dd r&| j |d< t t
| j | j |ffS t t | | j | j |ffS )Nr| _isautoFr ) r r r r> RebuildProxyrG r^ r r r3 rM s r rW zBaseProxy.__reduce__ s + "mDO 4E * * G "nDO T-=tDF
F !$ZZd.>EG
Gr c * | S r )ro )r3 memos r __deepcopy__zBaseProxy.__deepcopy__ s ~~ r c d dt | j | j j t | fz S )Nz <%s object, typeid %r at %#x>)r r? r^ r/ r1 r6 s r r@ zBaseProxy.__repr__ s/ .T
#T[%7DBC Cr c | d S # t $ r t | dd dz cY S w xY w)zV
Return representation of the referent (or a fall-back if that fails)
r@ Nrk z; '__str__()' failed>)rl r r r6 s r r] zBaseProxy.__str__ sV =##J// / = = =::crc?%<< < < < =s $>>NNNTF)r? rA rB rC r; r ForkAwareThreadLockrZ r4 ri rl ro rb rM rs rc rW r r@ r] r r r r r s
%T
%
'
'F26HM'> '> '> '>R$ $ $ ,.B - - - -<- - - ( \ 0/ / / G G G C C C= = = = =r r c t t j dd }|rW|j |j k rGt j d| d|d< |j |j vr |j |j |j |j < | dd o"t t j dd } | ||fd|i|S ) z5
Function used for unpickling proxy objects.
r Nz*Rebuild a proxy owned by manager, token=%rTrd rr _inheritingF)
r r r r0 r r r1 r r pop)rc r r rM r" rr s r r| r| s W,..0A4
H
HF
+&.EM11
?GGG $_ 867 7 7 *
( 2
4 E G+--}e D DD 4z 9 9& 9D 9 99r c t | } || |f S # t $ r Y nw xY wi }|D ]}t d|d|d| t | t f| }||_ ||| |f< |S )zB
Return a proxy type whose methods are given by `exposed`
zdef z:(self, /, *args, **kwds):
return self._callmethod(z
, args, kwds))r r execr r r> )r# r _cachedicmeth ProxyTypes r
MakeProxyTyper s GnnG
tWo&&
C H H 6:ddDDDBCF H H H H TI<--I!I 'FD'? s
((c t | d }|T || j | } t |dd| f }| n# | w xY w| ||j }|t j j }t d| j z | } | | ||||| }
d|
_
|
S )z*
Return an auto-proxy for `token`
r Nr rn z
AutoProxy[%s])rB r| rr rd T) r} r0 rP r r r r r| r r/ r{ ) r r rB r| r rr rd r r r rD s r rG rG s
j)!,Gwu}g666 tT=5(CCG JJLLLLDJJLLLL7.")++3 o <gFFI IeZ' #=
B
B
BEEM Ls A A'c e Zd Zd Zd ZdS ) Namespacec : | j | d S r )rE updater} s r r4 zNamespace.__init__ s
T"""""r c 2 t | j }g }|D ]4\ }}| d s| |d| 5| | j j dd | dS )Nrg =(, r= ) r) rE r%
startswithra r r> r? r )r3 r% rb r# r s r r@ zNamespace.__repr__ s T]((**++ 5 5KD%??3''
5 tttUU 3444 >222DIIdOOOODDr N)r? rA rB r4 r@ r r r r r s7 # # #E E E E Er r c @ e Zd ZddZd Zd Zd Z eee ZdS )ValueTc " || _ || _ d S r ) _typecode_value)r3 r r locks r r4 zValue.__init__ s ! r c | j S r r r6 s r r z Value.get s
{r c || _ d S r r r3 r s r r z Value.set s
r c P t | j d| j d| j dS )Nr r r= )r r? r r r6 s r r@ zValue.__repr__ s* !$ZZ 0 0 0$...$+++NNr NT) r? rA rB r4 r r r@ rN r r r r r r sc O O O HS# EEEr r c , t j | | S r )r )r sequencer s r Arrayr s ;x * **r c 0 e Zd ZdZd Zd Zd Zd Zd ZdS )
IteratorProxy)__next__rG throwr c | S r r r6 s r __iter__zIteratorProxy.__iter__ r c . | d| S )Nr rn r3 rL s r r zIteratorProxy.__next__ s
D111r c . | d| S )NrG rn r s r rG zIteratorProxy.send s ---r c . | d| S )Nr rn r s r r zIteratorProxy.throw ...r c . | d| S )Nr rn r s r r zIteratorProxy.close r r N) r? rA rB r> r r rG r r r r r r r
sd 6I 2 2 2. . ./ / // / / / /r r c , e Zd ZdZddZd Zd Zd ZdS )
AcquirerProxy)acquirereleaseTNc @ ||fn||f}| d| S Nr rn )r3 blockingr( rL s r r zAcquirerProxy.acquire s, %o{{Hg3F 4000r c , | d S Nr rn r6 s r r zAcquirerProxy.release ***r c , | d S r rn r6 s r r0 zAcquirerProxy.__enter__ r r c , | d S r rn r2 s r r6 zAcquirerProxy.__exit__! r r )TN)r? rA rB r> r r r0 r6 r r r r r sZ &I1 1 1 1+ + ++ + ++ + + + +r r c 0 e Zd ZdZddZd dZd ZddZdS )
ConditionProxy)r r r notify
notify_allNc 0 | d|f S Nr rn r' s r r zConditionProxy.wait'
333r r c 0 | d|f S )Nr rn )r3 ns r r zConditionProxy.notify) s 1$///r c , | d S )Nr rn r6 s r r zConditionProxy.notify_all+ s ---r c | }|r|S |t j |z }nd }d }|s@| |t j z
}|dk rn!| | | }|@|S )Nr )time monotonicr )r3 predicater( rO endtimewaittimes r wait_forzConditionProxy.wait_for- s M n&&0GGGH !""T^%5%55q== IIh Y[[F
!
r r )r )r? rA rB r> r r r r r r r r r % sd FI4 4 4 40 0 0 0. . . r r c , e Zd ZdZd Zd Zd ZddZdS )
EventProxy)r r rS r c , | d S )Nr rn r6 s r r zEventProxy.is_setB s )))r c , | d S Nr rn r6 s r r zEventProxy.setD &&&r c , | d S )NrS rn r6 s r rS zEventProxy.clearF (((r Nc 0 | d|f S r rn r' s r r zEventProxy.waitH r r r )r? rA rB r> r r rS r r r r r r @ sZ 2I* * *' ' ') ) )4 4 4 4 4 4r r c h e Zd ZdZd dZd Zd Zed Zed Z ed Z
dS )
BarrierProxy)__getattribute__r abortresetNc 0 | d|f S r rn r' s r r zBarrierProxy.waitN r r c , | d S )Nr rn r6 s r r zBarrierProxy.abortP r r c , | d S )Nr rn r6 s r r zBarrierProxy.resetR r r c . | dd S )Nr )partiesrn r6 s r r zBarrierProxy.partiesT s 2LAAAr c . | dd S )Nr ) n_waitingrn r6 s r r zBarrierProxy.n_waitingW s 2NCCCr c . | dd S )Nr )brokenrn r6 s r r zBarrierProxy.brokenZ s 2K@@@r r ) r? rA rB r> r r r rN r r r r r r r r L s >I4 4 4 4) ) )) ) )
B B XB
D D XD
A A XA A Ar r c $ e Zd ZdZd Zd Zd ZdS )NamespaceProxy)r __setattr__ __delattr__c |d dk rt | | S t | d } |d|f S )Nr rg rl r )objectr r3 rJ
callmethods r __getattr__zNamespaceProxy.__getattr__a sO q6S==**455 5,,T=AA
z,sf555r c |d dk r t | || S t | d } |d||f S )Nr rg rl r )r r r )r3 rJ r r s r r zNamespaceProxy.__setattr__f sR q6S==%%dC77 7,,T=AA
z-#u 666r c |d dk rt | | S t | d } |d|f S )Nr rg rl r )r r r r s r r zNamespaceProxy.__delattr__k sN q6S==%%dC00 0,,T=AA
z-#000r N)r? rA rB r> r r r r r r r r _ sF BI6 6 6
7 7 7
1 1 1 1 1r r c V e Zd ZdZd Zd Z eee Z ee j
Z dS )
ValueProxy)r r c , | d S )Nr rn r6 s r r zValueProxy.gett r r c 0 | d|f S r rn r s r r zValueProxy.setv s x000r N) r? rA rB r> r r rN r rL types GenericAlias__class_getitem__r r r r r r sW I' ' '1 1 1 HS# E# E$677r r
BaseListProxy)__add__ __contains__ __delitem__ __getitem____len____mul__ __reversed____rmul__ __setitem__ra countextendindexinsertr removereverser __imul__c e Zd Zd Zd ZdS ) ListProxyc 4 | d|f | S )Nr rn r s r __iadd__zListProxy.__iadd__ s E8,,, r c 4 | d|f | S )Nr rn r s r r zListProxy.__imul__ s eX... r N)r? rA rB r r r r r r
r
s2 r r
DictProxy)r r r r r r rS rF r r% r& r popitem
setdefaultr r' r Iterator
ArrayProxy)r r r PoolProxy) apply apply_asyncr imapimap_unorderedr map map_asyncstarmap
starmap_asyncr8 AsyncResult)r r r r r c e Zd Zd Zd ZdS )r c | S r r r6 s r r0 zPoolProxy.__enter__ r r c . | d S r )r8 r2 s r r6 zPoolProxy.__exit__ s r N)r? rA rB r0 r6 r r r r r s2 r c e Zd ZdZdS )r a(
Subclass of `BaseManager` which supports a number of shared object types.
The types registered are those intended for the synchronization
of threads, plus `dict`, `list` and `Namespace`.
The `multiprocessing.Manager()` function creates started instances of
this class.
N)r? rA rB rC r r r r r s r r Queue
JoinableQueuer r RLock SemaphoreBoundedSemaphore ConditionBarrierPoolr) r r )r rI )rI c @ e Zd ZdZg fdZd Zd Zd Zd Zd Z d Z
d S )
_SharedMemoryTrackerz+Manages one or more shared memory segments.c " || _ || _ d S r shared_memory_context_name
segment_names)r3 r# r1 s r r4 z _SharedMemoryTracker.__init__ s .2D +!.D r c t j d|dt | j | dS )z6Adds the supplied shared memory block name to tracker.zRegister segment in pid N)r r r r1 ra r3 segment_names r register_segmentz%_SharedMemoryTracker.register_segment sD JM<MM688MM N N N % %l 3 3 3 3 3r c t j d|dt | j | t j | }| | dS )zCalls unlink() on the shared memory block with the supplied name
and removes it from the list of blocks being tracked.zDestroy segment r3 N) r r r r1 r r SharedMemoryr unlink)r3 r5 segments r destroy_segmentz$_SharedMemoryTracker.destroy_segment ss
JL,LL&((LL M M M % %l 3 3 3#0 >>G MMOOO NN r c T | j dd D ]}| | dS )z<Calls destroy_segment() on all tracked shared memory blocks.N)r1 r; r4 s r r9 z_SharedMemoryTracker.unlink s> $ 2111 5
3
3 $$\2222
3
3r c t j d| j j dt | d S )NzCall z .__del__ in )r r r> r? r r9 r6 s r __del__z _SharedMemoryTracker.__del__ s= JNt~ 6NNFHHNN O O O KKMMMMMr c | j | j fS r r/ r6 s r r7 z!_SharedMemoryTracker.__getstate__ s 3T5GH Hr c | j | d S r )r4 r9 s r r; z!_SharedMemoryTracker.__setstate__ s DM5 ! ! ! !r N) r? rA rB rC r4 r6 r; r9 r> r7 r; r r r r- r- s 55/1 / / / / 4 4 4
3 3 3
I I I " " " " "r r- c J e Zd Zej g dz Zd Zd Zd Zd Zd Z d Z
dS ) SharedMemoryServer)
track_segmentrelease_segment
list_segmentsc " t j | g|R i | | j }t |t rt j | }t d| dt | _ t j dt d S )Nshm_rg z"SharedMemoryServer started by pid ) rj r4 r0 rU ry osfsdecoder- r shared_memory_contextr r )r3 rL kwargsr0 s r r4 zSharedMemoryServer.__init__ s OD 24 2 2 26 2 2 2lG'5))
/ +g..$%@G%@%@fhh%@%@AA
& JFFHHFF G G G G Gr c t | j | d d r
| j |d< t j | ||g|R i |S )zCreate a new distributed-shared object (not backed by a shared
memory block) and return its id to be used in a Proxy Object.rk _shared_memory_proxyrJ )r9 rz rJ rj rl )r3 rJ r/ rL rK s r rl zSharedMemoryServer.create sV t}V,R02HII
M262L./=q&B4BBB6BB Br c j | j t | | S )zACall unlink() on all tracked shared memory, terminate the Server.)rJ r9 rj rk r s r rk zSharedMemoryServer.shutdown s+ & - - / / /??4++ +r c : | j | dS )z?Adds the supplied shared memory block name to Server's tracker.N)rJ r6 r3 rJ r5 s r rC z SharedMemoryServer.track_segment s & 7 7 E E E E Er c : | j | dS )zCalls unlink() on the shared memory block with the supplied name
and removes it from the tracker instance inside the Server.N)rJ r; rP s r rD z"SharedMemoryServer.release_segment s!
& 6 6| D D D D Dr c | j j S )zbReturns a list of names of shared memory blocks that the Server
is currently tracking.)rJ r1 r s r rE z SharedMemoryServer.list_segments! s -; ;r N) r? rA rB rj r r4 rl rk rC rD rE r r r rB rB s FFFG H H H C C C , , ,
F F F E E E
< < < < <r rB c 4 e Zd ZdZeZd Zd Zd Zd Z d Z
dS )r a Like SyncManager but uses SharedMemoryServer instead of Server.
It provides methods for creating and returning SharedMemory instances
and for creating a list-like object (ShareableList) backed by shared
memory. It also provides methods that create and return Proxy Objects
that support synchronization across processes (i.e. multi-process-safe
locks and semaphores).
c t j dk rddlm} | t j | g|R i | t j | j j
dt d S )Nposixr )resource_trackerz created by pid ) rH r# rV ensure_runningr r4 r r r> r? r )r3 rL rK rV s r r4 z SharedMemoryManager.__init__3 s w'!! /..... //111 7 7 7 7 7 7 7 J$.1MM688MM N N N N Nr c d t j | j j dt d S )Nz.__del__ by pid )r r r> r? r r6 s r r> zSharedMemoryManager.__del__? s/ J$.1MM688MM N N N N Nr c | j j t j k r~| j j t j k rt d | j j t j k rt d t d | j j | | j | j
| j | j S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr )
r r r r r r
r rX r r r r r r6 s r r z SharedMemoryManager.get_serverB s { EM11;$
55&'KLLL[&%.88&'JKKK&,33DK4EFFH H H<<
$
t/?A A
Ar c , | | j | j 5 }t j dd| } t |dd|j f n(# t $ r}| |d}~ww xY w ddd n # 1 swxY w Y |S )zoReturns a new SharedMemory instance with the specified size in
bytes, to be tracked by the manager.r NT)rl sizerC ) r r r r r8 rP r#
BaseExceptionr9 )r3 r\ r smsr s r r8 z SharedMemoryManager.SharedMemoryO s dmT] CC
t#0dNNN T4 38+FFFF$ JJLLLG G
Js4 B AB
A9 A44A99B B
B
c : | | j | j 5 }t j | } t |dd|j j f n-# t $ r }|j |d}~ww xY w ddd n # 1 swxY w Y |S )zReturns a new ShareableList instance populated with the values
from the input sequence, to be tracked by the manager.r NrC )
r r r r
ShareableListrP shmr# r] r9 )r3 r r slr s r r` z!SharedMemoryManager.ShareableList[ s dmT] CC
t"0:: T4 26;.IIII$ FMMOOOG J
Is4 B AB
B A;;B BBBN) r? rA rB rC rB r r4 r> r r8 r` r r r r r ' sy %
O
O
O O O O A A A
r r r )U__all__r r r r queuer r rH r r r rW r
contextr r r
r r r r r HAS_SHMEMra ImportErrorr rK
view_typesr, view_typer r rP rI r rY rd rh rj r r r XmlListener XmlClientr} r r rP r r| r rG r r r r r r r r r r r r
r r? r
BasePoolProxyr r r$ r r r& r' r( r) r* r+ r) r r- rB r r r r <module>rm s A
@
@
@ @ @ @ @ @ @ @ @ @ * I NN()))) III2 2 2 5; - - -
N
N4M
N
N
N
3 3IIy/2222
z M M M M MF M M M. &(b ) ) ) )
I
I
I C C C C C) C C C A A AG* G* G* G* G*V G* G* G*\
F #Z%67 ):+?@ t' t' t' t' t'& t' t' t't c m= m= m= m= m= m= m= m=f: : :* )+ , 8<7< :
E
E
E
E
E
E
E
E
F
+ + + + / / / / /I / / /
+
+
+
+
+I
+
+
+ ] 6 4 4 4 4 4 4 4 4A A A A A9 A A A&1 1 1 1 1Y 1 1 1&8 8 8 8 8 8 8 8
o 0
M+ (
]< *
k ,
! " $ $
+ Wek * * * _ek 2 2 2 Wioz : : : VY^] ; ; ; Wio} = = = [)"5} E E E ')C"$ $ $ [)"5~ F F F Y 1< @ @ @ VTY 2 2 2 VT9 - - - VT9 - - - WeZ 0 0 0 WeZ 0 0 0 [)^ < < < Z= N N N ]% 8 8 8
Q"" "" "" "" "" "" "" ""J*< *< *< *< *<V *< *< *<Z> > > > >k > > > > >gQ Qs A8 8BB
Browse
Usage
Versions