python (3.12.0)
̑e
g d Z ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl
m Z ddl m
Z
ddlmZmZmZ ddl mZ dd l mZ dd
l mZ dd l mZ dd l mZ d
Ze j1 d d Z ej6 ej e dD cg c] } e e i | c} Z d Z e D ] Z ej6 e e [ [ G d de! Z"di fdZ#d Z$ G d de% Z&d Z'd Z( G d d e! Z) G d d e! Z*e
jV e
jX fe
jZ e
j\ fd Z/ G d! d"e! Z0 G d# d$e1 Z2 G d% d&e! Z3d' Z4i fd(Z5 dbd)Z6 G d* d+e! Z7 G d, d-e! Z8dcd.Z9 G d/ d0e3 Z: G d1 d2e3 Z; G d3 d4e; Z< G d5 d6e3 Z= G d7 d8e3 Z> G d9 d:e3 Z? G d; d<e3 Z@ e5d=d> ZA G d? d@eA ZB e5dAdB ZCdCdDieC_D e5dEdF ZE e5dGdH ZFdIdIdIdDdDdJeF_D G dK dGeF ZG G dL dMe0 ZHeHj7 dNej eHj7 dOej eHj7 dPej e= eHj7 dQej e; eHj7 dRej e; eHj7 dSej e; eHj7 dTej e; eHj7 dUej e< eHj7 dVej e> eHj7 dWej eG eHj7 dXeReB eHj7 dYeSeC eHj7 d-e8e@ eHj7 dZe9eE eHj7 d+e7e? eHj7 dDe:d[ eHj7 dId\ er! G d] d^ ZT G d_ d`e) ZU G da de0 ZVyy# e$ r dZY w xY wc c} w )d) BaseManager SyncManager BaseProxyToken N)getpid)
format_exc )
connection) reductionget_spawning_popen ProcessError)pool)process)util) get_context)
shared_memoryTSharedMemoryManagerFc Z t j | j | j ffS N)arraytypecodetobytes)as L/BuggyBox/python/3.12.0/bootstrap/lib/python3.12/multiprocessing/managers.py reduce_arrayr / s ;;QYY[1 11 )itemskeysvaluesc & t t | ffS r )listobjs r rebuild_as_listr$ 4 s $s) r c , e Zd ZdZdZd Zd Zd Zd Zy)r z3
Type to uniquely identify a shared object
typeidaddressidc 0 |||c| _ | _ | _ y r r& )selfr' r( r) s r __init__zToken.__init__D s 06,dlDGr c H | j | j | j fS r r& r+ s r __getstate__zToken.__getstate__G s T\\47733r c . |\ | _ | _ | _ y r r& r+ states r __setstate__zToken.__setstate__J s /4,dlDGr c | j j d| j d| j d| j dS )Nz(typeid=z
, address=z, id=)) __class____name__r' r( r) r. s r __repr__zToken.__repr__M s- ''dllDGGM Mr N) r7
__module__ __qualname____doc__ __slots__r, r/ r3 r8 r r r r > s$ ,IE45Mr r r= c x | j ||||f | j \ }}|dk( r|S t || )zL
Send a message to manager using connection `c` and return response
#RETURN)sendrecvconvert_to_error)cr)
methodnameargskwdskindresults r dispatchrI U sB FFB
D$ '(668LD& y
4
((r c | dk( r|S | dv rSt |t s%t dj || t | | dk( rt d|z S t | S t
dj | S )N#ERROR)
#TRACEBACK#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrM zUnserializable message: %s
z Unrecognized message type {!r})
isinstancestr TypeErrorformattype RemoteError
ValueError)rG rH s r rB rB _ s x
2 2&#&@GGD$v,01
1 $ $ = FG G v& &:AA$GHHr c e Zd Zd Zy)rS c > dt | j d z dz S )NzM
---------------------------------------------------------------------------
r zK---------------------------------------------------------------------------)rO rE r. s r __str__zRemoteError.__str__o s $s499Q<'886ABr N)r7 r9 r: rW r= r r rS rS n s Cr rS c | g }t | D ]+ }t | | }t | s|j | - |S )z4
Return a list of names of methods of `obj`
)dirgetattrcallableappend)r# tempnamefuncs r all_methodsr` v sB DC sD! D> KK Kr c P t | D cg c]
}|d dk7 s | c}S c c}w )zP
Return a list of names of methods of `obj` which do not start with '_'
r _)r` )r# r^ s r public_methodsrc s' ) - @TaC D @@ @s
##c e Zd ZdZg dZd Zd Zd Zd Zd Z d Z
d Z d
Z d Z
e e
e d Zd
Zd Zd Zd Zd Zd Zd Zd Zd Zy)ServerzM
Server class which runs in a process controlled by a manager object
) shutdowncreateaccept_connection get_methods
debug_infonumber_of_objectsdummyincrefdecrefc z t |t s$t dj |t | || _ t
j | | _ t | \ }} ||d | _
| j j | _ ddi| _ i | _
i | _ t j | _ y )Nz&Authkey {0!r} is type {1!s}, not bytes )r( backlog0Nr= )rN bytesrP rQ rR registryr AuthenticationStringauthkeylistener_clientlistenerr( id_to_objid_to_refcountid_to_local_proxy_obj threadingLockmutex)r+ ru r( rw
serializerListenerClients r r, zServer.__init__ s '5)8??T'],-
- !
33G< *:6& !"=
}},, z* %'" ^^%
r c t j | _ | t j _ t j | j }d|_ |j | j j s6| j j d | j j s6t j t j k7 rGt# j$ d t j t _ t j& t _ t j* d y# t t f$ r Y w xY w# t j t j k7 rGt# j$ d t j t _ t j& t _ t j* d w xY w)z(
Run the server forever
)targetTr zresetting stdout, stderrr N)r} Event
stop_eventr current_process_manager_serverThreadaccepterdaemonstartis_setwaitKeyboardInterrupt
SystemExitsysstdout
__stdout__r debug
__stderr__stderrexit)r+ r s r
serve_foreverzServer.serve_forever s $//+48 !1 ''t}}=H "HO NN
//002OO((+ //002
zzS^^+
56 ^^
^^
HHQK &z2
zzS^^+
56 ^^
^^
HHQKs+ 7E ,AD: :E E E E A?Gc | j j }t j | j
|f }d|_ |j U# t $ r Y aw xY w)NTr rE )ry acceptOSErrorr} r handle_requestr r )r+ rC ts r r zServer.accepter sa
MM((* (;(;1$GAAH
GGI
s A A#"A#c d } t j || j t j || j |j }|\ }}}}|| j
v s
J d|z t
| | } ||g|i |}d|f} |j | y # t $ r dt f} Y *w xY w# t $ r dt f} Y Ew xY w# t $ rx}
|j dt f n# t $ r Y nw xY wt j d| t j d| t j d|
Y d }
~
y d }
~
ww xY w)Nz%r unrecognizedr? rL zFailure to send message: %rz ... request was %r ... exception was %r) r
deliver_challengerw answer_challengerA publicrZ Exceptionr r@ r info) r+ rC requestignorefuncnamerE rF r_ rH msges r _handle_requestzServer._handle_request sL * ( (DLL 9 ' '4<< 8ffhG+2 (FHdDt{{* H,=,H H4*D
* a/$/$/ !&) 2
FF3K
3#Z\2
3 / .C / 2
jl34
II3S 9 II+W 5 II-q 1 1 2s[ A;B> B# C #B;:B;>CC E#C?>E? D E
D AEEc | j | |j y# t $ r Y w xY w# |j w xY w)z)
Handle a new connection
N)r r closer+ conns r r zServer.handle_request s@ &
JJL
JJLs $ 03 03 Ac $ t j dt j j |j
}|j }| j }| j j s dx}} | }|\ }}} }
|| \ }} } || vr t d|dt | d| t || } || i |
}| xr | j |d }|r4| j! ||| \ }}t# || j$ | }d||ff}nd|f} | | j j syy# t $ r.}
| j | \ }} } n# t $ r |
w xY wY d}
~
d}
~
ww xY w# t& $ r}d|f}Y d}~sd}~ww xY w# t $ rQ
d t) f}n? | j* | } || |g i
}d|f}n# t& $ r d t) f}Y nw xY wY t, $ rK t j d
t j j t/ j0 d Y &t& $ r d t) f}Y =w xY w# t& $ r |d t) f Y Uw xY w# t& $ r}t j2 d
t j j t j2 d t j2 d| |j5 t/ j0 d Y d}~d}~ww xY w)zQ
Handle requests from the proxies in a particular process/thread
z$starting server thread to service %rNzmethod z of z object is not in exposed=#PROXYr? rK rL z$got EOF -- exiting thread serving %rr rM z exception in thread serving %rz ... message was %rr r )r r r} current_threadr^ rA r@ rz r r KeyErrorr| AttributeErrorrR rZ getrg r r( r r fallback_mappingEOFErrorr r r r )r+ r rA r@ rz rD r# r identrE rF exposed gettypeidkefunctionresr' ridentrexposedtokenr r
fallback_funcrH s r serve_clientzServer.serve_client s
9 ++-22 4 yyyyNN //((*5
3#''
S &07-z4!.7.>+C) W,(#T#Y9
#3
3 /"D1D1C ' J9==T+JF +/;;tVS+I( %fdllF C '(E): ; (# ..
<Iw //((* !! 6 6u = 0Wi# ! ! '0!" ! (#Q-C( "
; %' 6C;(,(=(=j(I
!. $s" 59" =A" )& 1$ ; +Z\ :;
A$335::<
3#Z\2
3 ! <+Z\:;<
:!002779 /5 115
s 2F D< -F <E6 AF I < E3EE. E&&E.)F .E33F 6 F
?FF F
F I)"G I G$!I#G$$I)AI;III51I8 4I55I8 8 LBL
Lc |S r r= r+ r r r# s r fallback_getvaluezServer.fallback_getvalue? s
r c t | S r rO r s r fallback_strzServer.fallback_strB s 3xr c t | S r )reprr s r
fallback_reprzServer.fallback_reprE s Cyr )rW r8 #GETVALUEc y r r= r+ rC s r rl z Server.dummyN s r c
r | j 5 g }t | j j }|j |D ]K }|dk7 s |j d|d| j | dt
| j | d dd M dj | cddd S # 1 sw Y yxY w) zO
Return some info --- useful to spot problems with refcounting
rr z z: refcount=z
r NK
) r r! r{ r sortr\ rO rz join)r+ rC rH r r s r rj zServer.debug_infoQ s
ZZ %F++0023D IIK
HC<MM#($*=*=e*D#&t~~e'<Q'?#@"#E#G H
H
99V$ % % %s A B-AB--B6c , t | j S )z*
Number of shared objects
)lenr{ r s r rk zServer.number_of_objectsa s
4&&''r c t j d |j d | j
j
y# ddl}|j Y 3xY w# | j
j
w xY w)z'
Shutdown this process
z!manager received shutdown messager? Nr N)r r r@ traceback print_excr set)r+ rC r s r rf zServer.shutdownh sZ " JJ: ;
FF$ %
OO ! " ! OO !s &A AA A:c n | j 5 | j | \ }}}}|!|st | dk7 r t d |d } n ||i |} | t | }|Kt |t s$t dj |t | t | t | z }dt | z }
t j d||
| t | |f| j |
< |
| j vrd| j |
< ddd | j# |
|
t% fS # 1 sw Y (xY w)z>
Create a new shared object and return its id
Nr z4Without callable, must have one non-keyword argumentr z,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)r ru r rT rc rN dictrP rQ rR r! r) r r r rz r{ rm tuple) r+ rC r' rE rF r[ r method_to_typeid proxytyper# r s r rg z
Server.createu sM ZZ /mmF+
;Hg / CIN$NP P1g --(- +!"2D9#FMM ,d3C.DFG G w-$/?*@@2c7NE JJ? O%(#g,8H$IDNN5 !D / //-.##E*7 /:
Au eGn$$= / /s C7D++D4c L t | j |j d S )zL
Return the methods of the shared object indicated by token
r )r rz r) )r+ rC r s r ri zServer.get_methods s! T^^EHH-a011r c z |t j _ |j d | j | y)z=
Spawn a new thread to serve this connection
r N)r} r r^ r@ r )r+ rC r^ s r rh zServer.accept_connection s0 +/ "' ! ! r c F | j 5 | j |xx dz
cc< d d d y # t $ r\}|| j v rBd| j |< | j | | j |< t j d| n|Y d }~id }~ww xY w# 1 sw Y y xY w)Nr z&Server re-enabled tracking & INCREF %r)r r{ r r| rz r r )r+ rC r r s r rm z
Server.incref s
ZZ
##E*a/*
D 6 6612D''. 2259 NN5)JJ GO H P
s, B/ BAB
BBBB c l || j vr%|| j v rt j d| y | j 5 | j | dk r6t dj
|| j | | j | | j |xx dz cc< | j | dk( r
| j |= d d d || j vrHd| j |< t j d| | j 5 | j |= d d d y y # 1 sw Y `xY w# 1 sw Y y xY w)NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr= Nzdisposing of obj with id %r)r{ r| r r r AssertionErrorrQ rz )r+ rC r s r rn z
Server.decref s0 ++ + T// / JJ2E :
ZZ /""5)Q.$AHH t~~e 4 ++E245 5
&! + &""5)Q.''. / ++ + %5DNN5 ! JJ4e <
*NN5)
*
* , / /$
*
*s A?D D* D'*D3N)r7 r9 r: r; r r, r r r r r r r r r rl rj rk rf rg ri rh rm rn r= r r re re s NF&$, 2<
O b %
% ( ""%H2 "*r re c e Zd ZdgZdZdZdZy)Statevaluer r N)r7 r9 r: r< INITIALSTARTEDSHUTDOWNr= r r r r s IGGHr r )pickle xmlrpclibc e Zd ZdZi ZeZ ddddZd Zd Z ddZ
e dd Z d
Z
dd Zd Zd
Zd Zd Zed Zed Ze dd Zy)r z!
Base class for managers
Ng ?)shutdown_timeoutc P | t j j }|| _ t j | | _ t
| _ t j | j _ || _
t | \ | _ | _
|xs
t | _ || _ y r )r r rw _addressrv _authkeyr _stater r _serializerrx _Listener_Clientr _ctx_shutdown_timeout)r+ r( rw r ctxr s r r, zBaseManager.__init__ s~ ? --/77G
44W=
g !MM %'6z'B$ (;= !1 r c | j j t j k7 r| j j t j k( r t d | j j t j k( r t d t dj | j j t | j | j | j | j S )zX
Return server object with serve_forever() method and address attribute
Already started serverManager has shut downUnknown state {!r})
r r r r r r
r rQ re _registryr r r r. s r
get_serverzBaseManager.get_server s ;;
-{{ EMM1"#;<<""enn4"#:;;"(// 0A0ABD DdnndmmmmT%5%57 7r c t | j \ }} || j | j }t |dd t
j | j _ y)z>
Connect manager object to the server process
rw Nrl ) rx r r r rI r r r r )r+ r r r s r connectzBaseManager.connect sI +4+;+;<&dmmT]];tW% !MM r c
| j j t j k7 r| j j t j k( r t d | j j t j k( r t d t dj | j j |t | s t d t j d \ }}| j j t | j | j | j" | j$ | j& |||f | _ d j+ d
| j( j, D }t | j. d z |z | j( _ | j( j3 |j5 |j7 | _ |j5 t j | j _ t9 j: | t | j< | j( | j" | j$ | j | j> | j@ fd
| _! y)z@
Spawn a server process for this manager object
r r r Nz initializer must be a callableF)duplexr :c 3 2 K | ] }t | y wr r ).0is r <genexpr>z$BaseManager.start.<locals>.<genexpr>0 s AAQAs -r rE exitpriority)"r r r r r r
r rQ r[ rP r
Piper ProcessrR _run_serverr r r r _processr _identityr7 r^ r r rA r Finalize_finalize_managerr r rf )r+ initializerinitargsreaderwriterr s r r zBaseManager.start s ;;
-{{ EMM1"#;<<""enn4"#:;;"(// 0A0ABD D "8K+@ <= = $ 6 )):))..$-- ""FKC *
A )@)@AA !$Z 0 0C 7% ?
"MM
$t*..--
t{{,, 6 68
r c T t j t j t j | || | j |||| }|j |j
|j
t j d|j
|j y)z@
Create a server, report its address and run it
Nzmanager serving at %r)
signalSIGINTSIG_IGN_Serverr@ r( r r r r ) clsru r( rw r r r r servers r r zBaseManager._run_serverB sz
fmmV^^4 " " XwD FNN#
)6>>: r c V | j j t j k( sJ d | j | j
| j } t |dd|f|z | \ }}|j t || j
| |fS # |j w xY w)zP
Create a new shared object; return the token and exposed tuple
zserver not yet startedr Nrg )
r r r r r r r rI r r )r+ r' rE rF r r) r s r _createzBaseManager._createY s {{ EMM1K3KK||DMM4==|A "4x&4 NKB JJLVT]]B/88
JJLs B B(c | j >| j j | | j j sd| _ yyy)zC
Join the manager process (if it has been spawned)
N)r r is_aliver+ timeouts r r zBaseManager.joine sA == $ MM w '==))+ $
, %r c | j | j | j } t |dd |j S # |j w xY w)zS
Return some info about the servers shared objects and connections
r Nrj r r r rI r r s r _debug_infozBaseManager._debug_infon sB ||DMM4==|A D$ 5 JJLDJJL A Ac | j | j | j } t |dd |j S # |j w xY w)z5
Return the number of shared objects
r Nrk r& r s r _number_of_objectsz BaseManager._number_of_objectsx sC ||DMM4==|A D$(;< JJLDJJLr( c | j j t j k( r| j | j j t j
k7 r| j j t j k( r t
d | j j t j k( r t
d t
dj | j j | S )NzUnable to start serverr r ) r r r r r r r
r rQ r. s r __enter__zBaseManager.__enter__ s ;;
- JJL ;;
-{{ EMM1"#;<<""enn4"#:;;"(// 0A0ABD D r c $ | j y r )rf r+ exc_typeexc_valexc_tbs r __exit__zBaseManager.__exit__ s
r c | j rt j d ||| } t |dd |j | j | | j rt j d t | d rt j d | j | j | | j r7t j d | j | j t j |_ t j |= y# |j w xY w# t
$ r Y w xY w# t $ r Y yw xY w)
zQ
Shutdown the manager process; will be registered as a finalizer
z#sending shutdown message to managerr Nrf )r$ zmanager still alive terminatez'trying to `terminate()` manager processz#manager still alive after terminate)r" r r rI r r r hasattrr4 killr r r r _address_to_localr )r r( rw r2 r r r s r r z BaseManager._finalize_manager s* 7 II; <
w8! T44JJL
GLL!1 2 w ! /07K0II GH%G%%' GLL)9:'w'') "GH$ $ nn ++G4% JJL
$ s:
E
E E .E% EE E"!E"% E10E1c | j S r )r r. s r r( zBaseManager.address s }} r c d| j vr | j j | _ t |xs
t dd }|xs
t dd }|rWt |j
D ]; \ }}t | t u s
J d|z t | t u r3J d|z |||f| j < |rfd} | _ t | | yy)z9
Register a typeid with the manager type
r N _exposed__method_to_typeid_z%r is not a stringc ( t j d | j g|i |\ }} || j | | j | }| j |j | j }t |d d|j f |S )Nz)requesting creation of a shared %r objectmanagerrw r r rn ) r r r r r r r( rI r) ) r+ rE rF r expproxyr r r' s r r] z"BaseManager.register.<locals>.temp s
FO )T\\& @4 @4 @
s!4++T MM3 ||EMM4==|ItX{; r ) __dict__r copy AutoProxyrZ r! r rR rO r7 setattr)
r r' r[ r r r
create_methodkeyr r] s
` ` r registerzBaseManager.register s cll * MM . . 0CM !IBWY T B+ J"9.BDI "#3#9#9#; <
H
UCyC'C)=)CCE{c)G+?%+GG
H
g /!
f
#DM C & r )NNr Nrs r )NNNNT)r7 r9 r: r; r re r r, r r r classmethodr r r r' r* r, r2 staticmethodr propertyr( rG r= r r r r s IG>F 2/2 2
7 *)V /1 ,
9% D EI6:%' %'r r c e Zd Zd Zd Zy)ProcessLocalSetc 2 t j | d y )Nc " | j S r )clearr" s r <lambda>z*ProcessLocalSet.__init__.<locals>.<lambda> s 399; r )r register_after_forkr. s r r, zProcessLocalSet.__init__ s '>?r c t | dfS rs )rR r. s r
__reduce__zProcessLocalSet.__reduce__ s Dz2~ r N)r7 r9 r: r, rS r= r r rL rL s
@ r rL c e Zd ZdZi Z ej Z ddZd Z di fdZ
d Z d Z e
d Zd
Zd Zd Zd
Zd Zy)r z.
A base for proxies of shared objects
Nc t j 5 t j j |j d }|;t j t f}|t j |j < d d d d | _ |d | _ || _
| j j | _ || _
|| _ t | d | _ || _ |t% j& | | _ nK| j | j j( | _ n#t% j* j, | _ |r| j/ t j0 | t j2 y # 1 sw Y xY w)Nr r )r _mutexr7 r r( r ForkAwareLocalrL _tls_idset_tokenr) _id_managerr rx r _owned_by_managerr rv r r rw _increfrQ _after_fork) r+ r r r> rw r rm
manager_owned tls_idsets r r, zBaseProxy.__init__ s6
G!3377
tLI / / 1?3D D =F ++EMM: G aL
l ;;>>
%&z215 "/ # 8 8 ADM
]]
& MM 2 2DM # 3 3 5 = =DM LLN y'<'<=K G Gs A(E<<Fc t j d t j j }t j j dk7 r$|dt j j z z
}| j | j j | j }t |d d|f || j _
y )Nz making connection to manager
MainThread|r rh )r r r r r^ r} r r rZ r( r rI rX r
)r+ r^ r s r _connectzBaseProxy._connect s
12&&(-- # # % * *l : C)224999 9D||DKK / / |Gt 04': # r r= c | j j }|j | j |||f |j \ }}|dk( r|S |dk( r|\ }}| j j |j d } | j j |_ | || j" | j | j$ | }
| j' |j | j$ }t) |dd|j* f |
S t- || # t $ r\ t j dt j j | j | j j }Y aw xY w) zV
Try to call a method of the referent and return a copy of the result
z#thread %r does not own a connectionr? r r= r Nrn )rX r
r r r r} r r^ re r@ r[ rA r\ r r' rZ r( r r r rI r) rB ) r+ rD rE rF r rG rH r r r r@ s r _callmethodzBaseProxy._callmethod( s< (99''D
488Zt45yy{ f 9 M
X
#NGU
// =bAI KK / /EM t''
wE <<
t}}<ED T4EHH; 7L tV,,- ( JJ< //166
8 MMO99''D (s D A!E:9E:c $ | j d S )z9
Get a copy of the value of the referent
r rh r. s r _getvaluezBaseProxy._getvalueF s ,,r c
| j r+t j d| j j y | j | j j | j }t |d d| j f t j d| j j | j j | j | j xr | j j }t j | t j | j | j || j" | j | j
fd | _ y )Nz%owned_by_manager skipped INCREF of %rr rm z INCREF %r
r )r] r r rZ r) r r( r rI r[ rY addr\ r r r _decrefrX _close)r+ r r2 s r r^ zBaseProxy._increfL s ! ! JJ> O ||DKK / / |GtX{3
; / !
6$--"6"6mm )##++t}}e))T[[$,,8 r c j |j | j | |j t j k( rO t j d| j || j | }t |d d| j f n t j d| j |s\t |d rOt j dt j j |j j |`y y y # t $ r }t j d| Y d }~d }~ww xY w)Nz DECREF %rr rn z... decref failed %sz%DECREF %r -- manager already shutdownr
z-thread %r has no more proxies so closing conn)discardr) r r r r r r( rI r r5 r} r r^ r
r )r rw r2 tlsidsetr r r s r ro zBaseProxy._decref` s
ehh =EKK5== 8
6
;1 u}}g>tX{;
JJ> I l3 JJF //166
8 NN " 4u
6
1155
6s A
D D2D--D2c d | _ | j y # t $ r"}t j d|z Y d }~y d }~ww xY w)Nzincref failed: %s)r\ r^ r r r )r+ r s r r_ zBaseProxy._after_forky s<
/ LLN / II)A- . . /s AA Ac
i }t | j |d< t | dd r3| j |d< t t
| j | j |ffS t t | | j | j |ffS )Nrw _isautoFr ) r r rZ r: RebuildProxyrC rZ r rR r+ rF s r rS zBaseProxy.__reduce__ s + "mmDO 4E * "nnDO T-=-=tDF
F !$Zd.>.>EG
Gr c " | j S r )rk )r+ memos r __deepcopy__zBaseProxy.__deepcopy__ s ~~ r c r dt | j | j j t | fz S )Nz <%s object, typeid %r at %#x>)rR r7 rZ r' r) r. s r r8 zBaseProxy.__repr__ s3 .T
##T[[%7%7DBC Cr c f | j d S # t $ r t | dd dz cY S w xY w)zV
Return representation of the referent (or a fall-back if that fails)
r8 Nrg z; '__str__()' failed>)rh r r r. s r rW zBaseProxy.__str__ s= =##J/ / =:cr?%<< < =s 00NNNTF)r7 r9 r: r; r7 r ForkAwareThreadLockrV r, re rh rk r^ rI ro r_ rS r| r8 rW r= r r r r su
%T
%
%
'F26HM'>R$ ,.B -<- ( 0/ G C=r r c t t j dd }|r||j |j k( rct j
d| d|d< |j |j vr0|j |j |j |j < |j dd xr t t j dd } | ||fd|i|S ) z5
Function used for unpickling proxy objects.
r Nz*Rebuild a proxy owned by manager, token=%rTr` rm _inheritingF)
rZ r r r( r r r) r| rz pop)r_ r r rF r rm s r rx rx s W,,.0A4
HF
&..EMM1
?G $_ 88677 7 *
( ( 2
4 E G++-}e DD z 9& 9D 99r c t | } || |f S # t $ r Y nw xY wi }|D ] }t d|d|d| t | t f| }||_ ||| |f< |S )zB
Return a proxy type whose methods are given by `exposed`
zdef z:(self, /, *args, **kwds):
return self._callmethod(z
, args, kwds))r r execrR r r: )r^ r _cachedicmeth ProxyTypes r
MakeProxyTyper s GnG
tWo&&
C H 6:DBCF HH TI<-I!I 'FD'? s c p t | d }|4 || j | } t |dd| f }|j || |j }| t j j }t d| j z | } | | ||||| }
d|
_
|
S # |j w xY w)z*
Return an auto-proxy for `token`
r Nr ri z
AutoProxy[%s])r> rw rm r` T) rx r( rI r r r r rw r r' rw ) r r r> rw r rm r` r r r r@ s r rC rC s
j)!,Gu}}g6 tT=5(CG JJL7.""))+33 o <gFI eZ' #=
BEEM L
JJLs B# #B5c e Zd Zd Zd Zy) Namespacec : | j j | y r )rA updatery s r r, zNamespace.__init__ s
T"r c & t | j j }g }|D ]- \ }}|j d r|j |d| / |j | j j ddj | dS )Nrb =(, r5 ) r! rA r
startswithr\ r r6 r7 r )r+ r r] r^ r s r r8 zNamespace.__repr__ sv T]]((*+ 5KD%??3' tU 34 5
>>22DIIdODDr N)r7 r9 r: r, r8 r= r r r r s
#Er r c 8 e Zd ZddZd Zd Zd Z eee Zy)Valuec || _ || _ y r ) _typecode_value)r+ r r locks r r, zValue.__init__ s ! r c | j S r r r. s r r z Value.get s {{r c || _ y r r r+ r s r r z Value.set s r c f t | j d| j d| j dS )Nr r r5 )rR r7 r r r. s r r8 zValue.__repr__ s! !$Z 0 0$..$++NNr NT) r7 r9 r: r, r r r8 rJ r r= r r r r s# O S# Er r c . t j | | S r )r )r sequencer s r Arrayr s ;;x **r c . e Zd ZdZd Zd Zd Zd Zd Zy)
IteratorProxy)__next__r@ throwr c | S r r= r. s r __iter__zIteratorProxy.__iter__ r c & | j d| S )Nr rj r+ rE s r r zIteratorProxy.__next__
s
D11r c & | j d| S )Nr@ rj r s r r@ zIteratorProxy.send s --r c & | j d| S )Nr rj r s r r zIteratorProxy.throw ..r c & | j d| S )Nr rj r s r r zIteratorProxy.close r r N) r7 r9 r: r: r r r@ r r r= r r r r s 6I2.//r r c * e Zd ZdZddZd Zd Zd Zy)
AcquirerProxy)acquirereleaseNc 8 ||fn||f}| j d| S Nr rj )r+ blockingr$ rE s r r zAcquirerProxy.acquire s' %o{Hg3F 400r c $ | j d S Nr rj r. s r r zAcquirerProxy.release **r c $ | j d S r rj r. s r r, zAcquirerProxy.__enter__ r r c $ | j d S r rj r. s r r2 zAcquirerProxy.__exit__ r r )TN)r7 r9 r: r: r r r, r2 r= r r r r s &I1+++r r c . e Zd ZdZddZddZd ZddZy) ConditionProxy)r r r notify
notify_allNc ( | j d|f S Nr rj r# s r r zConditionProxy.wait&
33r c ( | j d|f S )Nr rj )r+ ns r r zConditionProxy.notify( s 1$//r c $ | j d S )Nr rj r. s r r zConditionProxy.notify_all* s --r c | }|r|S |t j |z }nd }d }|s<| |t j z
}|dk r |S | j | }|s<|S )Nr )time monotonicr )r+ predicater$ rH endtimewaittimes r wait_forzConditionProxy.wait_for, s~ M nn&0GGH""T^^%55q=
IIh [F
r r )r )r7 r9 r: r: r r r r r= r r r r $ s FI40.r r c * e Zd ZdZd Zd Zd ZddZy)
EventProxy)r r rO r c $ | j d S )Nr rj r. s r r zEventProxy.is_setA s ))r c $ | j d S Nr rj r. s r r zEventProxy.setC &&r c $ | j d S )NrO rj r. s r rO zEventProxy.clearE ((r Nc ( | j d|f S r rj r# s r r zEventProxy.waitG r r r )r7 r9 r: r: r r rO r r= r r r r ? s 2I*')4r r c T e Zd ZdZd dZd Zd Zed Zed Z ed Z
y)
BarrierProxy)__getattribute__r abortresetNc ( | j d|f S r rj r# s r r zBarrierProxy.waitM r r c $ | j d S )Nr rj r. s r r zBarrierProxy.abortO r r c $ | j d S )Nr rj r. s r r zBarrierProxy.resetQ r r c & | j dd S )Nr )partiesrj r. s r r zBarrierProxy.partiesS s 2LAAr c & | j dd S )Nr ) n_waitingrj r. s r r zBarrierProxy.n_waitingV s 2NCCr c & | j dd S )Nr )brokenrj r. s r r zBarrierProxy.brokenY s 2K@@r r ) r7 r9 r: r: r r r rJ r r r r= r r r r K sR >I4))
B B
D D
A Ar r c " e Zd ZdZd Zd Zd Zy)NamespaceProxy)r __setattr__ __delattr__c ~ |d dk( rt j | | S t j | d } |d|f S )Nr rb rh r )objectr r+ rF
callmethods r __getattr__zNamespaceProxy.__getattr__` sB q6S=**45 5,,T=A
,sf55r c |d dk( rt j | || S t j | d } |d||f S )Nr rb rh r )r r r )r+ rF r r s r r zNamespaceProxy.__setattr__e sE q6S=%%dC7 7,,T=A
-#u 66r c ~ |d dk( rt j | | S t j | d } |d|f S )Nr rb rh r )r r r r s r r zNamespaceProxy.__delattr__j sA q6S=%%dC0 0,,T=A
-#00r N)r7 r9 r: r: r r r r= r r r r ^ s BI6
7
1r r c R e Zd ZdZd Zd Z eee Z ee j Z y)
ValueProxy)r r c $ | j d S )Nr rj r. s r r zValueProxy.gets r r c ( | j d|f S r rj r s r r zValueProxy.setu s x00r N) r7 r9 r: r: r r rJ r rH types GenericAlias__class_getitem__r= r r r r q s. I'1 S# E#E$6$67r r
BaseListProxy)__add__ __contains__ __delitem__ __getitem____len____mul__ __reversed____rmul__ __setitem__r\ countextendindexinsertr removereverser __imul__c e Zd Zd Zd Zy) ListProxyc , | j d|f | S )Nr rj r s r __iadd__zListProxy.__iadd__ s E8, r c , | j d|f | S )Nr rj r s r r zListProxy.__imul__ s eX. r N)r7 r9 r: r r r= r r r r s r r DictProxy)r r r r r r rO rB r r r r popitem
setdefaultr r r Iterator
ArrayProxy)r r r PoolProxy) apply apply_asyncr imapimap_unorderedr map map_asyncstarmap
starmap_asyncr4 AsyncResult)r r r r r c e Zd Zd Zd Zy)r c | S r r= r. s r r, zPoolProxy.__enter__ r r c $ | j y r )r4 r. s r r2 zPoolProxy.__exit__ s r N)r7 r9 r: r, r2 r= r r r r s r c e Zd ZdZy)r a(
Subclass of `BaseManager` which supports a number of shared object types.
The types registered are those intended for the synchronization
of threads, plus `dict`, `list` and `Namespace`.
The `multiprocessing.Manager()` function creates started instances of
this class.
N)r7 r9 r: r; r= r r r r s r r Queue
JoinableQueuer r~ RLock SemaphoreBoundedSemaphore ConditionBarrierPoolr! r r )r rE )rE c > e Zd ZdZg fdZd Zd Zd Zd Zd Z d Z
y )
_SharedMemoryTrackerz+Manages one or more shared memory segments.c || _ || _ y r shared_memory_context_name
segment_names)r+ r^ r- s r r, z _SharedMemoryTracker.__init__ s .2D +!.D r c t j d|dt | j j | y)z6Adds the supplied shared memory block name to tracker.zRegister segment in pid N)r r r r- r\ r+ segment_names r register_segmentz%_SharedMemoryTracker.register_segment s3 JJ*<*:(68*M N % %l 3r c t j d|dt | j j | t j | }|j |j y)zCalls unlink() on the shared memory block with the supplied name
and removes it from the list of blocks being tracked.zDestroy segment r/ N) r r r r- r r SharedMemoryr unlink)r+ r1 segments r destroy_segmentz$_SharedMemoryTracker.destroy_segment sX
JJ),)9&(L M % %l 3#00 >G MMO NN r c N | j dd D ] }| j | y)z<Calls destroy_segment() on all tracked shared memory blocks.N)r- r7 r0 s r r5 z_SharedMemoryTracker.unlink s* $ 2 21 5
3 $$\2
3r c t j d| j j dt | j y )NzCall z .__del__ in )r r r6 r7 r r5 r. s r __del__z _SharedMemoryTracker.__del__ s1 JJt~~ 6 6 7|FH:N O KKMr c 2 | j | j fS r r+ r. s r r/ z!_SharedMemoryTracker.__getstate__ s 33T5G5GH Hr c " | j | y r )r, r1 s r r3 z!_SharedMemoryTracker.__setstate__ s DMM5 !r N) r7 r9 r: r; r, r2 r7 r5 r: r/ r3 r= r r r) r) s, 5/1 / 4
3
I "r r) c R e Zd Zej g dz Zd Zd Zd Zd Zd Z d Z
y) SharedMemoryServer)
track_segmentrelease_segment
list_segmentsc t j | g|i | | j }t |t rt j | }t d| dt | _ t j dt y )Nshm_rb z"SharedMemoryServer started by pid ) re r, r( rN rt osfsdecoder) r shared_memory_contextr r )r+ rE kwargsr( s r r, zSharedMemoryServer.__init__ sn OOD 24 26 2llG'5) ++g.$tG9AfhZ%@A
& JJ;FH:F Gr c t | j | d d r| j |d< t j | ||g|i |S )zCreate a new distributed-shared object (not backed by a shared
memory block) and return its id to be used in a Proxy Object.rg _shared_memory_proxyrF )r5 ru rF re rg )r+ rC r' rE rG s r rg zSharedMemoryServer.create sK t}}V,R02HI262L2L./==q&B4B6B Br c b | j j t j | | S )zACall unlink() on all tracked shared memory, terminate the Server.)rF r5 re rf r s r rf zSharedMemoryServer.shutdown s% & & - - /??4+ +r c : | j j | y)z?Adds the supplied shared memory block name to Server's tracker.N)rF r2 r+ rC r1 s r r? z SharedMemoryServer.track_segment s & & 7 7 Er c : | j j | y)zCalls unlink() on the shared memory block with the supplied name
and removes it from the tracker instance inside the Server.N)rF r7 rL s r r@ z"SharedMemoryServer.release_segment s
& & 6 6| Dr c . | j j S )zbReturns a list of names of shared memory blocks that the Server
is currently tracking.)rF r- r s r rA z SharedMemoryServer.list_segments s --;; ;r N) r7 r9 r: re r r, rg rf r? r@ rA r= r r r> r> s6 FG H C ,
F E
<r r> c 2 e Zd ZdZeZd Zd Zd Zd Z d Z
y)r a Like SyncManager but uses SharedMemoryServer instead of Server.
It provides methods for creating and returning SharedMemory instances
and for creating a list-like object (ShareableList) backed by shared
memory. It also provides methods that create and return Proxy Objects
that support synchronization across processes (i.e. multi-process-safe
locks and semaphores).
c t j dk( rddlm} |j t j | g|i | t j | j j dt y )Nposixr )resource_trackerz created by pid ) rD r^ rR ensure_runningr r, r r r6 r7 r )r+ rE rG rR s r r, z SharedMemoryManager.__init__2 s\ ww'! / //1 7 7 7 JJ$..1122B68*M Nr c p t j | j j dt y )Nz.__del__ by pid )r r r6 r7 r r. s r r: zSharedMemoryManager.__del__> s' JJ$..1122B68*M Nr c | j j t j k7 r| j j t j k( r t d | j j t j k( r t d t dj | j j | j | j | j | j | j S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr )
r r r r r r
r rQ r r r r r r. s r r z SharedMemoryManager.get_serverA s {{ EMM1;;$$
5&'KLL[[&&%..8&'JKK&,33DKK4E4EFH H<<
$
t/?/?A
Ar c , | j | j | j 5 }t j dd| } t |dd|j f ddd |S # t $ r}|j |d}~ww xY w# 1 sw Y S xY w)zoReturns a new SharedMemory instance with the specified size in
bytes, to be tracked by the manager.r NT)rg sizer? ) r r r r r4 rI r^
BaseExceptionr5 )r+ rX r smsr s r r4 z SharedMemoryManager.SharedMemoryN s dmmT]] C
t#00dN T4 388+F
J % JJLG
Js) B A&& B/BBB Bc N | j | j | j 5 }t j | } t |dd|j j f ddd |S # t $ r!}|j j |d}~ww xY w# 1 sw Y S xY w)zReturns a new ShareableList instance populated with the values
from the input sequence, to be tracked by the manager.r Nr? )
r r r r
ShareableListrI shmr^ rY r5 )r+ r r slr s r r\ z!SharedMemoryManager.ShareableListZ s dmmT]] C
t"00: T4 266;;.I
I % FFMMOG
Is( B#A-- B6 BBBB$N) r7 r9 r: r; r> r r, r: r r4 r\ r= r r r r & s* %
O O A
r r r )W__all__r r} r r queuer r rD r r r rS r
contextr r r
r r r r r HAS_SHMEMr\ ImportErrorr rG rR rZ
view_typesr$ view_typer r rI rB r rS r` rc re r r r XmlListener XmlClientrx r r rL r rx r rC r r r r r r r r r r r r r
r; r
BasePoolProxyr r r r r~ r" r# r$ r% r& r' r! r r) r> r )r^ s 0r <module>ri sW A
@ @ * I NN() 2 5;; -4M
NDd$72t$&'
N
3IIy/23
z MF M. &(b )
I C) C AF*V F*Z
F ##Z%6%67 )):+?+?@t'& t't c m= m=f:* )+ , 8<7<:
E
E
F
+ /I /
+I
+] 6 4 4A9 A&1Y 1&8 8 o 0
+ (
< *
k ,
! " $
+ Wekk * _ekk 2 Wiooz : VY^^] ; Wioo} = [)"5"5} E ')C)C"$ [)"5"5~ F Y 1 1< @ VTYY 2 VT9 - VT9 - WeZ 0 WeZ 0 [)^ < Z= N ]% 8
"" ""J*<V *<Z>k >g
]% I Os O; P ;PP
Browse
Usage
Versions