python (3.11.7)
e d Z dZddlZddlZddlmZ ddlmZ ddlm Z G d d e
Z G d
d e
Z i a
d ZdS )
a A bottom-up tree matching algorithm implementation meant to speed
up 2to3's matching process. After the tree patterns are reduced to
their rarest linear path, a linear Aho-Corasick automaton is
created. The linear automaton traverses the linear paths from the
leaves to the root of the AST and returns a set of nodes for further
matching. This reduces significantly the number of candidate nodes.z+George Boutsioukis <gboutsioukis@gmail.com> N) defaultdict )pytree) reduce_treec 6 e Zd ZdZ ej Zd ZdS )BMNodez?Class for a node of the Aho-Corasick automaton used in matchingc l i | _ g | _ t t j | _ d| _ d S )N )transition_tablefixersnextr countidcontentselfs G/BuggyBox/python/3.11.7/bootstrap/lib/python3.11/lib2to3/btm_matcher.py__init__zBMNode.__init__ s- " v|$$ N)__name__
__module__ __qualname____doc__ itertoolsr r r r r r s8 II IO E r r c 0 e Zd ZdZd Zd Zd Zd Zd ZdS )
BottomMatcherzgThe main matcher class. After instantiating the patterns should
be added using the add_fixer methodc t | _ t | _ | j g| _ g | _ t
j d | _ d S )NRefactoringTool) setmatchr rootnodesr logging getLoggerloggerr s r r zBottomMatcher.__init__ sA UU
HH i[
'(9:: r c | j | t |j }| }| || j }|D ] }|j | dS )zReduces a fixer's pattern tree to a linear path and adds it
to the matcher(a common Aho-Corasick automaton). The fixer is
appended on the matching states and called when they are
reachedstartN)r appendr pattern_treeget_linear_subpatternaddr" )r fixertreelinear match_nodes
match_nodes r add_fixerzBottomMatcher.add_fixer% s
5!!!5-..++--hhvTYh77 % , ,J $ $U + + + + , ,r c |s|gS t |d t r\g }|d D ]O}| || }|D ]3}| | |dd | 4P|S |d |j vr t }||j |d < n|j |d }|dd r | |dd | }n|g}|S )z5Recursively adds a linear pattern to the AC automatonr r( r N)
isinstancetupler- extendr r )r patternr) r1 alternative end_nodesend next_nodes r r- zBottomMatcher.add1 s& 7N gaj% ( ( K &qz
C
C !HH[H > > $ C CC &&txx S'A'ABBBBC qz!777 "HH 5>&wqz22 " 271: > qrr{
( HHWQRR[ H B B &K r c 6 | j }t t }|D ]}|}|rd|_ |j D ]0}t |t j r|j dk r d|_ n1|j dk r|j }n|j }||j
v r3|j
| }|j D ] }|| | nV| j }|j
|j
j rnD||j
v r2|j
| }|j D ] }|| | |j
}||S )au The main interface with the bottom matcher. The tree is
traversed from the bottom using the constructed
automaton. Nodes are only checked once as the tree is
retraversed. When the automaton fails, we give it one more
shot(in case the above tree matches as a whole with the
rejected leaf), then we break for the next leaf. There is the
special case of multiple arguments(see code comments) where we
recheck the nodes
Args:
The leaves of the AST tree to be matched
Returns:
A dictionary of node matches with fixers as the keys
T;Fr )r" r list was_checkedchildrenr5 r Leafvaluetyper r r* parent) r leavescurrent_ac_noderesultsleafcurrent_ast_nodechild
node_tokenr. s r runzBottomMatcher.runS s ) d## # ; # ;D # " !
;/3 , - 6 E!%55 %+:L:L7<(4 #(A--!1!7JJ!1!6J !AAA&5&Fz&RO!0!7 @ @ --.>????@ '+iO(/; , 3 ? < "_%EEE*9*J:*V%4%; D DE #EN 1 12B C C C C#3#: C # !
;D r c n t d fd | j t d dS )z<Prints a graphviz diagram of the BM automaton(for debugging)z
digraph g{c
" | j D ]s}| j | }t d| j |j t | t |j fz |dk rt |j | td S )Nz%d -> %d [label=%s] //%sr )r keysprintr type_reprstrr r )node subnode_keysubnode
print_nodes r rW z*BottomMatcher.print_ac.<locals>.print_node s # 4 9 9 ; ;
$
$ / <0w
Ik,B,BCDWDWXY Z Z Z !##'/***
7####
$
$r }N)rQ r" )r rW s @r print_aczBottomMatcher.print_ac sM
l $ $ $ $ $
49
c
r N) r r r r r r3 r- rM rY r r r r r sk + +; ; ;
,
,
, D6 6 6p r r c t sGddlm} |j D ]'\ }}t | t k r
|t |< (t | | S )Nr )python_symbols) _type_reprspygramr[ __dict__itemsrD int
setdefault)type_numr[ namevals r rR rR sq 9****** (06688 9 9ID#CyyC DS!1 ! !(H 5 55r )r
__author__r$ r collectionsr r
r btm_utilsr objectr r r\ rR r r r <module>ri s G G ;
# # # # # # " " " " " " V } } } } }F } } }@ 6 6 6 6 6r 
Browse
Usage
Versions