ikan Uploader :
Directory : /opt/alt/python37/lib64/python3.7/idlelib/__pycache__/
Upload File : |
| Current File : //opt/alt/python37/lib64/python3.7/idlelib/__pycache__/pyparse.cpython-37.pyc |
B
� f�M � @ s d Z ddlZed�\ZZZZZe�dej ej
B �j Z e�dej �j
Ze�dej ejB �j
Ze�dej �j
Ze�dej �j
Ze�d ej �j
ZG d
d � d e�Ze�ed �d
�Ze�dd� dD �� e�dd� dD �� e�dd� dD �� G dd� d�Zedk�rddlm Z e ddd� dS ) a� Define partial Python code Parser used by editor and hyperparser.
Instances of ParseMap are used with str.translate.
The following bound search and match functions are defined:
_synchre - start of popular statement;
_junkre - whitespace or comment line;
_match_stringre: string, possibly without closer;
_itemre - line that may have bracket structure start;
_closere - line that must be followed by dedent.
_chew_ordinaryre - non-special characters.
� N� z�
^
[ \t]*
(?: while
| else
| def
| return
| assert
| break
| class
| continue
| elif
| try
| except
| raise
| import
| yield
)
\b
z'
[ \t]*
(?: \# \S .* )?
\n
aK
\""" [^"\\]* (?:
(?: \\. | "(?!"") )
[^"\\]*
)*
(?: \""" )?
| " [^"\\\n]* (?: \\. [^"\\\n]* )* "?
| ''' [^'\\]* (?:
(?: \\. | '(?!'') )
[^'\\]*
)*
(?: ''' )?
| ' [^'\\\n]* (?: \\. [^'\\\n]* )* '?
zM
[ \t]*
[^\s#\\] # if we match, m.end()-1 is the interesting char
z_
\s*
(?: return
| break
| continue
| raise
| pass
)
\b
z
[^[\](){}#'"\\]+
c @ s e Zd ZdZdd� ZdS )�ParseMapap Dict subclass that maps anything not in dict to 'x'.
This is designed to be used with str.translate in study1.
Anything not specifically mapped otherwise becomes 'x'.
Example: replace everything except whitespace with 'x'.
>>> keepwhite = ParseMap((ord(c), ord(c)) for c in ' \t\n\r')
>>> "a + b\tc\nd".translate(keepwhite)
'x x x\tx\nx'
c C s dS )N�x � )�self�keyr r �4/opt/alt/python37/lib64/python3.7/idlelib/pyparse.py� __missing__r s zParseMap.__missing__N)�__name__�
__module__� __qualname__�__doc__r r r r r r f s
r � r c c s | ]}t |�t d �fV qdS )�(N)�ord)�.0�cr r r � <genexpr>x s r z({[c c s | ]}t |�t d �fV qdS )�)N)r )r r r r r r y s z)}]c c s | ]}t |�t |�fV qd S )N)r )r r r r r r z s z"'\
#c @ s| e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd S ) �Parserc C s || _ || _d S )N)� indentwidth�tabwidth)r r r r r r �__init__ s zParser.__init__c C s, t |�dks |d dks t�|| _d| _d S )Nr ����
)�len�AssertionError�code� study_level)r �sr r r �set_code� s zParser.set_codec C s� | j d }}t|�}xdtd�D ]X}|�dd|�}|dk r:P |�dd|�d }t|||�}|rr||�� �sr|�� }P |}q W |dkr�t|�}|r�||�� �s�|�� }|S |d }x.t||�}|r�|�� \}}||�s�|}q�P q�W |S )a^
Return index of a good place to begin parsing, as close to the
end of the string as possible. This will be the start of some
popular stmt like "if" or "def". Return None if none found:
the caller should pass more prior context then, if possible, or
if not (the entire program text up until the point of interest
has already been tried) pass 0 to set_lo().
This will be reliable iff given a reliable is_char_in_string()
function, meaning that when it says "no", it's absolutely
guaranteed that the char is not in a string.
Nr z:
r r � )r r �range�rfind�_synchre�start�span) r Zis_char_in_stringr �pos�limitZtries�i�mr r r r �find_good_parse_start� s4
z Parser.find_good_parse_startc C s: |dks | j |d dks t�|dkr6| j |d� | _ dS )zx Throw away the start of the string.
Intended to be called with the result of find_good_parse_start().
r r! r N)r r )r �lor r r �set_lo� s z
Parser.set_loc
C s | j dkrdS d| _ | j}|�t�}|�dd�}|�dd�}|�dd�}|�dd�}|�dd�}t}d }}d g | _}|j}d t|� }}�x||k �r�|| } |d }| dkr�q�| dkr�|d }|d kr�||� q�| d
kr�|d }q�| d k�r |r�|d }q�| d k�s| d
k�r2| }
||d |d � |
d k�r>|
d }
|} t|
�d } || }x�||k �r|| } |d }| dk�r��qX||d || � |
k�r�|| }P | dk�r�|d }| d k�rX|d k�r�||� P �qX| dk�rX||k �s�t �|| dk�r|d }|d }�qX�qXW |d | k�r,t
}q�t }q�| dk�rV|� d|�}|d ks�t �q�| dk�sdt �||k �srt �|| dk�r�|d }|d |k�r�t
}|d }q�W |t
k�r�|t k�r�|d k�r�t}|| _|tk|d |kk�s�t �|d |k�r�||� dS )z�Find the line numbers of non-continuation lines.
As quickly as humanly possible <wink>, find the line numbers (0-
based) of the non-continuation lines.
Creates self.{goodlines, continuation}.
r! NZxxxxxxxx�xZxxxxZxxz
xr r r r �"�'� � �\�#r )r r � translate�trans�replace�C_NONE� goodlines�appendr r �C_STRING_FIRST_LINE�C_STRING_NEXT_LINES�find� C_BACKSLASH� C_BRACKET� continuation)
r r r@ �levelZlnor9 Z push_goodr) �n�chZquoteZfirstlno�wr r r �_study1� s�
zParser._study1c C s | � � | jS )N)rE r@ )r r r r �get_continuation_typeO s z Parser.get_continuation_typec C s� | j dkrdS | �� d| _ | j| j }}t|�d }t|�}x`|r�|sLt�|}x4t||d || �D ]}|�dd|d �d }qhW t||�r�|d }q@P q@W |dkr�|dks�t�|}|| | _ | _
d}g }|j } |dfg}
�x�||k �r�t |||�} | �rX| �
� } | d }x&||k�r4|| dk�r4|d }�qW ||k�rH|| }| }||k�rXP || }
|
dk�r�| |� |
� |t|�f� |
}|d }q�|
d k�r�|�r�|d
= |
}|d }|
� |t|�f� q�|
d k�s�|
d k�r|
� |t|�d f� |
}t|||��
� }|
� |t|�f� q�|
d
k�rn|
� |t|�d f� |�d||�d }|dk�sZt�|
� |t|�f� q�|
dk�s|t�|d }||k �s�t�|| dk�r�|
|| }|d }q�W || _|�r�|d
nd| _t|
�| _dS )am
study1 was sufficient to determine the continuation status,
but doing more requires looking at every character. study2
does this for the last interesting statement in the block.
Creates:
self.stmt_start, stmt_end
slice indices of last interesting stmt
self.stmt_bracketing
the bracketing structure of the last interesting stmt; for
example, for the statement "say(boo) or die",
stmt_bracketing will be ((0, 0), (0, 1), (2, 0), (2, 1),
(4, 0)). Strings and comments are treated as brackets, for
the matter.
self.lastch
last interesting character before optional trailing comment
self.lastopenbracketpos
if continuation is C_BRACKET, index of last open bracket
r1 Nr! r r � z
z([{z)]}r r/ r0 r4 r3 )r rE r r9 r r r" r# �_junkre�
stmt_start�stmt_endr: �_chew_ordinaryre�end�_match_stringrer= �lastch�lastopenbracketpos�tuple�stmt_bracketing)r r r9 r) �p�qZnothingrN �stackZ
push_stackZ
bracketingr* ZnewprC r r r �_study2S s�
zParser._study2c C s� | � � | jtkst�| j}| j}t|�}|�dd|�d }}|d }xj||k r�t||�}|rt|� � d }d}P qJ|�
d|�d }}qJW | }}x|| dkr�|d }q�W | j }t|||� � | j
��| S )zpReturn number of spaces the next line should be indented.
Line continuation must be C_BRACKET.
r r r! z )rU r@ r? r rO r r r# �_itemrerL r= r �
expandtabsr )r �jr rB Zorigir) r* Zextrar r r �compute_bracket_indent� s&
z Parser.compute_bracket_indentc C s | � � | j}|d |d S )z�Return number of physical lines in last stmt.
The statement doesn't have to be an interesting statement. This is
intended to be called when continuation is C_BACKSLASH.
r ���)rE r9 )r r9 r r r �get_num_lines_in_stmt� s z Parser.get_num_lines_in_stmtc C s� | � � | jtkst�| j}| j}x|| dkr:|d }q$W |}|�d|�d }d }}x�||k �r&|| }|dkr�|d }|d }qZ|dkr�|r�|d }|d }qZ|dks�|dkr�t|||��� }qZ|d kr�P qZ|dk�r |d
k�r |dk�s||d d k�r ||d d
k�r d}P qZ|d }qZW |�rN|d }t �
d |||� �d
k}|�sv|}x || dk�rt|d }�qZW t || j|� � | j
��d S )z�Return number of spaces the next line should be indented.
Line continuation must be C_BACKSLASH. Also assume that the new
line is the first one following the initial line of the stmt.
z r! r r z([{z)]}r/ r0 r4 �=z=<>!z\s*\\Nz
)rU r@ r> r r rI r= rM rL �re�matchr rW r )r r r) �startpos�endpos�foundrA rC r r r �compute_backslash_indent� sJ
z Parser.compute_backslash_indentc C sN | � � | j| j }}|}| j}x ||k r@|| dkr@|d }q"W |||� S )z`Return the leading whitespace on the initial line of the last
interesting stmt.
z r! )rU rI rJ r )r r) rB rX r r r r �get_base_indent_string0 s z Parser.get_base_indent_stringc C s | � � | jdkS )z<Return True if the last interesting statement opens a block.�:)rU rN )r r r r �is_block_opener< s zParser.is_block_openerc C s | � � t| j| j�dk S )z=Return True if the last interesting statement closes a block.N)rU �_closerer rI )r r r r �is_block_closerA s zParser.is_block_closerc C s | � � | jS )z�Return bracketing structure of the last interesting statement.
The returned tuple is in the format defined in _study2().
)rU rQ )r r r r �get_last_stmt_bracketingF s z Parser.get_last_stmt_bracketingN)r
r r r r r+ r- rE rF rU rY r[ rb rc re rg rh r r r r r } s 8 {
9 r �__main__)�mainz idlelib.idle_test.test_pyparser1 )� verbosity) r
r] r" r8 r> r; r< r? �compile�VERBOSE� MULTILINE�searchr$ r^ rH �DOTALLrM rV rf rK �dictr �fromkeysr6 �updater r
Zunittestrj r r r r �<module> s4 U
........