관리-도구
편집 파일: _tokenizer.cpython-38.pyc
U &?�f� � @ s� U d dl mZ d dlZd dlZd dlmZ d dlmZmZ ddl m Z eG dd� d��Z G d d � d e �Z d d d ddde�dej�dddde�dej�e�e je j ejejB �dddddd d d �Zd ed < G d!d"� d"�ZdS )#� )� annotationsN)� dataclass)�Iterator�NoReturn� )� Specifierc @ s& e Zd ZU ded< ded< ded< dS )�Token�str�name�text�int�positionN)�__name__� __module__� __qualname__�__annotations__� r r �N/opt/hc_python/lib/python3.8/site-packages/pip/_vendor/packaging/_tokenizer.pyr s r c s: e Zd ZdZddddd�� fdd� Zdd�d d �Z� ZS ) �ParserSyntaxErrorz7The provided source text could not be parsed correctly.r ztuple[int, int]�None)�message�source�span�returnc s || _ || _|| _t� �� d S )N)r r r �super�__init__)�selfr r r �� __class__r r r s zParserSyntaxError.__init__�r c C s> d| j d d| j d | j d d }d�| j| j|g�S )N� r �~r �^z )r �joinr r )r �markerr r r �__str__" s *zParserSyntaxError.__str__)r r r �__doc__r r% � __classcell__r r r r r s r z\(z\)z\[z\]�;�,zk ( ('[^']*') | ("[^"]*") ) z(===|==|~=|!=|<=|>=|<|>)z \b(or|and)\bz\bin\bz\bnot\ba� \b( python_version |python_full_version |os[._]name |sys[._]platform |platform_(release|system) |platform[._](version|machine|python_implementation) |python_implementation |implementation_(name|version) |extra )\b z\@z[^ \t]+z \b[a-zA-Z0-9][a-zA-Z0-9._-]*\bz\.\*z \+[a-z0-9]+(?:[-_\.][a-z0-9]+)*z[ \t]+�$)ZLEFT_PARENTHESISZRIGHT_PARENTHESISZ LEFT_BRACKETZ RIGHT_BRACKET� SEMICOLON�COMMAZ QUOTED_STRING�OP�BOOLOP�INZNOT�VARIABLEZ SPECIFIER�AT�URL� IDENTIFIERZVERSION_PREFIX_TRAILZVERSION_LOCAL_LABEL_TRAILZWSZEND� dict[str, str | re.Pattern[str]]� DEFAULT_RULESc @ s� e Zd ZdZdddd�dd�Zddd�d d �Zd d �dd d d�dd�Zdddd�dd�Zdd�dd�Zddd�ddddd �d d �Z e j dddd d �d!d"��Z dS )#� Tokenizerz�Context-sensitive token parsing. Provides methods to examine the input stream to check whether the next token matches. r r4 r )r �rulesr c C s* || _ dd� |�� D �| _d | _d| _d S )Nc S s i | ]\}}|t �|��qS r )�re�compile)�.0r �patternr r r � <dictcomp>h s z&Tokenizer.__init__.<locals>.<dictcomp>r )r �itemsr7 � next_tokenr )r r r7 r r r r a s �zTokenizer.__init__)r r c C s | � |�r| �� dS )z8Move beyond provided token name, if at current position.N)�check�read)r r r r r �consumen s zTokenizer.consumeF)�peek�bool)r rB r c C sz | j dks td|�d| j ����|| jks8td|����| j| }|�| j| j�}|dkr^dS |svt||d | j�| _ dS )z�Check whether the next token has the provided name. By default, if the check succeeds, the token *must* be read before another check. If `peek` is set to `True`, the token is not loaded and would need to be checked again. NzCannot check for z, already have zUnknown token name: Fr T)r> �AssertionErrorr7 �matchr r r )r r rB Z expressionrE r r r r? s s �� zTokenizer.checkr )r �expectedr c C s" | � |�s| �d|� ���| �� S )zsExpect a certain token name next, failing with a syntax error otherwise. The token is *not* read. z Expected )r? �raise_syntax_errorr@ )r r rF r r r �expect� s zTokenizer.expectr c C s0 | j }|dk st�| jt|j�7 _d| _ |S )z%Consume the next token and return it.N)r> rD r �lenr )r �tokenr r r r@ � s zTokenizer.readN)� span_start�span_endz int | Noner )r rK rL r c C s8 |dkr| j n||dkr | j n|f}t|| j|d��dS )z.Raise ParserSyntaxError at the given position.N)r r )r r r )r r rK rL r r r r rG � s ��z Tokenizer.raise_syntax_errorzIterator[None])� open_token� close_token�aroundr c c sf | � |�r| j}| �� nd }d V |d kr0d S | � |�sZ| jd|� d|� d|� �|d� | �� d S )NzExpected matching z for z, after )rK )r? r r@ rG )r rM rN rO Z open_positionr r r �enclosing_tokens� s �zTokenizer.enclosing_tokens) r r r r& r rA r? rH r@ rG � contextlib�contextmanagerrP r r r r r6 Z s �r6 )� __future__r rQ r8 � dataclassesr �typingr r � specifiersr r � Exceptionr r9 �VERBOSEZ_operator_regex_strZ_version_regex_str� IGNORECASEr5 r r6 r r r r �<module> sP � � ��3