관리-도구
편집 파일: streams.cpython-37.opt-1.pyc
B �k�ahQ � @ s$ U d dl Z d dlZd dlZd dlmZmZmZmZmZm Z m Z m Z ddl m Z ddlmZmZmZ ddlmZ ddlmZ dZe d �ZG d d � d e�ZG d d � d ee �ZG dd� d�ZG dd� d�Z G dd� de �Z G dd� de �Z e � Z ee e d< G dd� dee �Z!G dd� de!e �Z"dS )� N)� Awaitable�Callable�Deque�Generic�List�Optional�Tuple�TypeVar� )� BaseProtocol)�BaseTimerContext� set_exception� set_result)�internal_logger)�Final)� EMPTY_PAYLOAD� EofStream� StreamReader� DataQueue�FlowControlDataQueue�_Tc @ s e Zd ZdZdS )r zeof stream indication.N)�__name__� __module__� __qualname__�__doc__� r r �B/opt/alt/python37/lib64/python3.7/site-packages/aiohttp/streams.pyr s r c @ sD e Zd Zeg ee f dd�dd�Zdd�dd�Zed�d d �ZdS ) �AsyncStreamIteratorN)� read_func�returnc C s || _ d S )N)r )�selfr r r r �__init__ s z AsyncStreamIterator.__init__zAsyncStreamIterator[_T])r c C s | S )Nr )r r r r � __aiter__ s z AsyncStreamIterator.__aiter__c � s< y| � � I d H }W n tk r* t�Y nX |dkr8t�|S )N� )r r �StopAsyncIteration)r �rvr r r � __anext__! s z AsyncStreamIterator.__anext__) r r r r r r r! r" r& r r r r r s r c @ s@ e Zd Zddd�dd�Zd d�dd�Zeeef d�d d �ZdS ) � ChunkTupleAsyncStreamIteratorr N)�streamr c C s || _ d S )N)�_stream)r r( r r r r! , s z&ChunkTupleAsyncStreamIterator.__init__)r c C s | S )Nr )r r r r r" / s z'ChunkTupleAsyncStreamIterator.__aiter__c � s | j �� I d H }|dkr t�|S )N)r# F)r) � readchunkr$ )r r% r r r r& 2 s z'ChunkTupleAsyncStreamIterator.__anext__) r r r r! r" r �bytes�boolr& r r r r r' + s r' c @ sR e Zd Zee d�dd�Zeee d�dd�Zee d�dd�Ze d�d d �Z d S ) �AsyncStreamReaderMixin)r c C s t | j�S )N)r �readline)r r r r r" : s z AsyncStreamReaderMixin.__aiter__)�nr c s t � �fdd��S )zzReturns an asynchronous iterator that yields chunks of size n. Python-3.5 available for Python 3.5+ only c s �� � �S )N)�readr )r/ r r r �<lambda>C r# z5AsyncStreamReaderMixin.iter_chunked.<locals>.<lambda>)r )r r/ r )r/ r r � iter_chunked= s z#AsyncStreamReaderMixin.iter_chunkedc C s t | j�S )zoYield all available data as soon as it is received. Python-3.5 available for Python 3.5+ only )r �readany)r r r r �iter_anyF s z AsyncStreamReaderMixin.iter_anyc C s t | �S )z�Yield chunks of data as they are received by the server. The yielded objects are tuples of (bytes, bool) as returned by the StreamReader.readchunk method. Python-3.5 available for Python 3.5+ only )r' )r r r r � iter_chunksM s z"AsyncStreamReaderMixin.iter_chunksN) r r r r r+ r" �intr2 r4 r' r5 r r r r r- 9 s r- c @ s� e Zd ZdZdZddd�eeee ee j dd�dd�Z e d�d d �Z eeef d�d d �Zee d�d d�Zedd�dd�Zeg df dd�dd�Zdd�dd�Zed�dd�Zed�dd�Zdd�dd �Zedd �d d �Zd@eedd �d!d"�Z dd�d#d$�Z dd�d%d&�Z e dd'�d(d)�Z ed�d*d+�Z dAeed-�d.d/�Z!dBeed1�d2d3�Z"ed�d4d5�Z#eeef d�d6d7�Z$eed1�d8d9�Z%dCeed1�d:d;�Z&eed1�d<d=�Z'eed1�d>d?�Z(dS )Dr a* An enhancement of asyncio.StreamReader. Supports asynchronous iteration by line, chunk or as available:: async for line in reader: ... async for chunk in reader.iter_chunked(1024): ... async for slice in reader.iter_any(): ... r N)�timer�loop)�protocol�limitr7 r8 r c C sv || _ || _|d | _|d kr&t�� }|| _d| _d| _d | _t � � | _ d| _ d| _ d | _d | _d | _|| _g | _d S )N� r F)� _protocol� _low_water� _high_water�asyncioZget_event_loop�_loop�_size�_cursor�_http_chunk_splits� collections�deque�_buffer�_buffer_offset�_eof�_waiter� _eof_waiter� _exception�_timer�_eof_callbacks)r r9 r: r7 r8 r r r r! h s" zStreamReader.__init__)r c C s� | j jg}| jr |�d| j � | jr0|�d� | jdkrP|�d| j| jf � | jrf|�d| j � | jr||�d| j � dd� |� S ) Nz%d bytes�eofi zlow=%d high=%dzw=%rze=%rz<%s>� ) � __class__r rA �appendrH r= r> rI rK �join)r �infor r r �__repr__� s zStreamReader.__repr__c C s | j | jfS )N)r= r> )r r r r �get_read_buffer_limits� s z#StreamReader.get_read_buffer_limitsc C s | j S )N)rK )r r r r � exception� s zStreamReader.exception)�excr c C sP || _ | j�� | j}|d k r.d | _t||� | j}|d k rLd | _t||� d S )N)rK rM �clearrI r rJ )r rW �waiterr r r r � s zStreamReader.set_exception)�callbackr c C sB | j r2y |� W q> tk r. t�d� Y q>X n | j�|� d S )NzException in eof callback)rH � Exceptionr rV rM rQ )r rZ r r r �on_eof� s zStreamReader.on_eofc C s� d| _ | j}|d k r$d | _t|d � | j}|d k rBd | _t|d � x8| jD ].}y |� W qJ tk rv t�d� Y qJX qJW | j�� d S )NTzException in eof callback) rH rI r rJ rM r[ r rV rX )r rY �cbr r r �feed_eof� s zStreamReader.feed_eofc C s | j S )z&Return True if 'feed_eof' was called.)rH )r r r r �is_eof� s zStreamReader.is_eofc C s | j o | j S )z=Return True if the buffer is empty and 'feed_eof' was called.)rH rF )r r r r �at_eof� s zStreamReader.at_eofc � sB | j r d S | jd kst�| j�� | _z| jI d H W d d | _X d S )N)rH rJ �AssertionErrorr@ � create_future)r r r r �wait_eof� s zStreamReader.wait_eof)�datar c C sx t jdtdd� |sdS | jr>| jd | jd� | jd< d| _| jt|�7 _| jt|�8 _| j�|� d| _ dS )zDrollback reading some data from stream, inserting it to buffer head.zJunread_data() is deprecated and will be removed in future releases (#3260)r; )� stacklevelNr ) �warnings�warn�DeprecationWarningrG rF rA �lenrB � appendleft� _eof_counter)r rd r r r � unread_data� s zStreamReader.unread_data)rd �sizer c C s� | j rtd��|sd S | jt|�7 _| j�|� | jt|�7 _| j}|d k rdd | _t|d � | j| j kr�| j j s�| j � � d S )Nzfeed_data after feed_eof) rH ra rA ri rF rQ � total_bytesrI r r> r< �_reading_paused� pause_reading)r rd rm rY r r r � feed_data� s zStreamReader.feed_datac C s" | j d kr | jrtd��g | _ d S )Nz?Called begin_http_chunk_receiving whensome data was already fed)rC rn � RuntimeError)r r r r �begin_http_chunk_receiving� s z'StreamReader.begin_http_chunk_receivingc C sd | j d krtd��| j r"| j d nd}| j|kr4d S | j �| j� | j}|d k r`d | _t|d � d S )NzFCalled end_chunk_receiving without calling begin_chunk_receiving first���r )rC rr rn rQ rI r )r �posrY r r r �end_http_chunk_receiving s z%StreamReader.end_http_chunk_receiving)� func_namer c � sf | j d k rtd| ��| j�� }| _ z2| jrL| j� |I d H W d Q R X n |I d H W d d | _ X d S )NzH%s() called while another coroutine is already waiting for incoming data)rI rr r@ rb rL )r rw rY r r r �_wait! s zStreamReader._waitc � s | � � I d H S )N)� readuntil)r r r r r. 6 s zStreamReader.readline� )� separatorr c � s� t |�}|dkrtd��| jd k r(| j�d}d}d}x�|r�xn| jr�|r�| j}| jd �||�d }| �|rr|| nd�}||7 }|t |�7 }|r�d}|| jkr<td��q<W | jr�P |r6| � d �I d H q6W |S ) Nr z,Separator should be at least one-byte stringr# Tr rt Fz Chunk too bigry ) ri � ValueErrorrK rF rG �find�_read_nowait_chunkr> rH rx ) r r{ Zseplen�chunkZ chunk_sizeZ not_enough�offsetZicharrd r r r ry 9 s0 zStreamReader.readuntilrt )r/ r c � s� | j d k r| j �| jrF| jsFt| dd�d | _| jdkrFtjddd� |sNdS |dk r�g }x"| �� I d H }|spP |�|� q\W d� |�S x | js�| js�| � d �I d H q�W | � |�S ) Nrk r r � zEMultiple access to StreamReader in eof state, might be infinite loop.T)Z stack_infor# r0 ) rK rH rF �getattrrk r �warningr3 rQ rR rx � _read_nowait)r r/ �blocks�blockr r r r0 [ s* zStreamReader.readc � s< | j d k r| j �x | js0| js0| �d�I d H qW | �d�S )Nr3 rt )rK rF rH rx r� )r r r r r3 � s zStreamReader.readanyc � s� x�| j dk r| j �xL| jr^| j�d�}|| jkr4dS || jkrR| �|| j �dfS t�d� qW | jrt| �d�dfS | j r~dS | � d �I dH qW dS ) a Returns a tuple of (data, end_of_http_chunk). When chunked transfer encoding is used, end_of_http_chunk is a boolean indicating if the end of the data corresponds to the end of a HTTP chunk , otherwise it is always False. Nr )r# TTzESkipping HTTP chunk end due to data consumption beyond chunk boundaryrt F)r# Fr* ) rK rC �poprB r� r r� rF r~ rH rx )r ru r r r r* � s zStreamReader.readchunkc � st | j d k r| j �g }xT|dkrh| �|�I d H }|sPd�|�}t�|t|�| ��|�|� |t|�8 }qW d�|�S )Nr r# )rK r0 rR r? �IncompleteReadErrorri rQ )r r/ r� r� �partialr r r � readexactly� s zStreamReader.readexactlyc C s2 | j d k r| j �| jr(| j�� s(td��| �|�S )Nz9Called while some coroutine is waiting for incoming data.)rK rI Zdonerr r� )r r/ r r r � read_nowait� s zStreamReader.read_nowaitc C s� | j d }| j}|dkrHt|�| |krH|||| � }| j|7 _n,|rj| j �� ||d � }d| _n | j �� }| jt|�8 _| jt|�7 _| j}x |r�|d | jk r�|�d� q�W | j| jk r�| j j r�| j � � |S )Nr rt ) rF rG ri �popleftrA rB rC r� r= r< ro �resume_reading)r r/ Z first_bufferr� rd Z chunk_splitsr r r r~ � s$ z StreamReader._read_nowait_chunkc C sT g }x<| j r@| �|�}|�|� |dkr|t|�8 }|dkrP qW |rPd�|�S dS )z6Read not more than n bytes, or whole buffer if n == -1rt r r# )rF r~ rQ ri rR )r r/ Zchunksr r r r r� � s zStreamReader._read_nowait)r )rz )rt )rt ))r r r r rn r r6 r r r? �AbstractEventLoopr! �strrT r rU � BaseExceptionrV r r r\ r^ r, r_ r` rc r+ rl rq rs rv rx r. ry r0 r3 r* r� r� r~ r� r r r r r X s8 "* "r c @ s e Zd Zdd�dd�Zee d�dd�Zedd�dd �Zeg df dd �d d �Z dd�d d�Z e d�dd�Z e d�dd�Z dd�dd�Zd'eedd�dd�Zed�dd�Zd(eed �d d �Zed�d d �Zeee f d�d!d"�Zeed �d#d$�Zd)eed �d%d&�ZdS )*�EmptyStreamReaderN)r c C s d S )Nr )r r r r r! � s zEmptyStreamReader.__init__c C s d S )Nr )r r r r rV � s zEmptyStreamReader.exception)rW r c C s d S )Nr )r rW r r r r s z EmptyStreamReader.set_exception)rZ r c C s. y |� W n t k r( t�d� Y nX d S )NzException in eof callback)r[ r rV )r rZ r r r r\ s zEmptyStreamReader.on_eofc C s d S )Nr )r r r r r^ s zEmptyStreamReader.feed_eofc C s dS )NTr )r r r r r_ s zEmptyStreamReader.is_eofc C s dS )NTr )r r r r r` s zEmptyStreamReader.at_eofc � s d S )Nr )r r r r rc s zEmptyStreamReader.wait_eofr )rd r/ r c C s d S )Nr )r rd r/ r r r rq s zEmptyStreamReader.feed_datac � s dS )Nr# r )r r r r r. s zEmptyStreamReader.readlinert )r/ r c � s dS )Nr# r )r r/ r r r r0 s zEmptyStreamReader.readc � s dS )Nr# r )r r r r r3 " s zEmptyStreamReader.readanyc � s dS )N)r# Tr )r r r r r* % s zEmptyStreamReader.readchunkc � s t �d|��d S )Nr# )r? r� )r r/ r r r r� ( s z EmptyStreamReader.readexactlyc C s dS )Nr# r )r r/ r r r r� + s z EmptyStreamReader.read_nowait)r )rt )rt )r r r r! r r� rV r r r\ r^ r, r_ r` rc r+ r6 rq r. r0 r3 r r* r� r� r r r r r� � s r� r c @ s� e Zd ZdZejdd�dd�Zed�dd�Ze d�d d �Z e d�d d �Z e e d�d d�Ze dd�dd�Zd eedd�dd�Zdd�dd�Zed�dd�Zee d�dd�ZdS ) r z>DataQueue is a general-purpose blocking queue with one reader.N)r8 r c C s, || _ d| _d | _d | _d| _t�� | _d S )NFr )r@ rH rI rK rA rD rE rF )r r8 r r r r! 5 s zDataQueue.__init__)r c C s t | j�S )N)ri rF )r r r r �__len__= s zDataQueue.__len__c C s | j S )N)rH )r r r r r_ @ s zDataQueue.is_eofc C s | j o | j S )N)rH rF )r r r r r` C s zDataQueue.at_eofc C s | j S )N)rK )r r r r rV F s zDataQueue.exception)rW r c C s. d| _ || _| j}|d k r*d | _t||� d S )NT)rH rK rI r )r rW rY r r r r I s zDataQueue.set_exceptionr )rd rm r c C s@ | j |7 _ | j�||f� | j}|d k r<d | _t|d � d S )N)rA rF rQ rI r )r rd rm rY r r r rq R s zDataQueue.feed_datac C s( d| _ | j}|d k r$d | _t|d � d S )NT)rH rI r )r rY r r r r^ [ s zDataQueue.feed_eofc � s� | j sX| jsX| jrt�| j�� | _y| jI d H W n$ tjtjfk rV d | _� Y nX | j r~| j � � \}}| j |8 _ |S | j d k r�| j �nt �d S )N) rF rH rI ra r@ rb r? ZCancelledError� TimeoutErrorr� rA rK r )r rd rm r r r r0 c s zDataQueue.readc C s t | j�S )N)r r0 )r r r r r" w s zDataQueue.__aiter__)r )r r r r r? r� r! r6 r� r, r_ r` r r� rV r r rq r^ r0 r r" r r r r r 2 s r c sX e Zd ZdZeeejdd�� fdd� Zd e edd�� fdd � Z e d �� fd d � Z � Z S )r zlFlowControlDataQueue resumes and pauses an underlying stream. It is a destination for parsed data. N)r9 r: r8 r c s" t � j|d� || _|d | _d S )N)r8 r; )�superr! r< �_limit)r r9 r: r8 )rP r r r! � s z FlowControlDataQueue.__init__r )rd rm r c s0 t � �||� | j| jkr,| jjs,| j�� d S )N)r� rq rA r� r< ro rp )r rd rm )rP r r rq � s z FlowControlDataQueue.feed_data)r c � s6 zt � �� I d H S | j| jk r0| jjr0| j�� X d S )N)r� r0 rA r� r< ro r� )r )rP r r r0 � s zFlowControlDataQueue.read)r ) r r r r r r6 r? r� r! r rq r0 � __classcell__r r )rP r r { s r )#r? rD rf �typingr r r r r r r r Z base_protocolr Zhelpersr r r �logr Ztypedefsr �__all__r r[ r r r' r- r r� r �__annotations__r r r r r r �<module> s, ( &4I