ikan Uploader :
Directory : /opt/alt/python37/lib64/python3.7/multiprocessing/__pycache__/
Upload File : |
| Current File : //opt/alt/python37/lib64/python3.7/multiprocessing/__pycache__/queues.cpython-37.opt-1.pyc |
B
� fC- � @ s� d ddgZ ddlZddlZddlZddlZddlZddlZddlZddlm Z m
Z
ddl Z ddl m
Z
ddl mZ ejjZdd lmZmZmZmZmZ G d
d � d e�Ze� ZG d d� de�ZG d d� de�Z dS )
�Queue� SimpleQueue�
JoinableQueue� N)�Empty�Full� )�
connection)�context)�debug�info�Finalize�register_after_fork�
is_exitingc @ s� e Zd Zd*dd�Zdd� Zdd� Zdd � Zd+d d
�Zd,dd�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zd d � Zd d � Zd d!� Zed"d#� �Zed$d%� �Zed&d'� �Zed(d)� �Zd S )-r r c C s� |dkrddl m} || _tjdd�\| _| _|�� | _t �
� | _ t j
dkrTd | _n
|�� | _|�|�| _d| _| �� t j
dkr�t| tj� d S )Nr r )�
SEM_VALUE_MAXF)�duplex�win32)Z synchronizer �_maxsizer �Pipe�_reader�_writer�Lock�_rlock�os�getpid�_opid�sys�platform�_wlockZBoundedSemaphore�_sem�
_ignore_epipe� _after_forkr
r )�self�maxsize�ctx� r$ �;/opt/alt/python37/lib64/python3.7/multiprocessing/queues.py�__init__$ s
zQueue.__init__c C s. t �| � | j| j| j| j| j| j| j| j fS )N)
r �assert_spawningr r r r r r r r )r! r$ r$ r% � __getstate__9 s
zQueue.__getstate__c C s0 |\| _ | _| _| _| _| _| _| _| �� d S )N) r r r r r r r r r )r! �stater$ r$ r% � __setstate__> s $zQueue.__setstate__c C sb t d� t�t�� �| _t�� | _d | _d | _ d| _
d| _ d | _ | j
j| _| jj| _| jj| _d S )NzQueue._after_fork()F)r
� threading� Conditionr � _notempty� collections�deque�_buffer�_thread� _jointhread�_joincancelled�_closed�_closer �
send_bytes� _send_bytesr �
recv_bytes� _recv_bytes�poll�_poll)r! r$ r$ r% r C s
zQueue._after_forkTNc C sP | j �||�st�| j�. | jd kr,| �� | j�|� | j�� W d Q R X d S )N) r �acquirer r- r1 �
_start_threadr0 �append�notify)r! �obj�block�timeoutr$ r$ r% �putP s
z Queue.putc C s� |r2|d kr2| j � | �� }W d Q R X | j�� nr|rBt�� | }| j �||�sTt�zB|rv|t�� }| �|�s�t�n | �� s�t�| �� }| j�� W d | j �� X t �
|�S )N) r r9 r �release�timeZ monotonicr< r r; �_ForkingPickler�loads)r! rA rB �resZdeadliner$ r$ r% �get[ s&
z Queue.getc C s | j | jj�� S )N)r r �_semlockZ
_get_value)r! r$ r$ r% �qsizes s z Queue.qsizec C s
| � � S )N)r; )r! r$ r$ r% �emptyw s z Queue.emptyc C s | j j�� S )N)r rJ �_is_zero)r! r$ r$ r% �fullz s z
Queue.fullc C s
| � d�S )NF)rI )r! r$ r$ r% �
get_nowait} s zQueue.get_nowaitc C s | � |d�S )NF)rC )r! r@ r$ r$ r% �
put_nowait� s zQueue.put_nowaitc C s2 d| _ z| j�� W d | j}|r,d | _|� X d S )NT)r4 r �closer5 )r! rQ r$ r$ r% rQ � s z Queue.closec C s t d� | jr| �� d S )NzQueue.join_thread())r
r2 )r! r$ r$ r% � join_thread� s zQueue.join_threadc C s6 t d� d| _y| j�� W n tk
r0 Y nX d S )NzQueue.cancel_join_thread()T)r
r3 r2 Zcancel�AttributeError)r! r$ r$ r% �cancel_join_thread� s zQueue.cancel_join_threadc
C s� t d� | j�� tjtj| j| j| j| j | j
j | j | j
| jfdd�| _d| j_t d� | j�� t d� | js�t| jtjt�| j�gdd�| _t| tj| j| jgd d�| _d S )
NzQueue._start_thread()ZQueueFeederThread)�target�args�nameTzdoing self._thread.start()z ... done self._thread.start()���)Z exitpriority�
)r
r0 �clearr+ ZThreadr �_feedr- r7 r r rQ r �_on_queue_feeder_errorr r1 Zdaemon�startr3 r �_finalize_join�weakref�refr2 �_finalize_closer5 )r! r$ r$ r% r= � s*
zQueue._start_threadc C s4 t d� | � }|d k r(|�� t d� nt d� d S )Nzjoining queue threadz... queue thread joinedz ... queue thread already dead)r
�join)ZtwrZthreadr$ r$ r% r^ � s
zQueue._finalize_joinc C s. t d� |� | �t� |�� W d Q R X d S )Nz telling queue thread to quit)r
r> � _sentinelr? )�buffer�notemptyr$ r$ r% ra � s
zQueue._finalize_closec
C sR t d� |j}|j} |j}
| j} t} tjdkr<|j}
|j}nd }
�x
y�|� z| sX|
� W d | � X ybx\| � }|| kr�t d� |� d S t� |�}|
d kr�||� qh|
� z ||� W d |� X qhW W n t
k
r� Y nX W qD t k
�rH } zJ|�rt |dd�t
jk�rd S t� �r&td|� d S |�� |||� W d d }~X Y qDX qDW d S )Nz$starting thread to feed data to piper z%feeder thread got sentinel -- exiting�errnor zerror in queue thread: %s)r
r< rD �wait�popleftrc r r rF �dumps�
IndexError� Exception�getattrrf ZEPIPEr r )rd re r6 Z writelockrQ Z ignore_epipe�onerrorZ queue_semZnacquireZnreleaseZnwaitZbpopleft�sentinelZwacquireZwreleaser@ �er$ r$ r% r[ � sR
z Queue._feedc C s ddl }|�� dS )z�
Private API hook called when feeding data in the background thread
raises an exception. For overriding by concurrent.futures.
r N)� traceback� print_exc)ro r@ rp r$ r$ r% r\
s z Queue._on_queue_feeder_error)r )TN)TN)�__name__�
__module__� __qualname__r& r( r* r rC rI rK rL rN rO rP rQ rR rT r= � staticmethodr^ ra r[ r\ r$ r$ r$ r% r " s&
>c @ s@ e Zd Zddd�Zdd� Zdd� Zdd
d �Zd d
� Zdd� Zd S )r r c C s* t j| ||d� |�d�| _|�� | _d S )N)r# r )r r& Z Semaphore�_unfinished_tasksr, �_cond)r! r" r# r$ r$ r% r& s zJoinableQueue.__init__c C s t �| �| j| jf S )N)r r( rw rv )r! r$ r$ r% r( % s zJoinableQueue.__getstate__c C s, t �| |d d� � |dd � \| _| _d S )N���)r r* rw rv )r! r) r$ r$ r% r* ( s zJoinableQueue.__setstate__TNc
C sl | j �||�st�| j�J | j�8 | jd kr4| �� | j�|� | j �
� | j� � W d Q R X W d Q R X d S )N) r r< r r- rw r1 r= r0 r> rv rD r? )r! r@ rA rB r$ r$ r% rC , s
zJoinableQueue.putc C s@ | j �0 | j�d�s td��| jj�� r2| j �� W d Q R X d S )NFz!task_done() called too many times)rw rv r< �
ValueErrorrJ rM Z
notify_all)r! r$ r$ r% � task_done8 s
zJoinableQueue.task_donec C s, | j � | jj�� s | j �� W d Q R X d S )N)rw rv rJ rM rg )r! r$ r$ r% rb ? s zJoinableQueue.join)r )TN) rr rs rt r& r( r* rC rz rb r$ r$ r$ r% r s
c @ s< e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
S )r c C sH t jdd�\| _| _|�� | _| jj| _tj dkr:d | _
n
|�� | _
d S )NF)r r ) r r r r r r r: r; r r r )r! r# r$ r$ r% r& J s
zSimpleQueue.__init__c C s
| � � S )N)r; )r! r$ r$ r% rL S s zSimpleQueue.emptyc C s t �| � | j| j| j| jfS )N)r r' r r r r )r! r$ r$ r% r( V s
zSimpleQueue.__getstate__c C s" |\| _ | _| _| _| j j| _d S )N)r r r r r: r; )r! r) r$ r$ r% r* Z s zSimpleQueue.__setstate__c C s& | j � | j�� }W d Q R X t�|�S )N)r r r8 rF rG )r! rH r$ r$ r% rI ^ s zSimpleQueue.getc C sD t �|�}| jd kr"| j�|� n | j� | j�|� W d Q R X d S )N)rF ri r r r6 )r! r@ r$ r$ r% rC d s
zSimpleQueue.putN) rr rs rt r& rL r( r* rI rC r$ r$ r$ r% r H s ) �__all__r r r+ r. rE r_ rf Zqueuer r Z_multiprocessing� r r Z reductionZForkingPicklerrF �utilr
r r r
r �objectr rc r r r$ r$ r$ r% �<module>
s$
s
*
........