Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/celery/events/__pycache__/state.cpython-39.pyc
Ðазад
a t�h0d � @ s� d Z ddlZddlZddlZddlmZ ddlmZ ddlmZ ddl m Z ddl m Z ddl mZ dd lmZ dd lmZmZ dd lmZmZ dd lmZ dd lmZ ddlmZ ddl m Z m Z m Z ddl m!Z! dZ"e#ed�Z$dZ%dZ&dZ'e!e(�Z)e)j*Z+dZ,dZ-dZ.ej/ej0ej1ej2ej3ej4ej5ej6d�Z7G dd� de�Z8e�9e8� e d d d � d �d d!� �Z:d"e%e e;e<fd#d$�Z=d%d&� Z>d'd(� Z?e?d)�G d*d+� d+��Z@e?d,�G d-d.� d.��ZAG d/d0� d0�ZBd1d2� ZCd3d4� ZDdS )5a� In-memory representation of cluster state. This module implements a data-structure used to keep track of the state of a cluster of workers and the tasks it is working on (by consuming events). For every event consumed the state is updated, so the state represents the state of the cluster at the time of the last event. Snapshots (:mod:`celery.events.snapshot`) can be used to take "pictures" of this state at regular intervals to for example, store that in a database. � N)� defaultdict)�Callable)�datetime)�Decimal)�islice)� itemgetter)�time)�Mapping�Optional)�WeakSet�ref�� timetuple)�cached_property)�states)�LRUCache�memoize�pass1)� get_logger)�Worker�Task�State�heartbeat_expires�pypy_version_info�� � zmSubstantial drift from %s may mean clocks are out of sync. Current drift is %s seconds. [orig: %s recv: %s]z4<State: events={0.event_count} tasks={0.task_count}>z9<Worker: {0.hostname} ({0.status_string} clock:{0.clock})z4<Task: {0.name}({0.uuid}) {0.state} clock:{0.clock}>)�sent�received�started�failed�retried� succeeded�revoked�rejectedc s( e Zd ZdZ� fdd�Zdd� Z� ZS )�CallableDefaultdicta� :class:`~collections.defaultdict` with configurable __call__. We use this for backwards compatibility in State.tasks_by_type etc, which used to be a method but is now an index instead. So you can do:: >>> add_tasks = state.tasks_by_type['proj.tasks.add'] while still supporting the method call:: >>> add_tasks = list(state.tasks_by_type( ... 'proj.tasks.add', reverse=True)) c s || _ t� j|i |�� d S �N)�fun�super�__init__)�selfr& �args�kwargs�� __class__� ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/celery/events/state.pyr( _ s z CallableDefaultdict.__init__c O s | j |i |��S r% )r& )r) r* r+ r. r. r/ �__call__c s z CallableDefaultdict.__call__)�__name__� __module__� __qualname__�__doc__r( r0 � __classcell__r. r. r, r/ r$ O s r$ i� c C s | d S �Nr r. )�a�_r. r. r/ �<lambda>j � r9 )�maxsizeZkeyfunc C s t t| |t�|�t�|�� d S r% )�warn� DRIFT_WARNINGr � fromtimestamp)�hostname�drift�local_received� timestampr. r. r/ � _warn_driftj s �rC �< c C s8 |||�r||�n|}|| |�r(|| �} | ||d S )z#Return time when heartbeat expires.g Y@r. )rB �freq� expire_windowr �float� isinstancer. r. r/ r r s r c C s | f i |��S r% r. )�cls�fieldsr. r. r/ �_depickle_task~ s rK c s � fdd�}|S )Nc s( � fdd�}|| _ � fdd�}|| _| S )Nc s$ t || j�r t| � �t|� �kS tS r% )rH r- �getattr�NotImplemented)�this�other��attrr. r/ �__eq__� s z8with_unique_field.<locals>._decorate_cls.<locals>.__eq__c s t t| � ��S r% )�hashrL )rN rP r. r/ �__hash__� s z:with_unique_field.<locals>._decorate_cls.<locals>.__hash__)rR rT )rI rR rT rP r. r/ � _decorate_cls� s z(with_unique_field.<locals>._decorate_clsr. )rQ rU r. rP r/ �with_unique_field� s rV r? c @ s� e Zd ZdZdZeZdZes$ed Z ddd �Z d d � Z d d � Z dd� Z dd� Zedd� �Zedd� �Zeefdd��Zedd� �ZdS )r z Worker State.� ) r? �pidrE � heartbeats�clock�active� processed�loadavg�sw_ident�sw_ver�sw_sys)�event�__dict__� __weakref__NrD r c C s` || _ || _|| _|d u r g n|| _|p*d| _|| _|| _|| _| | _| | _ | | _ | � � | _ d S r6 ) r? rX rE rY rZ r[ r\ r] r^ r_ r` �_create_event_handlerra ) r) r? rX rE rY rZ r[ r\ r] r^ r_ r` r. r. r/ r( � s zWorker.__init__c C s6 | j | j| j| j| j| j| j| j| j| j | j | j f fS r% ) r- r? rX rE rY rZ r[ r\ r] r^ r_ r` �r) r. r. r/ � __reduce__� s �zWorker.__reduce__c sP t j� �j��j��jj��jj�d d d tttt j t f� �����fdd� }|S )Nc s� |pi }|� � D ]\} } � �| | � q| dkr<g �d d �< n||rD|sHd S |||�||� �} | |krtt�j| ||� |r�|��} | �d kr��d� | r�|�d kr��|� n |�|� d S )N�offline� r ���)�itemsrC r? ) �type_rB rA rJ Z max_drift�abs�int�insort�len�k�vr@ �hearts�Z_setZ hb_appendZhb_popZhbmaxrY r) r. r/ ra � s& � z+Worker._create_event_handler.<locals>.event) �object� __setattr__� heartbeat_maxrY �pop�append�HEARTBEAT_DRIFT_MAXrl rm �bisectrn ro �r) ra r. rs r/ rd � s �z Worker._create_event_handlerc K s: |rt |fi |��n|}|�� D ]\}}t| ||� q d S r% )�dictrj �setattr)r) �f�kw�drp rq r. r. r/ �update� s z Worker.updatec C s t �| �S r% )�R_WORKER�formatre r. r. r/ �__repr__� s zWorker.__repr__c C s | j r dS dS )NZONLINEZOFFLINE��alivere r. r. r/ � status_string� s zWorker.status_stringc C s t | jd | j| j�S )Nri )r rY rE rF re r. r. r/ r � s �zWorker.heartbeat_expiresc C s t | jo|� | jk �S r% )�boolrY r )r) Znowfunr. r. r/ r� � s z Worker.alivec C s d� | �S )Nz{0.hostname}.{0.pid})r� re r. r. r/ �id� s z Worker.id) NNrD Nr NNNNNN)r1 r2 r3 r4 rv �HEARTBEAT_EXPIRE_WINDOWrF �_fields�PYPY� __slots__r( rf rd r� r� �propertyr� r r r� r� r. r. r. r/ r � s, � ! r �uuidc @ s6 e Zd ZdZd Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z Z ZZ e j Z dZ dZ!e"s�dZ#e j$diZ%dZ&d$dd �Z'ddde j(e)e*j+e j,fd d �Z-d%d d �Z.dd� Z/dd� Z0dd� Z1dd� Z2dd� Z3dd� Z4e5dd� �Z6e5d d � �Z7e5d d � �Z8e9d d!� �Z:e9d"d#� �Z;dS )&r z Task State.Nr ) r� �name�stater r r r# r! r r r" r* r+ �eta�expires�retries�worker�result� exceptionrB �runtime� traceback�exchange� routing_keyrZ �client�root�root_id�parent� parent_id�children)rb rc )r� r* r+ r� r� r� r� r� ) r* r+ r� r� r� r� r� r� r� r� r� r� c sd |� _ |� _� jd ur4t� fdd�|p(dD ��� _nt� � _� j� j� jd�� _|r`� j� |� d S )Nc 3 s( | ] }|� j jv r� j j�|�V qd S r% )� cluster_state�tasks�get)�.0�task_idre r. r/ � <genexpr>" s �z Task.__init__.<locals>.<genexpr>r. )r� r� r� ) r� r� r r� �_serializable_children�_serializable_root�_serializable_parent�_serializer_handlersrb r� )r) r� r� r� r+ r. re r/ r( s � �z Task.__init__c s� |pi }||�} | d ur&|| ||� n|� � } | |kr~| j|kr~|| �|| j�kr~| j�| �� � d ur�� fdd�|�� D �}n|j| |d� | j�|� d S )Nc s i | ]\}}|� v r||�qS r. r. )r� rp rq �Zkeepr. r/ � <dictcomp>E s z Task.event.<locals>.<dictcomp>)r� rB )�upperr� � merge_rulesr� rj r� rb ) r) rk rB rA rJ � precedencer} Ztask_event_to_state�RETRYr� r. r� r/ ra 1 s � �z Task.eventc s8 � sg n� � �du r�j n��� ��fdd�}t|� �S )z;Information about this task suitable for on-screen display.Nc 3 s8 t ��t � � D ]"} t�| d �}|d ur| |fV qd S r% )�listrL )�key�value��extrarJ r) r. r/ �_keysS s zTask.info.<locals>._keys)� _info_fieldsr| )r) rJ r� r� r. r� r/ �infoN s z Task.infoc C s t �| �S r% )�R_TASKr� re r. r. r/ r� [ s z Task.__repr__c s& t j� �jj�� ��fdd��jD �S )Nc s" i | ]}|�|t �� �|���qS r. )r )r� rp �r� �handlerr) r. r/ r� a s z Task.as_dict.<locals>.<dictcomp>)rt �__getattribute__r� r� r� re r. r� r/ �as_dict^ s �z Task.as_dictc C s dd� | j D �S )Nc S s g | ] }|j �qS r. �r� )r� �taskr. r. r/ � <listcomp>f r: z/Task._serializable_children.<locals>.<listcomp>)r� �r) r� r. r. r/ r� e s zTask._serializable_childrenc C s | j S r% )r� r� r. r. r/ r� h s zTask._serializable_rootc C s | j S r% )r� r� r. r. r/ r� k s zTask._serializable_parentc C s t | j| �� ffS r% )rK r- r� re r. r. r/ rf n s zTask.__reduce__c C s | j S r% )r� re r. r. r/ r� q s zTask.idc C s | j d u r| jS | j jS r% )r� r� r� re r. r. r/ �originu s z Task.originc C s | j tjv S r% �r� r Z READY_STATESre r. r. r/ �readyy s z Task.readyc C s2 z| j o| jjj| j W S ty, Y d S 0 d S r% )r� r� r� �data�KeyErrorre r. r. r/ r� } s z Task.parentc C s2 z| j o| jjj| j W S ty, Y d S 0 d S r% )r� r� r� r� r� re r. r. r/ r� � s z Task.root)NNN)NN)<r1 r2 r3 r4 r� r r r r! r r r" r# r* r+ r� r� r� r� r� r� rB r� r� r� r� r� r� r� r �PENDINGr� rZ r� r� r� �RECEIVEDr� r� r( r� r} �TASK_EVENT_TO_STATEr� r� ra r� r� r� r� r� r� rf r� r� r� r� r r� r� r. r. r. r/ r � s� � ���������������� � � r c @ s e Zd ZdZeZeZdZdZdZd9dd�Z e d d � �Z d d � Z d:dd�Z d;ed�dd�Zd<dd�Zd=ed�dd�Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zefd%d&�Zd>ee d'�d(d)�Z d?ed*�d+d,�Z e Z d@d-d.�Z dAd/d0�Z!d1d2� Z"d3d4� Z#d5d6� Z$d7d8� Z%dS )Br zRecords clusters state.r rW N� �' c C s� || _ |d u rt|�n|| _|d u r,t|�n|| _|d u r>g n|| _|| _|| _|| _|| _t � � | _ i | _ t � | _i | _| �� t| jt�| _| j�t| | j�� t| jt�| _| j�t| | j�� d S r% )�event_callbackr �workersr� � _taskheap�max_workers_in_memory�max_tasks_in_memory� on_node_join� on_node_leave� threading�Lock�_mutex�handlers�set� _seen_types�_tasks_to_resolve�rebuild_taskheapr$ �_tasks_by_typer � tasks_by_typer� �!_deserialize_Task_WeakSet_Mapping�_tasks_by_worker�tasks_by_worker) r) �callbackr� r� �taskheapr� r� r� r� r� r� r. r. r/ r( � s> � �� � � �� �zState.__init__c C s | � � S r% )�_create_dispatcherre r. r. r/ �_event� s z State._eventc O sr |� dd�}| j�L z,||i |��W |r0| �� W d � S n|rN| �� 0 W d � n1 sd0 Y d S )N� clear_afterF)rw r� �_clear)r) r& r* r+ r� r. r. r/ � freeze_while� s � �zState.freeze_whileTc C s4 | j � | �|�W d � S 1 s&0 Y d S r% )r� � _clear_tasks�r) r� r. r. r/ � clear_tasks� s zState.clear_tasks)r� c C sJ |r.dd� | � � D �}| j�� | j�|� n | j�� g | jd d �< d S )Nc S s" i | ]\}}|j tjvr||�qS r. r� �r� r� r� r. r. r/ r� � s �z&State._clear_tasks.<locals>.<dictcomp>)� itertasksr� �clearr� r� )r) r� Z in_progressr. r. r/ r� � s � zState._clear_tasksc C s$ | j �� | �|� d| _d| _d S r6 )r� r� r� � event_count� task_countr� r. r. r/ r� � s z State._clearc C s4 | j � | �|�W d � S 1 s&0 Y d S r% )r� r� r� r. r. r/ r� � s z State.clearc K s^ z"| j | }|r|�|� |dfW S tyX | j|fi |�� }| j |< |df Y S 0 dS )zsGet or create worker by hostname. Returns: Tuple: of ``(worker, was_created)`` pairs. FTN)r� r� r� r )r) r? r+ r� r. r. r/ �get_or_create_worker� s ��zState.get_or_create_workerc C sH z| j | dfW S tyB | j|| d� }| j |< |df Y S 0 dS )zGet or create task by uuid.F�r� TN)r� r� r )r) r� r� r. r. r/ �get_or_create_task� s zState.get_or_create_taskc C s4 | j � | �|�W d � S 1 s&0 Y d S r% )r� r� r{ r. r. r/ ra � s z State.eventc C s | � t|d�d|g�d��d S )� Deprecated, use :meth:`event`.�-r� ��typer �r� r| �join�r) rk rJ r. r. r/ � task_event� s zState.task_eventc C s | � t|d�d|g�d��d S )r� r� r� r� r r� r� r. r. r/ � worker_event� s zState.worker_eventc s� � j j�� j�tddd��tddddd��� j� � j�� j�� j� j � � j j �� j � j � � � j � j �� � j� j ���jj�jj ��� jj�� jj�tttjdf� ��������� � � � � ������fdd� }|S ) Nr? rB rA r� rZ Tc sV � j d7 _ �r �� | � | d �d�\}}}z �|�}W n |yN Y n0 ||| �|fS |dk�r>z�| �\} } } W n |y� Y n�0 |dk} z�| �d } }W n6 |y� | rʈ| �d } }n�| � } �| < Y n0 | �|| | | � � �r|�s|dk�r� | � � �r.| �r.� | � ��| d � | |f|fS �n|dk�rR�| �\}} } } }|d k}z�|�d }}W n, |�y� � |� d � }�|< d }Y n0 |�r�| |_nVz �| �} W n$ |�y� �| � } �| < Y n0 | |_| d u�r| �r| �d | | � |�r| n| j}t� �}|d � k�r4�d � ||| |t|��}|�rd|� d k�rd�|� n |� |� |dk�r�� j d7 _ |�|| | | � |j }|d u�rЈ|� |�rЈ|�� |� �| �� |� |j �rz� j |j }W n |�y � �|� Y n0 |j� |� z� j�|�}W n |�y8 Y n0 |j�|� ||f|fS d S )Nrh r� r� r� rg FZonliner� r r� Tr ri r )r� � partitionra rw r� r� r� ro r r� r� �addr� r� �_add_pending_task_childr� r� r� )ra r r� rn �created�groupr8 �subjectr� r? rB rA Z is_offliner� r� rZ Zis_client_eventr� Z task_createdr� ZheapsZtimetupZ task_nameZ parent_taskZ _children�r r �add_typer� Z get_handlerZget_taskZget_task_by_type_setZget_task_by_worker_setZ get_workerZmax_events_in_heapr� r� r) r� r� ZtfieldsZ th_appendZth_popZwfieldsr� r. r/ r� s� � z(State._create_dispatcher.<locals>._event)r� � __getitem__r� r r� rx rw r� �heap_multiplierr� r� r� r� r� r r� r r� r� r� r r� rz rn )r) r� r. r r/ r� s* � �4^zState._create_dispatcherc C sD z| j |j }W n$ ty4 t� }| j |j< Y n0 |�|� d S r% )r� r� r� r r� )r) r� �chr. r. r/ r� | s z State._add_pending_task_childc s2 � fdd�| j �� D � }| jd d �< |�� d S )Nc s$ g | ] }� |j |j|jt|���qS r. )rZ rB r� r �r� �tr r. r/ r� � s �z*State.rebuild_taskheap.<locals>.<listcomp>)r� �valuesr� �sort)r) r �heapr. r r/ r� � s �zState.rebuild_taskheap)�limitc c s6 t | j�� �D ]"\}}|V |r|d |kr q2qd S )Nrh )� enumerater� rj )r) r �index�rowr. r. r/ r� � s zState.itertasks��reversec c sb | j }|rt|�}t� }t|d|�D ]8}|d � }|dur$|j}||vr$||fV |�|� q$dS )zkGenerator yielding tasks ordered by time. Yields: Tuples of ``(uuid, Task)``. r � N)r� �reversedr� r r� r� )r) r r Z_heap�seenZevtupr� r� r. r. r/ � tasks_by_time� s zState.tasks_by_timec s" t � fdd�| j|d�D �d|�S )z�Get all tasks by type. This is slower than accessing :attr:`tasks_by_type`, but will be ordered by time. Returns: Generator: giving ``(uuid, Task)`` pairs. c 3 s$ | ] \}}|j � kr||fV qd S r% �r� r� r r. r/ r� � s �z'State._tasks_by_type.<locals>.<genexpr>r r �r r )r) r� r r r. r r/ r� � s �zState._tasks_by_typec s" t � fdd�| j|d�D �d|�S )znGet all tasks by worker. Slower than accessing :attr:`tasks_by_worker`, but ordered by time. c 3 s& | ] \}}|j j� kr||fV qd S r% )r� r? r� �r? r. r/ r� � s �z)State._tasks_by_worker.<locals>.<genexpr>r r r )r) r? r r r. r r/ r� � s �zState._tasks_by_workerc C s t | j�S )z%Return a list of all seen task types.)�sortedr� re r. r. r/ � task_types� s zState.task_typesc C s dd� | j �� D �S )z+Return a list of (seemingly) alive workers.c s s | ]}|j r|V qd S r% r� )r� �wr. r. r/ r� � r: z&State.alive_workers.<locals>.<genexpr>)r� r re r. r. r/ � alive_workers� s zState.alive_workersc C s t �| �S r% )�R_STATEr� re r. r. r/ r� � s zState.__repr__c C s8 | j | j| j| jd | j| j| j| jt| j �t| j �f fS r% ) r- r� r� r� r� r� r� r� � _serialize_Task_WeakSet_Mappingr� r� re r. r. r/ rf � s �zState.__reduce__) NNNNr� r� NNNN)T)T)T)T)N)NT)NT)NT)&r1 r2 r3 r4 r r r� r� r r( r r� r� r� r� r� r� r� r� r� ra r� r� r� r� r r� r rm r� r Ztasks_by_timestampr� r� r r r� rf r. r. r. r/ r � sH � { r c C s dd� | � � D �S )Nc S s i | ]\}}|d d� |D ��qS )c S s g | ] }|j �qS r. r� r r. r. r/ r� � r: z>_serialize_Task_WeakSet_Mapping.<locals>.<dictcomp>.<listcomp>r. )r� r� r� r. r. r/ r� � r: z3_serialize_Task_WeakSet_Mapping.<locals>.<dictcomp>�rj )�mappingr. r. r/ r � s r c s | pi } � fdd�| � � D �S )Nc s( i | ] \}}|t � fd d�|D ���qS )c 3 s | ]}|� v r� | V qd S r% r. )r� �i�r� r. r/ r� � r: z?_deserialize_Task_WeakSet_Mapping.<locals>.<dictcomp>.<genexpr>)r )r� r� Zidsr" r. r/ r� � s �z5_deserialize_Task_WeakSet_Mapping.<locals>.<dictcomp>r )r r� r. r" r/ r� � s �r� )Er4 rz �sysr� � collectionsr �collections.abcr r �decimalr � itertoolsr �operatorr r �typingr r �weakrefr r Z kombu.clocksr Zkombu.utils.objectsr Zceleryr Zcelery.utils.functionalr r r Zcelery.utils.logr �__all__�hasattrr� r� ry r= r1 �logger�warningr< r r� r� r� r� ZSTARTED�FAILUREr� �SUCCESSZREVOKEDZREJECTEDr� r$ �registerrC rG rH r rK rV r r r r r� r. r. r. r/ �<module> sr �� � ] G
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка