Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/celery/worker/__pycache__/worker.cpython-39.pyc
Ðазад
a t�h�8 � @ s4 d Z ddlZddlZddlmZmZ ddlmZ ddlmZ ddl m Z ddl m Z ddl m Z dd lmZmZ dd lmZmZmZ dd lmZmZ dd lmZ dd lmZ ddlm Z ddl m Z m Z ddl!m"Z" ddl#m$Z$ ddl%m&Z& z ddl'Z'W n e(�y dZ'Y n0 dZ)dZ*dZ+dZ,G dd� d�Z-dS )a� WorkController can be used to instantiate in-process workers. The command-line interface for the worker is in :mod:`celery.bin.worker`, while the worker program is in :mod:`celery.apps.worker`. The worker program is responsible for adding signal handlers, setting up logging, etc. This is a bare-bones worker without global side-effects (i.e., except for the global state stored in :mod:`celery.worker.state`). The worker consists of several components, all managed by bootsteps (mod:`celery.bootsteps`). � N)�datetime�timezone)� cpu_count)�detect_environment)� bootsteps)� concurrency)�signals)�RUN� TERMINATE)�ImproperlyConfigured�TaskRevokedError�WorkerTerminate)� EX_FAILURE�create_pidlock)�reload_from_cwd)�mlevel)� worker_logger)�default_nodename� worker_direct)� str_to_list)�default_socket_timeout� ��state)�WorkControllerg @z� Trying to select queue subset of {0!r}, but queue {1} isn't defined in the `task_queues` setting. If you want to automatically declare unknown queues you can enable the `task_create_missing_queues` setting. ze Trying to deselect queue subset of {0!r}, but queue {1} isn't defined in the `task_queues` setting. c @ sR e Zd ZdZdZdZdZdZdZdZ G dd� de j �Z dHdd�Z dIdd�Z d d � Zd d � Zd d� Zdd� Zdd� Zdd� Zdd� ZdJdd�Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Z d'd(� Z d)d*� Z dKd,d-�Z dLd.d/�Z dMd1d2�Z!dNd3d4�Z"dOd5d6�Z#dPd7d8�Z$d9d:� Z%d;d<� Z&d=d>� Z'd?d@� Z(dAdB� Z)e*dCdD� �Z+dQdFdG�Z,dS )Rr zUnmanaged worker instance.Nc @ s e Zd ZdZdZh d�ZdS )zWorkController.BlueprintzWorker bootstep blueprint.ZWorker> z celery.worker.components:Hubz celery.worker.components:StateDBz celery.worker.components:Timerz celery.worker.components:Beatz celery.worker.components:Poolz'celery.worker.autoscale:WorkerComponentz!celery.worker.components:ConsumerN)�__name__� __module__� __qualname__�__doc__�nameZ default_steps� r r ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/celery/worker/worker.py� BlueprintK s r" c K s� |p| j | _ t|�| _t�tj�| _| j j� � | j f i |�� | j f i |�� | j f i |�� | j f i | jf i |���� d S �N)�appr �hostnamer �nowr �utc� startup_time�loaderZ init_worker�on_before_init�setup_defaults� on_after_init�setup_instance� prepare_args)�selfr$ r% �kwargsr r r! �__init__Y s zWorkController.__init__c K s� || _ | �||� | �t|�� | jsLz t� | _W n tyJ d| _Y n0 t| j�| _|p`| j | _ | j � � | _ |d u r�| �� n|| _|| _tjj| d� t�| j�| _g | _| �� | j| j jd | j| j| j d�| _ | j j | fi |�� d S )N� �ZsenderZworker)�steps�on_start�on_close� on_stopped) �pidfile� setup_queues�setup_includesr r r �NotImplementedErrorr �loglevel�on_consumer_ready�ready_callbackr$ Zconnection_for_read� _conninfo�should_use_eventloop� use_eventloop�optionsr Z worker_init�send� _concurrencyZget_implementation�pool_clsr4 �on_init_blueprintr" r5 r6 r7 � blueprint�apply)r/ �queuesr> r8 �includerA Zexclude_queuesr0 r r r! r- d s4 � �z WorkController.setup_instancec C s d S r# r �r/ r r r! rF � s z WorkController.on_init_blueprintc K s d S r# r �r/ r0 r r r! r* � s z WorkController.on_before_initc K s d S r# r rL r r r! r, � s z WorkController.on_after_initc C s | j rt| j �| _d S r# )r8 r �pidlockrK r r r! r5 � s zWorkController.on_startc C s d S r# r )r/ �consumerr r r! r= � s z WorkController.on_consumer_readyc C s | j j�� d S r# )r$ r) Zshutdown_workerrK r r r! r6 � s zWorkController.on_closec C s( | j �� | j�� | jr$| j�� d S r# )Ztimer�stoprN �shutdownrM �releaserK r r r! r7 � s zWorkController.on_stoppedc C s� t |�}t |�}z| jjj�|� W n8 ty\ } z tt�� � ||���W Y d }~n d }~0 0 z| jjj� |� W n8 ty� } z tt �� � ||���W Y d }~n d }~0 0 | jj j r�| jjj�t | j�� d S r# )r r$ ZamqprI �select�KeyErrorr �SELECT_UNKNOWN_QUEUE�strip�formatZdeselect�DESELECT_UNKNOWN_QUEUE�confr Z select_addr% )r/ rJ �exclude�excr r r! r9 � s �� zWorkController.setup_queuesc sf t � jjj�}|r0|t |�7 }� fdd�|D � |� _dd� � jj�� D �}t t|�|B �� jj_d S )Nc s g | ]}� j j�|��qS r )r$ r) Zimport_task_module��.0�mrK r r! � <listcomp>� � z1WorkController.setup_includes.<locals>.<listcomp>c S s h | ] }|j j�qS r )� __class__r )r\ �taskr r r! � <setcomp>� s �z0WorkController.setup_includes.<locals>.<setcomp>)�tupler$ rX rJ �tasks�values�set)r/ Zincludes�prev� task_modulesr rK r! r: � s �z WorkController.setup_includesc K s |S r# r rL r r r! r. � s zWorkController.prepare_argsc C s t jj| d� d S )Nr3 )r Zworker_shutdownrC rK r r r! �_send_worker_shutdown� s z$WorkController._send_worker_shutdownc C s� z| j �| � W n� ty* | �� Y n� tyh } z(tjd|dd� | jtd� W Y d }~nVd }~0 t y� } z| j|j d� W Y d }~n&d }~0 t y� | jtd� Y n0 d S )NzUnrecoverable error: %rT)�exc_info)�exitcode) rG �startr � terminate� Exception�logger�criticalrO r � SystemExit�code�KeyboardInterrupt)r/ rZ r r r! rl � s " zWorkController.startc C s | j j| d|fdd� d S )N�register_with_event_loopz hub.register)�args� description)rG Zsend_all)r/ Zhubr r r! rt � s �z'WorkController.register_with_event_loopc C s | � | j|�S r# )Z_quick_acquire� _process_task�r/ �reqr r r! �_process_task_sem� s z WorkController._process_task_semc C sH z|� | j� W n2 tyB z | �� W n ty< Y n0 Y n0 dS )z2Process task by sending it to the pool of workers.N)Zexecute_using_pool�poolr Z_quick_release�AttributeErrorrx r r r! rw � s z WorkController._process_taskc C s& z| j �� W n ty Y n0 d S r# )rN �closer| rK r r r! �signal_consumer_close� s z$WorkController.signal_consumer_closec C s t � dko | jjjjo | jj S )N�default)r r? � transportZ implementsZ asynchronousr$ Z IS_WINDOWSrK r r r! r@ � s ��z#WorkController.should_use_eventloopFc C sF |dur|| _ | jjtkr:| �� |r.| jjr:| jdd� | �� dS )z'Graceful shutdown of the worker server.NT��warm) rk rG r r r~ r{ � signal_safe� _shutdownri )r/ � in_sighandlerrk r r r! rO � s zWorkController.stopc C s0 | j jtkr,| �� |r | jjr,| jdd� dS )z.Not so graceful shutdown of the worker server.Fr� N)rG r r r~ r{ r� r� )r/ r� r r r! rm � s zWorkController.terminateTc C sR | j d urNtt��, | j j| | d� | j �� W d � n1 sD0 Y d S )N)rm )rG r �SHUTDOWN_SOCKET_TIMEOUTrO �join)r/ r� r r r! r� s zWorkController._shutdownc C sT t | j|||d�� | jr.| j�� | j�� z| j�� W n tyN Y n0 d S )N)� force_reload�reloader)�list�_reload_modulesrN Zupdate_strategiesZreset_rate_limitsr{ Zrestartr; )r/ �modules�reloadr� r r r! r� s � zWorkController.reloadc s. � �fdd�t |d u r �jjjn|p&d�D �S )Nc 3 s | ]}�j |fi � ��V qd S r# )�_maybe_reload_moduler[ �r0 r/ r r! � <genexpr> s �z1WorkController._reload_modules.<locals>.<genexpr>r )rf r$ r) rh )r/ r� r0 r r� r! r� s � ��z WorkController._reload_modulesc C sH |t jvr$t�d|� | jj�|�S |rDt�d|� tt j| |�S d S )Nzimporting module %szreloading module %s)�sysr� ro �debugr$ r) Zimport_from_cwdr )r/ �moduler� r� r r r! r� s z#WorkController._maybe_reload_modulec C s8 t �tj�| j }| jjt�� t | j j �t |� � �d�S )N)�total�pid�clock�uptime)r r& r r' r( r Z total_count�os�getpid�strr$ r� �round� total_seconds)r/ r� r r r! �info' s �zWorkController.infoc C sb t d u rtd��t �t j�}|j|j|j|j|j|j |j |j |j |j |j|j|j|j|j|jd�S )Nz%rusage not supported by this platform)�utimeZstimeZmaxrssZixrssZidrssZisrssZminfltZmajfltZnswapZinblockZoublockZmsgsndZmsgrcvZnsignalsZnvcswZnivcsw)�resourcer; Z getrusageZ RUSAGE_SELFZru_utimeZru_stimeZ ru_maxrssZru_ixrssZru_idrssZru_isrssZ ru_minfltZ ru_majfltZru_nswapZ ru_inblockZ ru_oublockZ ru_msgsndZ ru_msgrcvZ ru_nsignalsZru_nvcswZ ru_nivcsw)r/ �sr r r! �rusage. s( �zWorkController.rusagec C s` | � � }|�| j� | �� |�| jj� | j�� z| �� |d< W n tyZ d|d< Y n0 |S )Nr� zN/A)r� �updaterG rN r� r; )r/ r� r r r! �statsE s zWorkController.statsc C s dj | | jr| j�� ndd�S )z``repr(worker)``.z#<Worker: {self.hostname} ({state})>ZINIT)r/ r )rV rG Z human_staterK r r r! �__repr__O s �zWorkController.__repr__c C s | j S )z#``str(worker) == worker.hostname``.)r% rK r r r! �__str__V s zWorkController.__str__c C s t S r# r rK r r r! r Z s zWorkController.state�WARNc K s | j j} || _|| _| d|�| _| d|�| _| d||�| _| d|�| _| d|�| _| d|�| _ | pd| | _ | d| �| _ | d| �| _ | d | �| _ | d ||�| _| d |�| _| d ||�| _| d ||�| _| d||�| _| d|�| _| d| �| _t| d|��| _| d|�| _| d|�| _d S )NZworker_concurrencyZworker_send_task_eventsZ worker_poolZworker_consumerZ worker_timerZworker_timer_precisionZworker_autoscalerZworker_pool_putlocksZworker_pool_restartsZworker_state_dbZbeat_schedule_filenameZbeat_scheduler�task_time_limit�task_soft_time_limitZworker_max_tasks_per_childZworker_max_memory_per_childZworker_prefetch_multiplierZworker_disable_rate_limits�worker_lost_wait)r$ �eitherr< �logfiler � task_eventsrE � consumer_cls� timer_cls�timer_precision� optimization�autoscaler_cls� pool_putlocks� pool_restarts�statedb�schedule_filename� scheduler� time_limit�soft_time_limit�max_tasks_per_child�max_memory_per_child�int�prefetch_multiplier�disable_rate_limitsr� ) r/ r r< r� r� r{ r� r� r� r� r� r� r� �Or� r� r� r� rE Zstate_dbr� r� Z scheduler_clsr� r� r� r� r� r� Z_kwr� r r r! r+ ^ sN � �������z WorkController.setup_defaults)NN)NNNNNN)N)FN)F)T)NFN)N)FN) Nr� NNNNNNNNNNNNNNNNNNNNNNNNNN)-r r r r r$ rM rG r{ Z semaphorerk r r" r1 r- rF r* r, r5 r= r6 r7 r9 r: r. ri rl rt rz rw r~ r@ rO rm r� r� r� r� r� r� r� r� r� �propertyr r+ r r r r! r > s� � ( �r ).r r� r� r r Zbilliardr Zkombu.utils.compatr Zceleryr r rD r Zcelery.bootstepsr r Zcelery.exceptionsr r r Zcelery.platformsr r Zcelery.utils.importsr Zcelery.utils.logr r ro Zcelery.utils.nodenamesr r Zcelery.utils.textr Zcelery.utils.threadsr � r r� � ImportError�__all__r� rT rW r r r r r! �<module> s6
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка