Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/celery/backends/__pycache__/redis.cpython-39.pyc
Ðазад
a t�hg � @ s� d Z ddlZddlmZ ddlmZ ddlmZmZm Z ddl m Z ddl m Z ddlmZ dd lmZmZ dd lmZ dd lmZ dd lmZ dd lmZmZm Z ddl m Z m Z ddl m!Z!m"Z" ddl#m$Z$ ddl%m&Z& ddl'm(Z(m)Z) ddl*m+Z+ zddl,Z-ddl.m/Z/ W n e0�y, dZ-dZ/Y n0 z ddl1Z-W n e0�yN Y n0 dZ2dZ3dZ4dZ5dZ6dZ7d Z8d Z9d Z:e$e;�Z<G d d � d e)�Z=G d!d"� d"e+e(�Z>e?e-d#d��r�G d$d%� d%e-j@jAe-jB�ZCG d&d'� d'e>�ZDdS )(zRedis result store backend.� N)�contextmanager)�partial)� CERT_NONE� CERT_OPTIONAL� CERT_REQUIRED)�unquote)�retry_over_time)�cached_property)� _parse_url�maybe_sanitize_url)�states)�task_join_will_block)�maybe_signature)�BackendStoreError� ChordError�ImproperlyConfigured)� GroupResult�allow_join_result)�_regen� dictfilter)� get_logger)�humanize_seconds� )�AsyncBackendMixin�BaseResultConsumer)�BaseKeyValueStoreBackend)�get_redis_error_classes)� RedisBackend�SentinelBackendzW You need to install the redis library in order to use the Redis result store backend. zp You need to install the redis library with support of sentinel in order to use the Redis result store backend. z� Setting ssl_cert_reqs=CERT_OPTIONAL when connecting to redis means that celery might not validate the identity of the redis broker when connecting. This leaves you vulnerable to man in the middle attacks. z� Setting ssl_cert_reqs=CERT_NONE when connecting to redis means that celery will not validate the identity of the redis broker when connecting. This leaves you vulnerable to man in the middle attacks. z� SSL connection parameters have been provided but the specified URL scheme is redis://. A Redis SSL connection URL should use the scheme rediss://. zv A rediss:// URL must have parameter ssl_cert_reqs and this must be set to CERT_REQUIRED, CERT_OPTIONAL, or CERT_NONE z+Connection to Redis lost: Retry (%s/%s) %s.z� Retry limit exceeded while trying to reconnect to the Celery redis result store backend. The Celery application must be restarted. c s� e Zd ZdZ� fdd�Z� fdd�Zdd� Zedd � �Zd d � Z � fd d �Z dd� Z dd� Z dd� Z d dd�Zdd� Zdd� Zdd� Z� ZS ) �ResultConsumerNc sF t � j|i |�� | jj| _| jj| _| jj| _| jj | _ t � | _ d S �N) �super�__init__�backendZget_key_for_task�_get_key_for_taskZ decode_result�_decode_result�ensure�_ensure�connection_errors�_connection_errors�set� subscribed_to��self�args�kwargs�� __class__� ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/celery/backends/redis.pyr" S s zResultConsumer.__init__c sh z&| j jj�� | jd ur$| j�� W n2 tyX } zt�t |�� W Y d }~n d }~0 0 t � � � d S r ) r# �client�connection_pool�reset�_pubsub�close�KeyError�logger�warning�strr! � on_after_fork)r- �er0 r2 r3 r= [ s $z ResultConsumer.on_after_forkc C s� d | _ | jjj�� | jrT| jj�| j�}dd� |D �}|D ]}| �| �|�d � q<| jjj dd�| _ | jr|| j j | j� n*| j j� d| j j �| j _ | j j �| j j� d S )Nc S s g | ] }|r|�qS r2 r2 )�.0�metar2 r2 r3 � <listcomp>k � z4ResultConsumer._reconnect_pubsub.<locals>.<listcomp>T�Zignore_subscribe_messages�pubsub)r7 r# r4 r5 r6 r+ �mget�on_state_changer% rD � subscribe�get_connectionZ shard_hint� connectionZregister_connect_callbackZ on_connect)r- Zmetasr@ r2 r2 r3 �_reconnect_pubsubd s ��z ResultConsumer._reconnect_pubsubc c sX z d V W nH | j yR z| �| jd� W n | j yL t�t� � Y n0 Y n0 d S )Nr2 )r) r' rJ r: �critical�E_RETRY_LIMIT_EXCEEDED�r- r2 r2 r3 �reconnect_on_error| s z!ResultConsumer.reconnect_on_errorc C s |d t jv r | �|d � d S )N�status�task_id)r Z READY_STATES� cancel_for)r- r@ r2 r2 r3 �_maybe_cancel_ready_task� s z'ResultConsumer._maybe_cancel_ready_taskc s t � �||� | �|� d S r )r! rF rR )r- r@ �messager0 r2 r3 rF � s z ResultConsumer.on_state_changec K s | j jjdd�| _| �|� d S )NTrC )r# r4 rD r7 � _consume_from)r- Zinitial_task_idr/ r2 r2 r3 �start� s �zResultConsumer.startc K s. |j f i |��D ]}|d ur| �|d � qd S r )Z _iter_metarF )r- �resultr/ r@ r2 r2 r3 �on_wait_for_pending� s z"ResultConsumer.on_wait_for_pendingc C s | j d ur| j �� d S r )r7 r8 rM r2 r2 r3 �stop� s zResultConsumer.stopc C sv | j rd| �� �D | j j|d�}|rD|d dkrD| �| �|d �|� W d � qr1 sX0 Y n|rrt�|� d S )N)�timeout�typerS �data)r7 rN Z get_messagerF r% �time�sleep)r- rY rS r2 r2 r3 � drain_events� s 6zResultConsumer.drain_eventsc C s" | j d u r| �|�S | �|� d S r )r7 rU rT �r- rP r2 r2 r3 � consume_from� s zResultConsumer.consume_fromc C sX | � |�}|| jvrT| j�|� | �� � | j�|� W d � n1 sJ0 Y d S r )r$ r+ �addrN r7 rG �r- rP �keyr2 r2 r3 rT � s z ResultConsumer._consume_fromc C sT | � |�}| j�|� | jrP| �� � | j�|� W d � n1 sF0 Y d S r )r$ r+ �discardr7 rN Z unsubscriberb r2 r2 r3 rQ � s zResultConsumer.cancel_for)N)�__name__� __module__� __qualname__r7 r" r= rJ r rN rR rF rU rW rX r^ r` rT rQ � __classcell__r2 r2 r0 r3 r P s r c sF e Zd ZdZeZeZer ejndZdZdZ dZ dZ d<� fdd� Z dd� Z e� fd d ��Zd d � Zd d� Zdd� Zdd� Zdd� Zdd� Zdd� Z� fdd�Zdd � Zd d � Zd d � Zd!d"� Ze j e j fd#d$�Z d%d&� Z d'd(� Z!ed)d*� �Z"ed+d,� �Z#d=d-d.�Z$d/d0� Z%d1d2� Z&d3d4� Z'e(d5d6� �Z)ed7d8� �Z*d>� fd:d;� Z+� Z,S )?r zyRedis task result store. It makes use of the following commands: GET, MGET, DEL, INCRBY, EXPIRE, SET, SETEX NTi c s t � jf dti|�� | jjj} | jd u r6tt� � ��|rLd|v rL|d }}|p\| d�p\| j | _ || _ | d�} | d�} | d�} | d�} | d�}| d �p�d | d �p�d | d �p�d| d�| j | o�t | �| p�d| o�t | �d�| _ | d�}|r�|| j d< |r�|| j d< | �r | | j d< | d�}|�r2| j �|� | j| j d< |�rH| �|| j �| _ d| j v �r�t| j d tj��r�d}ttttttd�}| j �d|�}|�||�}||�� v�r�tt��|tk�r�t�t� n|tk�r�t�t � || j d< || _ t �r�t � nd\| _ | _ | �!| | j| j"| j#| j$�| _%d S ) NZ expires_typez://Zredis_max_connectionsZredis_socket_timeoutZ redis_socket_connect_timeoutZredis_retry_on_timeoutZredis_socket_keepaliveZ#redis_backend_health_check_intervalZ redis_host� localhostZ redis_porti� Zredis_dbr Zredis_passwordF)�host�port�db�password�max_connections�socket_timeout�retry_on_timeout�socket_connect_timeoutZredis_username�username�health_check_interval�socket_keepaliveZredis_backend_use_ssl�connection_class�MISSING)r r r �required�optional�none� ssl_cert_reqs)r2 r2 )&r! r" �int�app�conf�get�redisr �E_REDIS_MISSING�striprn �_ConnectionPool�float� connparams�update�connection_class_ssl�_params_from_url� issubclass� SSLConnectionr r r �values� ValueError�%E_REDIS_SSL_CERT_REQS_MISSING_INVALIDr: r; �W_REDIS_SSL_CERT_OPTIONAL�W_REDIS_SSL_CERT_NONE�urlr r( Zchannel_errorsr �acceptZ_pending_resultsZ_pending_messages�result_consumer)r- rj rk rl rm rn r� r5 r/ �_getro rq rp rt rs rr �sslZssl_cert_reqs_missingZssl_string_to_constantrz r0 r2 r3 r" � s� �� � �� � �zRedisBackend.__init__c s� t |�\}}}}}}�t|fi t||||��dd �d����� |dkr�� �| jjd| d�� � �dd � � �dd � � �d� n|� d < g d �} |d kr�t� fd d �| D ��s�t�fdd �| D ��r�tt ��|dk�rtj � d< | D ] } ��| d �} | r�t | �� | < q� � d ��pd} t | t��r.| �d�n| } t| �� d < ��� D ],\} }| tjjv �rFtjj| |��| < �qF� ��� � S )NZ virtual_host)rj rk rr rm rl �socket�/)ru �pathrj rk rq rl )Z ssl_ca_certsZ ssl_certfileZ ssl_keyfilerz r c 3 s | ]}|� v V qd S r r2 �r? rc )r� r2 r3 � <genexpr>N rB z0RedisBackend._params_from_url.<locals>.<genexpr>c 3 s | ]}|� v V qd S r r2 r� )�queryr2 r3 r� O rB Zredissru r )r �dictr �popr� r ZUnixDomainSocketConnection�anyr� �&E_REDIS_SSL_PARAMS_AND_SCHEME_MISMATCHr� r r~ � isinstancer< r� r{ �itemsrI ZURL_QUERY_ARGUMENT_PARSERS)r- r� �defaults�schemerj rk rr rm r� Zssl_param_keysZ ssl_settingZssl_valrl rc �valuer2 )r� r� r3 r� 3 sP � ��� � � z RedisBackend._params_from_urlc s. t � j}d| jv r*|�� }|�| jd � |S )N� retry_policy)r! r� �_transport_options�copyr� )r- r� r0 r2 r3 r� j s zRedisBackend.retry_policyc C s t � s| j�|� d S r )r r� r` )r- ZproducerrP r2 r2 r3 � on_task_calls s zRedisBackend.on_task_callc C s | j �|�S r )r4 r~ �r- rc r2 r2 r3 r~ w s zRedisBackend.getc C s | j �|�S r )r4 rE )r- �keysr2 r2 r3 rE z s zRedisBackend.mgetc K s> t | jfi |��}|�d�}t|| j|i t| j|�fi |��S )N� max_retries)r� r� r~ r r( r �on_connection_error)r- Zfunr. �policyr� r� r2 r2 r3 r& } s ��zRedisBackend.ensurec C s* t |�}t�t�� ||pdt|d�� |S )NZInfzin )�nextr: �error�E_LOSTr� r )r- r� �excZ intervals�retriesZttsr2 r2 r3 r� � s �z RedisBackend.on_connection_errorc K s: t |t�r t|�| jkr td��| j| j||ffi |��S )Nz!value too large for Redis backend)r� r< �len�_MAX_STR_VALUE_SIZEr r& �_set)r- rc r� r� r2 r2 r3 r* � s zRedisBackend.setc C sf | j �� �H}| jr$|�|| j|� n |�||� |�||� |�� W d � n1 sX0 Y d S r )r4 �pipeline�expires�setexr* �publish�execute)r- rc r� �piper2 r2 r3 r� � s zRedisBackend._setc s t � �|� | j�|� d S r )r! �forgetr� rQ r_ r0 r2 r3 r� � s zRedisBackend.forgetc C s | j �|� d S r )r4 �deleter� r2 r2 r3 r� � s zRedisBackend.deletec C s | j �|�S r )r4 �incrr� r2 r2 r3 r� � s zRedisBackend.incrc C s | j �||�S r )r4 �expire)r- rc r� r2 r2 r3 r� � s zRedisBackend.expirec C s | j �| �|d�d� d S )N�.tr )r4 r� �get_key_for_group)r- �group_idrV r2 r2 r3 � add_to_chord� s zRedisBackend.add_to_chordc C sB ||�\}}}}||v r"| � |�}||v r>td|� d|����|S )Nz Dependency z raised )Zexception_to_pythonr ) r- �tup�decode�EXCEPTION_STATES�PROPAGATE_STATES�_�tid�state�retvalr2 r2 r3 �_unpack_chord_result� s z!RedisBackend._unpack_chord_resultc C s | � | �|d�|� d S )N�.s)r* r� )r- r� Z chord_sizer2 r2 r3 �set_chord_size� s zRedisBackend.set_chord_sizec K s> t |d t�s:| jj|� }tdd� |jD ��r:|j| d� d S )Nr c s s | ]}t |t�V qd S r )r� r )r? �nrr2 r2 r3 r� � rB z+RedisBackend.apply_chord.<locals>.<genexpr>)r# )r� r r| r r� �results�save)r- Zheader_result_args�bodyr/ � header_resultr2 r2 r3 � apply_chord� s zRedisBackend.apply_chordc C s | j �dd�S )NZresult_chord_orderedT)r� r~ rM r2 r2 r3 � _chord_zset� s zRedisBackend._chord_zsetc C s | j j�di �S )NZ result_backend_transport_options)r| r} r~ rM r2 r2 r3 r� � s z RedisBackend._transport_optionsc s | j }|j|j|j }}} |r$|s(d S | d u r4d} | j} | �|d�} | �|d�} | �|d�} | �||�}| �d|||g�}| �� ��}| j r�|� | || i�� | dd�n|� | |�� | ��| ��| �}| jr�|�| | j��| | j��| | j�}|�� d d� \}}}}W d � n1 �s0 Y t|�p.d�}|�r �zBt|j|d �}t|�| }||k�rzt�|�}|d u�r�|�� |j�r�|jn|j}t� � ||j j d d �}W d � n1 �s�0 Y n|| j | j � �| �� �@}| j �r�|� | dd �}n|�!| d|�}|�� \}W d � n1 �s(0 Y � �fd d�|D �}z�z|�"|� W n� t#�y� } zzt$�%d|j|� | �&|t'd|����W Y d }~W | �� �*}|�(| ��(| ��(| ��� W d � n1 �s�0 Y W S d }~0 0 W | �� �*}|�(| ��(| ��(| ��� W d � n1 �s(0 Y nF| �� �*}|�(| ��(| ��(| ��� W d � n1 �sn0 Y 0 W n� t'�y� } z(t$�%d|j|� | �&||�W Y d }~S d }~0 t#�y } z2t$�%d|j|� | �&|t'd|����W Y d }~S d }~0 0 d S )Nz+infz.jr� r� r z-inf� r )r| T)rY � propagate���c s g | ]}�|� ��qS r2 r2 )r? r� �r� �unpackr2 r3 rA rB z5RedisBackend.on_chord_part_return.<locals>.<listcomp>z Chord callback for %r raised: %rzCallback error: zChord %r raised: %rz Join error: ))r| �id�group� group_indexr4 r� Z encode_result�encoder� r� ZzaddZzcountZrpushZllenr~ r� r� r� r{ r Zchordr ZrestoreZon_ready�supports_native_joinZ join_native�joinr r} Zresult_chord_join_timeoutr� r� ZzrangeZlrange�delay� Exceptionr: � exceptionZchord_error_from_stackr r� )r- �requestr� rV r� r/ r| r� �gidr� r4 ZjkeyZtkeyZskey�encodedr� r� r� Z readycountZ totaldiffZchord_size_bytes�callback�totalr� Z join_funcZreslr� r2 r� r3 �on_chord_part_return� s� � ������8 � ��( *� � ���(� ���*� ���. �z!RedisBackend.on_chord_part_returnc K s | � � | jf i |��d�S )N)r5 )� _get_client� _get_pool�r- �paramsr2 r2 r3 �_create_client+ s �zRedisBackend._create_clientc C s | j jS r )r Z StrictRedisrM r2 r2 r3 r� 0 s zRedisBackend._get_clientc K s | j f i |��S r )�ConnectionPoolr� r2 r2 r3 r� 3 s zRedisBackend._get_poolc C s | j d u r| jj| _ | j S r )r� r r� rM r2 r2 r3 r� 6 s zRedisBackend.ConnectionPoolc C s | j f i | j��S r )r� r� rM r2 r2 r3 r4 < s zRedisBackend.clientr2 c s( |si n|}t � �|t|| j| jd��S )N)r� r� )r! � __reduce__r� r� r� r, r0 r2 r3 r� @ s �zRedisBackend.__reduce__)NNNNNNN)N)r2 N)-re rf rg �__doc__r r r� r� rn Zsupports_autoexpirer� r� r" r� r r� r� r~ rE r& r� r* r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� �propertyr� r4 r� rh r2 r2 r0 r3 r � s\ �a7 � � _ r �sentinelc @ s e Zd ZdZdS )� SentinelManagedSSLConnectionz�Connect to a Redis server using Sentinel + TLS. Use Sentinel to identify which Redis server is the current master to connect to and when connecting to the Master server, use an SSL Connection. N)re rf rg r� r2 r2 r2 r3 r� G s r� c sf e Zd ZdZdZeedd�Zer$endZ � fdd�Z d� fdd � Z � fd d �Z d d � Z dd� Z� ZS )r z!Redis sentinel task result store.�;r� Nc s, | j d u rtt�� ��t� j|i |�� d S r )r� r �E_REDIS_SENTINEL_MISSINGr� r! r" r, r0 r2 r3 r" [ s zSentinelBackend.__init__Fc sD |rt � j|d�S dd� | jp d�| j�D �}| j�dd� |D ��S )zDReturn the server addresses as URIs, sanitizing the password or not.)�include_passwordc s s | ]}t |�V qd S r )r )r? �chunkr2 r2 r3 r� j s �z)SentinelBackend.as_uri.<locals>.<genexpr>� c s s( | ] }|� d �r |dd� n|V qdS )z:///Nr� )�endswith)r? �urir2 r2 r3 r� p s �)r! �as_urir� �split�_SERVER_URI_SEPARATORr� )r- r� Z uri_chunksr0 r2 r3 r� a s �� �zSentinelBackend.as_uric s� |� | j�}t|g d�}|D ]"}t� j||d�}|d �|� q dD ]}|�|� qDdD ]2}|d rX||d d v rX|d d �|�||< qX|S )N)�hosts)r� r� r� )rj rk rl rm )rl rm r )r� r� r� r! r� �appendr� r~ )r- r� r� �chunksr� r� r[ �paramr0 r2 r3 r� u s � z SentinelBackend._params_from_urlc K sV |� � }|�d�}| j�dd�}| j�di �}| jjdd� |D �f||d�|��}|S )Nr� �min_other_sentinelsr �sentinel_kwargsc S s g | ]}|d |d f�qS )rj rk r2 )r? �cpr2 r2 r3 rA � rB z:SentinelBackend._get_sentinel_instance.<locals>.<listcomp>)r r )r� r� r� r~ r� ZSentinel)r- r� r� r� r r �sentinel_instancer2 r2 r3 �_get_sentinel_instance� s ���z&SentinelBackend._get_sentinel_instancec K s2 | j f i |��}| j�dd �}|j|| �� d�jS )N� master_name)� service_nameZ redis_class)r r� r~ Z master_forr� r5 )r- r� r r r2 r2 r3 r� � s �zSentinelBackend._get_pool)F)re rf rg r� r� �getattrr r� r� r� r" r� r� r r� rh r2 r2 r0 r3 r R s r )Er� r\ � contextlibr � functoolsr r� r r r � urllib.parser Zkombu.utils.functionalr Zkombu.utils.objectsr Zkombu.utils.urlr r Zceleryr Z celery._stater Z celery.canvasr Zcelery.exceptionsr r r Z celery.resultr r Zcelery.utils.functionalr r Zcelery.utils.logr Zcelery.utils.timer Z asynchronousr r �baser Zredis.connectionr Zkombu.transport.redisr � ImportErrorZredis.sentinel�__all__r� r� r� r� r� r� r� rL re r: r r r r� ZSentinelManagedConnectionr� r� r r2 r2 r2 r3 �<module> sb k �
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка