Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/celery/backends/__pycache__/dynamodb.cpython-39.pyc
Ðазад
a t�h�K � @ s� d Z ddlmZ ddlmZmZ ddlmZmZ ddlm Z ddl m Z ddl mZ dd lmZ zdd lZdd lmZ W n ey� d ZZY n0 d Zed d�Zee�ZG dd� de�Zd S )z"AWS DynamoDB result store backend.� )� namedtuple)�sleep�time)�Any�Dict)� _parse_url)�ImproperlyConfigured)� get_logger� )�KeyValueStoreBackendN)� ClientError)�DynamoDBBackend�DynamoDBAttribute��name� data_typec s^ e Zd ZdZdZdZdZdZdZdZ dZ e ddd�Z e d d d�Z e d d d�Ze d d d�Ze dd d�ZdZdZd=� fdd� Zd>dd�Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd?d"d#�Z d$d%� Z d&d'� Z e e e e!f d(�d)d*�Z"e e e e!f d(�d+d,�Z#d-d.� Z$e%d/d0� �Z&d1d2� Z'd3d4� Z(d5d6� Z)d7d8� Z*e+e,d(�d9d:�Z-� fd;d<�Z.� Z/S )@r z�AWS DynamoDB result backend. Raises: celery.exceptions.ImproperlyConfigured: if module :pypi:`boto3` is not available. Zceleryr NT�id�Sr �result�BZ chord_count�N� timestamp�ttlc s� t � j|i |�� || _|p | j| _ts0td��d}d }d }|d u�rrt|�\}} } } } } }| }| }|d u}|d u}||kr�td��|}| dkr�d| � �| _d| _t � d� | j�� n| | _| j j j}|d�}|r�|| _t|�d | j��| _t|�d | j��| _|�d | j�}|�rdzt|�| _W n@ t�yb } z&t jd |� d �|d� |�W Y d }~n d }~0 0 | �pn| j| _| j| j| jf| _d | _|�r�| j||d� d S )NzBYou need to install the boto3 library to use the DynamoDB backend.Fz6You need to specify both the Access Key ID and Secret.� localhostzhttp://localhost:z us-east-1z*Using local-only DynamoDB endpoint URL: {}Zdynamodb_endpoint_url�read�writeZ ttl_secondszTTL must be a number; got "�")�exc_info)� access_key_id�secret_access_key)�super�__init__�url� table_name�boto3r � parse_url� endpoint_url� aws_region�logger�warning�formatZappZconf�get�int�read_capacity_units�write_capacity_units�time_to_live_seconds� ValueError�error� _key_field� _value_field�_timestamp_field�_available_fields�_client� _get_client)�selfr" r# �args�kwargsZaws_credentials_given�aws_access_key_id�aws_secret_access_key�scheme�region�port�username�password�table�queryZaccess_key_givenZsecret_key_given�_getZconfig_endpoint_urlr �e�� __class__� ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/celery/backends/dynamodb.pyr! C s� � �� �� ���� ���zDynamoDBBackend.__init__c C s| | j du rvd| ji}|dur,|�||d�� | jdur@| j|d< tjdi |��| _ | �� | �� durv| �� | � � | j S )zGet client connection.NZ region_name)r; r< r& �dynamodb)rJ ) r6 r' �updater& r$ �client�_get_or_create_table�_has_ttl�_validate_ttl_methods�_set_table_ttl)r8 r r Zclient_parametersrH rH rI r7 � s( �� �� zDynamoDBBackend._get_clientc C s6 | j j| j jd�g| j| j jdd�g| j| jd�d�S )z=Get the boto3 structure describing the DynamoDB table schema.)� AttributeNameZ AttributeType�HASH)rQ ZKeyType)ZReadCapacityUnitsZWriteCapacityUnits)ZAttributeDefinitions� TableNameZ KeySchemaZProvisionedThroughput)r2 r r r# r- r. �r8 rH rH rI �_get_table_schema� s ������z!DynamoDBBackend._get_table_schemac C s� | � � }z| jj| jd�W S ty� } zz|jd �dd�}|dkr�| jjf i |��}t� d� | j�� | � d� t� d� | j�� |W Y d }~S |�W Y d }~n d }~0 0 d S ) z=Create table if not exists, otherwise return the description.�rS �Error�Code�UnknownZResourceNotFoundExceptionz*DynamoDB Table {} did not exist, creating.�ACTIVEz#DynamoDB Table {} is now available.N) rU r6 �describe_tabler# r �responser+ Z create_tabler( �infor* �_wait_for_table_status)r8 Z table_schemarE � error_code�table_descriptionrH rH rI rM � s( �� ��z$DynamoDBBackend._get_or_create_tablec C s | j du rdS | j dkS )z�Return the desired Time to Live config. - True: Enable TTL on the table; use expiry. - False: Disable TTL on the table; don't use expiry. - None: Ignore TTL on the table; don't use expiry. Nr )r/ rT rH rH rI rN � s �zDynamoDBBackend._has_ttlc C sb d}g }t |�D ]}t| j|�s|�|� q|r^t�djd�|�d�� tdjd�|�d���dS )z:Verify boto support for the DynamoDB Time to Live methods.)�update_time_to_live�describe_time_to_livezdboto3 method(s) {methods} not found; ensure that boto3>=1.9.178 and botocore>=1.12.178 are installed�,)�methodsz#boto3 method(s) {methods} not foundN) �list�hasattrr6 �appendr( r1 r* �join�AttributeError)r8 Zrequired_methodsZmissing_methods�methodrH rH rI rO � s" �����z%DynamoDBBackend._validate_ttl_methodsc C s | j | �� |d�d�S )zBGet the boto3 structure describing the DynamoDB TTL specification.)ZEnabledrQ )rS ZTimeToLiveSpecification)r# rN )r8 � ttl_attr_namerH rH rI �_get_ttl_specification s ��z&DynamoDBBackend._get_ttl_specificationc C s~ z| j j| jd�}W nd tyx } zL|jd �dd�}|jd �dd�}t�dj| j||d�� |�W Y d }~n d }~0 0 |S )NrV rW rX rY �MessagezJError describing Time to Live on DynamoDB table {table}: {code}: {message})rB �code�message) r6 rb r# r r\ r+ r( r1 r* )r8 � descriptionrE r_ � error_messagerH rH rI �_get_table_ttl_description s � ��z*DynamoDBBackend._get_table_ttl_descriptionc C s� | � � }|d d }|dv rd|d d }| �� r�|| jjkr�t�dj|dkrPdnd| jd �� |S nN|d v r�| �� s�t�dj|d kr�d nd | jd �� |S nt�dj|| jd�� |dkr�|n| jj}z@| j j f i | j |d���}t� dj| j| �� | jjd�� |W S t �y| } z\|jd �dd�}|jd �dd�}t�dj| �� �rRdnd| j||d�� |�W Y d}~n d}~0 0 dS ) z,Enable or disable Time to Live on the table.ZTimeToLiveDescriptionZTimeToLiveStatus)�ENABLEDZENABLINGrQ z5DynamoDB Time to Live is {situation} on table {table}rs zalready enabledzcurrently being enabled)Z situationrB )�DISABLEDZ DISABLINGrt zalready disabledzcurrently being disabledzWUnknown DynamoDB Time to Live status {status} on table {table}. Attempting to continue.)�statusrB )rk zUDynamoDB table Time to Live updated: table={table} enabled={enabled} attribute={attr})rB �enabled�attrrW rX rY rm zHError {action} Time to Live on DynamoDB table {table}: {code}: {message}ZenablingZ disabling)�actionrB rn ro N)rr rN � _ttl_fieldr r( �debugr* r# r) r6 ra rl r] r r\ r+ r1 ) r8 rp ru Z cur_attr_name� attr_name� specificationrE r_ rq rH rH rI rP - s| � ��� ��� ��&� ����� �� z DynamoDBBackend._set_table_ttlrZ c C sN d}|sJ| j j| jd�}t�d�| j|�� |d d }||k}td� qdS )z#Poll for the expected table status.FrV z+Waiting for DynamoDB table {} to become {}.�TableZ TableStatusr N)rL r[ r# r( rz r* r )r8 �expectedZachieved_stater` Zcurrent_statusrH rH rI r^ � s ��� z&DynamoDBBackend._wait_for_table_statusc C s | j | jj| jj|iid�S )z0Construct the item retrieval request parameters.)rS �Key)r# r2 r r �r8 �keyrH rH rI �_prepare_get_request� s ���z$DynamoDBBackend._prepare_get_requestc C s~ t � }| j| jj| jj|i| jj| jj|i| jj| jjt|�iid�}| �� rz|d � | j j| j jtt || j ��ii� |S )z/Construct the item creation request parameters.�rS �Itemr� ) r r# r2 r r r3 r4 �strrN rK ry r, r/ )r8 r� �valuer Z put_requestrH rH rI �_prepare_put_request� s* �� �����z$DynamoDBBackend._prepare_put_request)r� �returnc C sF t � }| j| jj| jj|i| jj| jjdi| jj| jjt|�iid�S )z7Construct the counter initialization request parameters�0r� )r r# r2 r r � _count_filedr4 r� )r8 r� r rH rH rI �_prepare_init_count_request� s �� ���z+DynamoDBBackend._prepare_init_count_requestc C s@ | j | jj| jj|iid| jj� d| jj� d�dddiidd�S ) z2Construct the counter increment request parameterszset z = z + :numz:numr �1Z UPDATED_NEW)rS r ZUpdateExpressionZExpressionAttributeValuesZ ReturnValues)r# r2 r r r� r� rH rH rI �_prepare_inc_count_request� s ����z*DynamoDBBackend._prepare_inc_count_requestc s d� vr i S � fdd�| j D �S )z1Convert get_item() response to field-value pairs.r� c s$ i | ] }|j � d |j |j �qS )r� r )�.0�field�� raw_responserH rI � <dictcomp>� s �z1DynamoDBBackend._item_to_dict.<locals>.<dictcomp>)r5 )r8 r� rH r� rI � _item_to_dict� s �z DynamoDBBackend._item_to_dictc C s | � � S �N)r7 rT rH rH rI rL � s zDynamoDBBackend.clientc C s< t |�}| �|�}| jjf i |��}| �|�}|�| jj�S r� )r� r� rL Zget_itemr� r+ r3 r )r8 r� �request_parameters� item_response�itemrH rH rI r+ s zDynamoDBBackend.getc C s* t |�}| �||�}| jjf i |�� d S r� )r� r� rL �put_item)r8 r� r� r� rH rH rI �set s zDynamoDBBackend.setc s � fdd�|D �S )Nc s g | ]}� � |��qS rH )r+ )r� r� rT rH rI � <listcomp> � z(DynamoDBBackend.mget.<locals>.<listcomp>rH )r8 �keysrH rT rI �mget s zDynamoDBBackend.mgetc C s( t |�}| �|�}| jjf i |�� d S r� )r� r� rL Z delete_item)r8 r� r� rH rH rI �delete s zDynamoDBBackend.deletec C sD t |�}| �|�}| jjf i |��}|d | jj | jj }t|�S )z<Atomically increase the chord_count and return the new count� Attributes)r� r� rL Z update_itemr� r r r, )r8 r� r� r� Z new_countrH rH rI �incr s zDynamoDBBackend.incrc sD | � |d �}| �t|��}| jjf i |�� t� j||fi |��S )Nr )Zget_key_for_chordr� r� rL r� r �_apply_chord_incr)r8 Zheader_result_args�bodyr: Z chord_keyZinit_count_requestrF rH rI r� s ��z!DynamoDBBackend._apply_chord_incr)NN)NN)rZ )0�__name__� __module__� __qualname__�__doc__r# r- r. r' r& r/ Zsupports_autoexpirer r2 r3 r� r4 ry r5 Zimplements_incrr! r7 rU rM rN rO rl rr rP r^ r� r� r� r r r� r� r� �propertyrL r+ r� r� r� �bytesr, r� r� � __classcell__rH rH rF rI r sL Y p r )r� � collectionsr r r �typingr r Zkombu.utils.urlr r% Zcelery.exceptionsr Zcelery.utils.logr �baser r$ Zbotocore.exceptionsr � ImportError�__all__r r� r( r rH rH rH rI �<module> s
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка