Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/libcloud/storage/drivers/__pycache__/oss.cpython-39.pyc
Ðазад
a q�h�� � @ s� d dl Z d dlZd dlZd dlZd dlmZ d dlmZ zd dlm Z m Z W n" e yn d dl m Z m Z Y n0 d dlm Z d dlmZ d dlmZ d dlmZ d d lmZ d d lmZ d d lmZmZ d d lmZ d d lmZmZ d dlm Z m Z m Z d dlm Z d dl m!Z!m"Z"m#Z# d dl$m%Z% d dl$m&Z& d dl$m'Z' d dl$m(Z( d dl$m)Z) d dl$m*Z* g d�Z+dZ,dZ-dZ.dZ/G d d � d e �Z0G d d � d e0e �Z1G d d!� d!e �Z2G d"d#� d#e3�Z4G d$d%� d%e#�Z5dS )&� N)�sha1)�ET)�Element� SubElement)�httplib��urlquote)� urlencode)�b)�tostring)�PY3)�fixxpath�findtext)�read_in_chunks)�InvalidCredsError� LibcloudError)�ConnectionUserAndKey� RawResponse� XmlResponse)�MalformedResponseError)�Object� Container� StorageDriver)�ContainerError)�ContainerIsNotEmptyError)�InvalidContainerNameError)�ContainerDoesNotExistError)�ObjectDoesNotExistError)�ObjectHashMismatchError)�OSSStorageDriver�OSSMultipartUpload�EXPIRATION_SECONDS� CHUNK_SIZE�MAX_UPLOADS_PER_RESPONSEz%a, %d %b %Y %H:%M:%S GMTi� i � i� c @ s8 e Zd ZdZejejejgZdd� Z dd� Z dd� Z dS )� OSSResponseNc C s, t | j�}d| ko dkn p*|| jv S )N�� i+ )�int�status�valid_response_codes)�self�i� r+ ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/libcloud/storage/drivers/oss.py�successL s zOSSResponse.successc C s~ t | j�dkr| js| jS z8trDtjdd�}tj| j�d�|d�}n t�| j�}W n& tyx t d| j| j j d��Y n0 |S )z8 OSSResponse body is in utf-8 encoding. r �utf-8)�encoding)�parserzFailed to parse XML)�body�driver) �lenr1 Zparse_zero_length_bodyr r Z XMLParser�XML�encode� Exceptionr � connectionr2 )r) r0 r1 r+ r+ r, � parse_bodyP s � zOSSResponse.parse_bodyc C st | j tjtjfv r t| j��n:| j tjkr8tdtd��n | j tj krXtd| j | j f ��td| j | jf td��d S )NzLThis bucket is located in a different region. Please use the correct driver.�r2 z7The method is not allowed. Status code: %d, headers: %sz(Unknown error. Status code: %d, body: %s) r' r � UNAUTHORIZED� FORBIDDENr r1 �MOVED_PERMANENTLYr r �METHOD_NOT_ALLOWED�headers�r) r+ r+ r, � parse_errorc s � � ��zOSSResponse.parse_error) �__name__� __module__� __qualname__� namespacer � NOT_FOUND�CONFLICT� BAD_REQUESTr( r- r8 r@ r+ r+ r+ r, r$ G s �r$ c @ s e Zd ZdS )�OSSRawResponseN)rA rB rC r+ r+ r+ r, rH r s rH c sb e Zd ZdZdZdZeZeZ e dd� �Z e dd� �Z dd � Z d d � Zd d � Zd� fdd� Z� ZS )� OSSConnectionzC Represents a single connection to the Aliyun OSS Endpoint z aliyuncs.comZossc C s" dddd�}i }t |�� �D ]<\} } | �� } | |v rB| �� || < q | �|�r | �� || < q |rjt|�|d< | g} t|�� �D ]\} } | �| � q|d�| �}g } t|�� �D ]\} } | �d| | f � q�d�| �}g }|||fD ]} | r�|�| � q�d�|�}t � t j t |�t |�td��� �}|S )z� Signature = base64(hmac-sha1(AccessKeySecret, VERB + " " + CONTENT-MD5 + " " + CONTENT-TYPE + " " + EXPIRES + " " + CanonicalizedOSSHeaders + CanonicalizedResource)) � )z content-md5� content-type�expiresrL � z%s:%s)� digestmod)�list�items�lower�strip� startswith�str�sorted�append�join�base64� b64encode�hmac�newr r �digest)�methodr> �paramsrL � secret_key�path� vendor_prefixZspecial_headersZvendor_headers�key�value� key_lower�buf�_Zstring_to_signZ header_stringZvalues_to_signZb64_hmacr+ r+ r, �_get_auth_signature� s< � �z!OSSConnection._get_auth_signaturec C sX d}d| v r| d }nd| v r&| d }|rHz t |�W S tyF Y n0 t t�� �t S )z> Get expires timeout seconds from parameters. NrL �Expires)r& r6 �timer! )r^ rL r+ r+ r, � _get_expires� s zOSSConnection._get_expiresc C s( | � |�}t|�}| j|d< ||d< |S )NZOSSAccessKeyIdrh )rj rT Zuser_id)r) r^ Z expires_atrL r+ r+ r, �add_default_params� s z OSSConnection.add_default_paramsc C s t �tt �� �|d< |S )N�Date)ri �strftime�GMT_TIME_FORMAT�gmtime)r) r> r+ r+ r, �add_default_headers� s z!OSSConnection.add_default_headersc C sP | j rd| j j| jf }n| j}| j| j|||d | j|| jjd�|d< ||fS )Nz/%s%srh )r] r> r^ rL r_ r` ra � Signature)� _container�name�actionrg r] rb r2 �http_vendor_prefix)r) r^ r> r` r+ r+ r, �pre_connect_hook� s � z OSSConnection.pre_connect_hookN�GETFc sv d| j | jf | _|| _|rZ|jrZd|jv rHd|j|jd | jf | _nd|j| jf | _tt| �j||||||d�S )Nz%s.%s�locationz%s.%s.%s)rt r^ �datar> r] �raw) �_default_location�_domain�hostrr rs �extra�superrI �request)r) rt r^ ry r> r] rz � container�� __class__r+ r, r� � s � �zOSSConnection.request)NNNrw FN)rA rB rC �__doc__r| r{ r$ Z responseClsrH ZrawResponseCls� staticmethodrg rj rk rp rv r� � __classcell__r+ r+ r� r, rI v s / �rI c @ s e Zd ZdZdd� Zdd� ZdS )r z; Class representing an Aliyun OSS multipart upload c C s || _ || _|| _dS )aT Class representing an Aliyun OSS multipart upload :param key: The object/key that was being uploaded :type key: ``str`` :param id: The upload id assigned by Aliyun :type id: ``str`` :param initiated: The date/time at which the upload was started :type created_at: ``str`` N)rb �id� initiated)r) rb r� r� r+ r+ r, �__init__� s zOSSMultipartUpload.__init__c C s d| j S )Nz <OSSMultipartUpload: key=%s>)rb r? r+ r+ r, �__repr__ s zOSSMultipartUpload.__repr__N)rA rB rC r� r� r� r+ r+ r+ r, r � s r c @ s$ e Zd ZdZdZeZdZdZdZ dZ dZ dd � Z d?d d �Z d d � Zdd� Zd@dd�Zdd� ZdAdd�ZdBdd�ZdCdd�ZdDdd�Zd d � Zddefd d �ZdEd d!�Zd"d#� ZdFd%d&�ZdGd'd(�Z dHd)d*�Z dId+d,�Z dJd-d.�Z d/d0� Z d1d2� Z!d3d4� Z"d5d6� Z#d7d8� Z$d9d:� Z%d;d<� Z&d=d>� Z'dS )Kr z Aliyun OSSz!http://www.aliyun.com/product/oss�md5FTNzx-oss-c C sB | j �d�}|jtjkr,| j|jdd�}|S td|j | d��d S )N�/zBuckets/Bucket)�obj�xpath�Unexpected status code: %sr9 )r7 r� r' r �OK�_to_containers�objectr )r) �response� containersr+ r+ r, �iterate_containers s � �z#OSSStorageDriver.iterate_containersc c s� | � ||�}i }|r ||d< d}d}|s�|r4||d< | jjd||d�}|jtjkrdtd|j | d��| j|jd |d �}|j� t d | j d ��� � } | d k}d}|D ]} | j }| V q�q$dS )a� Return a generator of objects for the given container. :param container: Container instance :type container: :class:`Container` :keyword prefix: Only return objects starting with prefix :type prefix: ``str`` :keyword ex_prefix: (Deprecated.) Only return objects starting with ex_prefix :type ex_prefix: ``str`` :return: A generator of Object instances. :rtype: ``generator`` of :class:`Object` �prefixNF�markerr� �r^ r� r� r9 ZContents)r� r� r� � IsTruncated�r� rD �false)Z_normalize_prefix_argumentr7 r� r' r r� r �_to_objsr� r r rD rQ rs ) r) r� r� Z ex_prefixr^ �last_keyZ exhaustedr� �objects� is_truncatedr� r+ r+ r, �iterate_container_objects s< � ���� z*OSSStorageDriver.iterate_container_objectsc C s2 | � � D ]}|j|kr| S qtd | |d��d S )N�rc r2 �container_name)r� rs r )r) r� r� r+ r+ r, � get_containerM s �z OSSStorageDriver.get_containerc C s^ | j |d�}| �||�}| jj|d|d�}|jtjkrL| j|||jd�}|S t d | |d��d S )N)r� �HEAD�r] r� )� object_namer� r> �rc r2 r� ) r� �_get_object_pathr7 r� r' r r� �_headers_to_objectr> r )r) r� r� r� � object_pathr� r� r+ r+ r, � get_objectU s � ��zOSSStorageDriver.get_objectc C s� d}|r2t d�}t|d�}||_t|�}d|i}nd}t||| d�}| jjd|d|d �}|jtj krh|S |jtj kr�t d || d ��n |jtj kr�t d |j || d ��td |j | d��dS )z� @inherits :class:`StorageDriver.create_container` :keyword ex_location: The desired location where to create container :type keyword: ``str`` NZCreateBucketConfigurationZLocationConstraintrx rJ �rs r~ r2 r� �PUT�ry r] r� zgContainer with this name already exists. The name must be unique among all the containers in the system�rc r� r2 z'Bad request when creating container: %sr� r9 )r r �textr r r7 r� r' r r� rF r rG r r1 r ) r) r� Z ex_locationr~ �root�childry r� r� r+ r+ r, �create_containere s> � � �� �z!OSSStorageDriver.create_containerc C s` | j jdd|d�}|jtjkr"dS |jtjkr@td|j| d��n |jtjkr\t d | |jd��dS ) Nr� �DELETEr� Tz1Container must be empty before it can be deleted.r� r� F) r7 r� r' r � NO_CONTENTrF r rs rE r )r) r� r� r+ r+ r, �delete_container� s" � � �z!OSSStorageDriver.delete_containerc C sL | � |j|j�}| jj|dd|jd�}| j|| j|||j|||d�tj d�S )Nrw T�r] rz r� )r� r� �destination_path�overwrite_existing�delete_on_failure�r� �callbackr� �callback_kwargsZsuccess_status_code) r� r� rs r7 r� � _get_objectZ _save_objectr� r r� )r) r� r� r� r� �obj_pathr� r+ r+ r, �download_object� s � ��z OSSStorageDriver.download_objectc C sD | � |j|j�}| jj|dd|jd�}| j|t||j|d�tj d�S )Nrw Tr� )�iterator� chunk_sizer� ) r� r� rs r7 r� r� r r� r r� )r) r� r� r� r� r+ r+ r, �download_object_as_stream� s ���z*OSSStorageDriver.download_object_as_streamc C s | j |||||d�S )N)r� r� r~ � file_path� verify_hash)� _put_object)r) r� r� r� r~ r� r> r+ r+ r, � upload_object� s �z OSSStorageDriver.upload_objectc C s( d}d }| j r| j||||||d|d�S )Nr� F)r� r� r~ r] � query_args�streamr� r> )�supports_multipart_uploadr� )r) r� r� r� r~ r> r] r^ r+ r+ r, �upload_object_via_stream� s �z)OSSStorageDriver.upload_object_via_streamc C sT | � |j|j�}| jj|d|jd�}|jtjkr4dS |jtjkrPt d | |jd��dS )Nr� r� Tr� F) r� r� rs r7 r� r' r r� rE r )r) r� r� r� r+ r+ r, � delete_object� s � �z OSSStorageDriver.delete_objectc # s" � j std� d��d}d|i}|r*||d< |r6||d< � fdd�}� jj|||d �}|jtjkrrtd |j � d��|�� } | �t d � j d ��D ]0} || d �} || d�} || d�} t | | | �V q�| � t d� j d ��}|� � dkr�q | � t d� j d ��}| � t d� j d ��}||d< ||d< qBdS )a Extension method for listing all in-progress OSS multipart uploads. Each multipart upload which has not been committed or aborted is considered in-progress. :param container: The container holding the uploads :type container: :class:`Container` :keyword prefix: Print only uploads of objects with this prefix :type prefix: ``str`` :keyword delimiter: The object/key names are grouped based on being split by this delimiter :type delimiter: ``str`` :keyword max_uploads: The max uplod items returned for one request :type max_uploads: ``int`` :return: A generator of OSSMultipartUpload instances. :rtype: ``generator`` of :class:`OSSMultipartUpload` zFeature not supportedr9 z /?uploadsz max-uploadsr� � delimiterc s | � t|� jd��S �Nr� )r r rD )�noder� r? r+ r, �finder s �z=OSSStorageDriver.ex_iterate_multipart_uploads.<locals>.finderr� z.Error fetching multipart uploads. Got code: %sZUploadr� �Key�UploadIdZ Initiatedr� r� ZNextUploadIdMarkerZ NextKeyMarkerz key-markerzupload-id-markerN)r� r r7 r� r' r r� r8 �findallr rD r r rQ )r) r� r� r� Z max_uploads� request_pathr^ r� r� r1 r� rb � upload_idr� r� Z upload_markerZ key_markerr+ r? r, � ex_iterate_multipart_uploads� sN � ��� � ��z-OSSStorageDriver.ex_iterate_multipart_uploadsc C s: | j ||dd�D ]$}| �||j�}| j||j|d� qdS )a7 Extension method for removing all partially completed OSS multipart uploads. :param container: The container holding the uploads :type container: :class:`Container` :keyword prefix: Delete only uploads of objects with this prefix :type prefix: ``str`` N)r� �r� )r� r� rb �_abort_multipartr� )r) r� r� �uploadr� r+ r+ r, � ex_abort_all_multipart_uploads- s � z/OSSStorageDriver.ex_abort_all_multipart_uploadsc C s t |�}|S )Nr )r) rs r+ r+ r, �_clean_object_name? s z#OSSStorageDriver._clean_object_namer� c C sX | pi } |pi }|� dd�} |� dd�} |� dd�} | rdt| �� �D ] \} }| jd| } || | < qD| r�| dvr|td| ��| | | jd < | �||�}|r�d �||f�}| j|| ||| ||d �}|d }|d }|j} | d � dd�}|�r|d |k�rt d� ||d �|| d��n>|j t jk�rBt|||d| i| || d�}|S td|j | d��dS )zL Create an object and upload data using the given function. � content_typeN� meta_data�aclzmeta-%s)z public-read�privatezpublic-read-writezinvalid acl value: %sz object-acl�?)r� r� r� �request_methodr> r� r� r� �bytes_transferred�etag�"rJ � data_hashz(MD5 hash {0} checksum does not match {1})rc r� r2 �rs �size�hashr~ r� r� r2 z&Unexpected status code, status_code=%sr9 )�getrO rP ru �AttributeErrorr� rW Z_upload_objectr> �replacer �formatr' r r� r r )r) r� r� r] r� r~ r� r� r� r> r� r� r� rb rc r� Z result_dictr� r� � server_hashr� r+ r+ r, r� C sV ��� ��z OSSStorageDriver._put_objectc C s� | � ||�}|j�� |_|�� }|�td| jd��j} z4| j ||| ||d�} | \} } } | j || | |d�}W n8 t y� } z | j || |d� |�W Y d}~n d}~0 0 ||j d< d| | fS )a� Callback invoked for uploading data to OSS using Aliyun's multipart upload mechanism :param response: Response object from the initial POST request :type response: :class:`OSSRawResponse` :param data: Any data from the initial POST request :type data: ``str`` :param iterator: The generator for fetching the upload data :type iterator: ``generator`` :param container: The container owning the object to which data is being uploaded :type container: :class:`Container` :param object_name: The name of the object to which we are uploading :type object_name: ``str`` :keyword calculate_hash: Indicates if we must calculate the data hash :type calculate_hash: ``bool`` :return: A tuple of (status, checksum, bytes transferred) :rtype: ``tuple`` r� r� r� Nr� T)r� r� �readr1 r8 �findr rD r� �_upload_from_iterator�_commit_multipartr6 r� r> )r) r� ry r� r� r� �calculate_hashr� r1 r� �result�chunksr� r� r� �er+ r+ r, �_upload_multipart{ s( � � � z"OSSStorageDriver._upload_multipartc C s d}|r| � � }d}d}g } d|i} t|tddd�D ]�} |t| �7 }|rR|�| � | � � } | �| � t�| �� ��d�} d| i} || d < d � |t | �f�}| j j |d | | |d �}|j tjkr�td | d��|jd }| �||f� |d7 }q4|r�|�� }| ||fS )a� Uploads data from an interator in fixed sized chunks to OSS :param iterator: The generator for fetching the upload data :type iterator: ``generator`` :param object_path: The path of the object to which we are uploading :type object_name: ``str`` :param upload_id: The upload id allocated for this multipart upload :type upload_id: ``str`` :keyword calculate_hash: Indicates if we must calculate the data hash :type calculate_hash: ``bool`` :keyword container: the container object to upload object to :type container: :class:`Container` :return: A tuple of (chunk info, checksum, bytes transferred) :rtype: ``tuple`` Nr � �uploadIdT)r� Z fill_sizeZ yield_emptyr. z Content-MD5Z partNumberr� r� )r] ry r> r� zError uploading chunkr9 r� )Z_get_hash_functionr r" r3 �updaterX rY r\ �decoderW r r7 r� r' r r� r r> rV � hexdigest)r) r� r� r� r� r� r� r� �countr� r^ ry Z chunk_hashr> r� �respr� r+ r+ r, r� � s> � � z&OSSStorageDriver._upload_from_iteratorc C s� t d�}|D ]:\}}t|d�}t|d�} t|�| _t|d�} t|�| _q t|�} d|i} d�|t| �f�} | jj| | d|d�}|j t j kr�|j }|j |d �\}}d ||f }t|| d ��|�� }|�td| jd ��j}|S ) a� Makes a final commit of the data. :param object_path: Server side object path. :type object_path: ``str`` :param upload_id: ID of the multipart upload. :type upload_id: ``str`` :param upload_id: A list of (chunk_number, chunk_hash) tuples. :type upload_id: ``list`` :keyword container: The container owning the object to which data is being uploaded :type container: :class:`Container` ZCompleteMultipartUploadZPartZ PartNumber�ETagr� r� �POSTr� )�elementz"Error in multipart commit: %s (%s)r9 r� )r r rT r� r rW r r7 r� r' r r� r� Z_parse_error_detailsr r8 r� r rD )r) r� r� r� r� r� r� r� �partZpart_noZetag_idry r^ r� r� r �code�message�msgr1 r� r+ r+ r, r� � s. � � z"OSSStorageDriver._commit_multipartc C sN d|i}d� |t|�f�}| jj|d|d�}|jtjkrJtd|j | d��dS )a� Aborts an already initiated multipart upload :param object_path: Server side object path. :type object_path: ``str`` :param upload_id: ID of the multipart upload. :type upload_id: ``str`` :keyword container: The container owning the object to which data is being uploaded :type container: :class:`Container` r� r� r� r� z(Error in multipart abort. status_code=%dr9 N)rW r r7 r� r' r r� r )r) r� r� r� r^ r� r� r+ r+ r, r� , s � ��z!OSSStorageDriver._abort_multipartc c s* |� t|| jd��D ]}| �|�V qd S r� )r� r rD � _to_container)r) r� r� r r+ r+ r, r� D s � z OSSStorageDriver._to_containersc C s@ t |d| jd�t |d| jd�d�}tt |d| jd�|| d�}|S )NZ CreationDate�r r� rD ZLocation)Z creation_daterx �Namer� )r rD r )r) r r~ r� r+ r+ r, r I s �����z OSSStorageDriver._to_containerc s$ � �fdd�|� t|�jd��D �S )Nc s g | ]}�� |� ��qS r+ )�_to_obj)�.0r �r� r) r+ r, � <listcomp>Z � z-OSSStorageDriver._to_objs.<locals>.<listcomp>r� )r� r rD )r) r� r� r� r+ r r, r� Y s �zOSSStorageDriver._to_objsc C s� t |d| jd�}t |d| jd�}d|| �|�d�i}t |d| jd�}d|i}| �t |d| jd��}t|tt |d | jd��t |d | jd��d d �|||| d �} | S )NzOwner/IDr zOwner/DisplayName�owner)r� � display_nameZ LastModified� last_modifiedr� �Sizer� r� rJ r� )r rD � _safe_decoder r& r� ) r) r r� Zowner_idZowner_display_namer� r r~ rs r� r+ r+ r, r ] sF ����� ����� zOSSStorageDriver._to_objc C s@ z$|r t �|�\}}|�d�W S |W S ty: | Y S 0 dS )zf Decode it as an escaped string and then treate the content as UTF-8 encoded. r. N)�codecs� escape_decoder� r6 )r) �encodedZ unescapedZ_ignr+ r+ r, r z s z OSSStorageDriver._safe_decodec C s d|j S )z� Return a container path :param container: Container instance :type container: :class:`Container` :return: A path for this container. :rtype: ``str`` �/%s)rs )r) r� r+ r+ r, �_get_container_path� s z$OSSStorageDriver._get_container_pathc C s | � |�}d| }|S )ax Return an object's path. Aliyun OSS api puts the container name in the host, so ignore container here. :param container: Container instance :type container: :class:`Container` :param object_name: Object name :type object_name: :class:`str` :return: A path for this object. :rtype: ``str`` r )r� )r) r� r� Zobject_name_cleanedr� r+ r+ r, r� � s z!OSSStorageDriver._get_object_pathc C s� |d � dd�}|d |d d�}i }d|v r:|d |d< |�� D ]8\}}|�� �| jd �s`qB|� | jd d�}|||< qBt|t|d �||||| d �} | S ) Nr� r� rJ rK )r� r� z last-modifiedr zmeta-zcontent-lengthr� )r� rP rQ rS ru r r& ) r) r� r� r> r� r~ r� rb rc r� r+ r+ r, r� � s& � �z#OSSStorageDriver._headers_to_object)NN)N)FT)N)NTN)NN)N)r� NNNNFN)T)TN)N)N)(rA rB rC rs ZwebsiterI Z connectionClsZ hash_typeZsupports_chunked_encodingr� rD ru r� r� r� r� r� r� r� r� r� r� r� r# r� r� r� r� r� r� r� r� r� r r� r r r r� r� r+ r+ r+ r, r sf � 3 ( � � � � O � 9 � ; � G � 1 r )6rX r rZ ri �hashlibr Zlibcloud.utils.py3r Z lxml.etreer r � ImportErrorZxml.etree.ElementTreer r r r r r Zlibcloud.utils.xmlr r Zlibcloud.utils.filesr Zlibcloud.common.typesr r Zlibcloud.common.baser r r r Zlibcloud.storage.baser r r Zlibcloud.storage.typesr r r r r r �__all__rn r! r" r# r$ rH rI r� r r r+ r+ r+ r, �<module> sJ +v
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка