Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/libcloud/storage/drivers/__pycache__/s3.cpython-39.pyc
Ðазад
a q�hM� � @ s� d dl Z d dlZd dlZd dlmZ d dlZd dlmZ d dlZz0ej j j r^d dl m Z mZ nd dlm Z mZ W n" ey� d dlm Z mZ Y n0 d dlmZ d dlmZ d dlmZ d dlmZ d d lmZ d d lmZmZ d d lmZ d d lm Z m Z d d l m Z m Z d dl!m"Z"m#Z#m$Z$m%Z%m&Z& d dl'm(Z(m)Z)m*Z* d dl+m,Z, d dl+m-Z- d dl+m.Z. d dl+m/Z/ d dl+m0Z0 d dl+m1Z1 dZ2dZ3dZ4dZ5dZ6dZ7d Z8d Z9d Z:d Z;d Z<d!Z=d"Z>d#Z?d$Z@d%ZAd&ZBeAZCd'ZDd(ZEd)ZFe3e4e5e6e7e8e9e:e;d*d+e<e>e?e@eAeBd,eDeEeFd-d.�ZGd/ZHd0eH ZId1ZJd2ZKd3ZLd4ZMeNe�Od5d6��ZPG d7d8� d8e"�ZQG d9d:� d:eQe �ZRG d;d<� d<e �ZSG d=d>� d>e$eS�ZTG d?d@� d@e%eS�ZUG dAdB� dBeV�ZWG dCdD� dDe*�ZXG dEdF� dFe#eX�ZYG dGdH� dHeU�ZZG dIdJ� dJeY�Z[G dKdL� dLeU�Z\G dMdN� dNeY�Z]G dOdP� dPeU�Z^G dQdR� dReY�Z_G dSdT� dTeU�Z`G dUdV� dVeY�ZaG dWdX� dXeU�ZbG dYdZ� dZeY�ZcG d[d\� d\eU�ZdG d]d^� d^eY�ZeG d_d`� d`eU�ZfG dadb� dbeY�ZgG dcdd� ddeU�ZhG dedf� dfeY�ZiG dgdh� dheU�ZjG didj� djeY�ZkG dkdl� dleU�ZlG dmdn� dneU�ZmG dodp� dpeY�ZnG dqdr� dreY�ZoG dsdt� dteU�ZpG dudv� dveY�ZqG dwdx� dxeU�ZrerZsG dydz� dzeY�ZtetZuG d{d|� d|eU�ZvG d}d~� d~eY�ZwG dd�� d�eU�ZxG d�d�� d�eY�ZyG d�d�� d�eU�ZzG d�d�� d�eY�Z{G d�d�� d�eU�Z|G d�d�� d�eY�Z}dS )�� N)�sha1)�datetime)�Element� SubElement)�httplib��urlquote)�b)�tostring)� urlencode)�fixxpath�findtext)�read_in_chunks)�InvalidCredsError� LibcloudError)�ConnectionUserAndKey� RawResponse)�AWSBaseResponse� AWSDriver�AWSTokenConnection�SignedAWSConnection�UnsignedPayloadSentinel)�Object� Container� StorageDriver)�ContainerError)�ContainerIsNotEmptyError)�InvalidContainerNameError)�ContainerDoesNotExistError)�ObjectDoesNotExistError)�ObjectHashMismatchErrori� �s3.amazonaws.comzs3-us-east-2.amazonaws.comzs3-us-west-1.amazonaws.comzs3-us-west-2.amazonaws.comz s3-us-gov-west-1.amazonaws.comz s3.cn-north-1.amazonaws.com.cnz"s3.cn-northwest-1.amazonaws.com.cnzs3-eu-west-1.amazonaws.comzs3-eu-west-2.amazonaws.comz s3-eu-central-1.amazonaws.comzs3-eu-north-1.amazonaws.comzs3-ap-south-1.amazonaws.comz s3-ap-southeast-1.amazonaws.comz s3-ap-southeast-2.amazonaws.comz s3-ap-northeast-1.amazonaws.comz s3-ap-northeast-2.amazonaws.comzs3-sa-east-1.amazonaws.comzs3-sa-east-2.amazonaws.comz s3-ca-central-1.amazonaws.comzs3.eu-west-3.amazonaws.comzs3.eu-north-1.amazonaws.comz s3.ap-northeast-3.amazonaws.comzs3.me-south-1.amazonaws.com)� us-east-1� us-east-2� us-west-1� us-west-2� us-gov-west-1� cn-north-1�cn-northwest-1� eu-west-1� eu-west-2z eu-west-3� eu-north-1� eu-central-1� ap-south-1�ap-southeast-1�ap-southeast-2�ap-northeast-1�ap-northeast-2zap-northeast-3� sa-east-1z sa-east-2� ca-central-1z me-south-1z 2006-03-01z http://s3.amazonaws.com/doc/%s/i P �d z%Y%m%dT%H%M%SZz%Y%m%dZ LIBCLOUD_S3_CDN_URL_EXPIRY_HOURSZ24c @ s4 e Zd ZdZejejejejgZ dd� Z dd� Z dS )� S3ResponseNc C s, t | j�}d| ko dkn p*|| jv S )N�� i+ )�int�status�valid_response_codes)�self�i� r< ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/libcloud/storage/drivers/s3.py�success~ s zS3Response.successc C sl | j tjtjfv r t| j��n8| j tjkrV| j�dd �}| j j j }t d||f t d��t d| j t d��d S )Nzx-amz-bucket-regionzrThis bucket is located in a different region. Please use the correct driver. Bucket region "%s", used region "%s".��driverz Unknown error. Status code: %d)r8 r � UNAUTHORIZED� FORBIDDENr �body�MOVED_PERMANENTLY�headers�get� connectionr@ �regionr �S3StorageDriver)r: Z bucket_regionZ used_regionr< r< r= � parse_error� s �� �zS3Response.parse_error) �__name__� __module__� __qualname__� namespacer � NOT_FOUND�CONFLICT� BAD_REQUEST�PARTIAL_CONTENTr9 r> rJ r< r< r< r= r5 y s �r5 c @ s e Zd ZdS )� S3RawResponseN)rK rL rM r< r< r< r= rS � s rS c @ s8 e Zd ZdZdZeZeZe dd� �Z dd� Z dd� Z d S ) �BaseS3Connectionz; Represents a single connection to the S3 Endpoint r! c C s( dddd�}i }t |�� �D ]<\} } | �� } | |v rB| �� || < q | �|�r | �� || < q |rjt|�|d< | g} t|�� �D ]\} } | �| � q|d�| �}g } t|�� �D ]\} } | �d| | f � q�d�| �}g }|||fD ]} | r�|�| � q�d�|�}t � t j t |�t |�td��� �}|�d�S )as Signature = URL-Encode( Base64( HMAC-SHA1( YourSecretAccessKeyID, UTF-8-Encoding-Of( StringToSign ) ) ) ); StringToSign = HTTP-VERB + " " + Content-MD5 + " " + Content-Type + " " + Expires + " " + CanonicalizedVendorHeaders + CanonicalizedResource; � )z content-md5� content-type�daterW � z%s:%s)� digestmod�utf-8)�list�items�lower�strip� startswith�str�sorted�append�join�base64� b64encode�hmac�newr r �digest�decode)�methodrE �params�expires� secret_key�path� vendor_prefixZspecial_headersZvendor_headers�key�value� key_lower�buf�_Zstring_to_signZ header_stringZvalues_to_signZb64_hmacr< r< r= �get_auth_signature� s6 �z#BaseS3Connection.get_auth_signaturec C s* t tt�� �t �}| j|d< ||d< |S )NZAWSAccessKeyId�Expires)r` r7 �time�EXPIRATION_SECONDS�user_id)r: rk rl r< r< r= �add_default_params� s z#BaseS3Connection.add_default_paramsc C s2 | j | j|||d | j| j| jjd�|d< ||fS )Nrv )rj rE rk rl rm rn ro � Signature)ru rj rp �actionr@ �http_vendor_prefix)r: rk rE r< r< r= �pre_connect_hook� s � z!BaseS3Connection.pre_connect_hookN) rK rL rM �__doc__�hostr5 Z responseClsrS ZrawResponseCls� staticmethodru rz r~ r< r< r< r= rT � s /rT c @ s e Zd ZdZdS )� S3Connectionz\ Represents a single connection to the S3 endpoint, with AWS-specific features. N)rK rL rM r r< r< r< r= r� � s r� c s& e Zd ZdZeZd� fdd� Z� ZS )�S3SignatureV4Connection�s3TNc s* t t| ��||||||||| | | d� d S )N� )�superr� �__init__) r: ry rp �securer� �port�url�timeout� proxy_url�tokenZ retry_delay�backoff�� __class__r< r= r� � s �z S3SignatureV4Connection.__init__) TNNNNNNNN)rK rL rM � service_name� API_VERSION�versionr� � __classcell__r< r< r� r= r� � s �r� c @ s e Zd ZdZdd� Zdd� ZdS )�S3MultipartUploadz: Class representing an amazon s3 multipart upload c C s" || _ || _|| _|| _|| _dS )a Class representing an amazon s3 multipart upload :param key: The object/key that was being uploaded :type key: ``str`` :param id: The upload id assigned by amazon :type id: ``str`` :param created_at: The date/time at which the upload was started :type created_at: ``str`` :param initiator: The AWS owner/IAM user who initiated this :type initiator: ``str`` :param owner: The AWS owner/IAM who will own this object :type owner: ``str`` N)rp �id� created_at� initiator�owner)r: rp r� r� r� r� r< r< r= r� � s zS3MultipartUpload.__init__c C s d| j S )Nz<S3MultipartUpload: key=%s>)rp �r: r< r< r= �__repr__ s zS3MultipartUpload.__repr__N)rK rL rM r r� r� r< r< r< r= r� � s r� c @ s: e Zd ZdZdZeZdZdZdZ dZ e Z dZ dd � ZdFd d �Zd d� Zdd� Zdd� Zdd� Zdd� Zdd� ZdGdd�ZdHdd �ZdId d �ZdJd d �ZdKd!d"�ZdLd#d$�ZdMd%d&�Z d'd(� Z d)d*� Z dNd+d,�Z d-d.� Z dOd/d0�Z!dPd1d2�Z"d3d4� Z#dQd6d7�Z$dRd8d9�Z%d:d;� Z&d<d=� Z'd>d?� Z(d@dA� Z)dBdC� Z*dDdE� Z+d S )S�BaseS3StorageDriverzAmazon S3 (standard)zhttp://aws.amazon.com/s3/�md5FTrU zx-amzc C sB | j �d�}|jtjkr,| j|jdd�}|S td|j | d��d S )N�/zBuckets/Bucket)�obj�xpath�Unexpected status code: %sr? )rG �requestr8 r �OK�_to_containers�objectr )r: �response� containersr< r< r= �iterate_containers s � �z&BaseS3StorageDriver.iterate_containersNc c s� | � ||�}i }|r ||d< d}d}| �|�}|s�|r>||d< | jj||d�}|jtjkrltd|j | d��| j|j d|d �} |j � t d | j d ��� � } | d k}d}| D ]} | j}| V q�q.dS ) a� Return a generator of objects for the given container. :param container: Container instance :type container: :class:`Container` :param prefix: Only return objects starting with prefix :type prefix: ``str`` :param ex_prefix: Only return objects starting with ex_prefix :type ex_prefix: ``str`` :return: A generator of Object instances. :rtype: ``generator`` of :class:`Object` �prefixNF�marker�rk r� r? ZContents)r� r� � container� IsTruncated�r� rN �false)Z_normalize_prefix_argument�_get_container_pathrG r� r8 r r� r �_to_objsr� r r rN r] �name) r: r� r� Z ex_prefixrk �last_keyZ exhaustedZcontainer_pathr� �objects� is_truncatedr� r< r< r= �iterate_container_objects* s< � ���� z-BaseS3StorageDriver.iterate_container_objectsc C sT z2| j jd| dd�}|jtjkr0td | |d��W n tyD Y n0 t|d | d�S )N�/%s�HEAD�rj �rq r@ �container_name�r� �extrar@ )rG r� r8 r rO r r r )r: r� r� r< r< r= � get_container\ s � � z!BaseS3StorageDriver.get_containerc C s\ | j |d�}| �||�}| jj|dd�}|jtjkrJ| j|||jd�}|S t d | |d��d S )N)r� r� r� )� object_namer� rE �rq r@ r� ) r� �_get_object_pathrG r� r8 r r� �_headers_to_objectrE r )r: r� r� r� � object_pathr� r� r< r< r= � get_objecti s ��z BaseS3StorageDriver.get_objectc C s d|j S )z� Return a container path :param container: Container instance :type container: :class:`Container` :return: A path for this container. :rtype: ``str`` r� )r� )r: r� r< r< r= r� w s z'BaseS3StorageDriver._get_container_pathc C s$ | � |�}| �|�}d||f }|S )a Return an object's CDN path. :param container: Container instance :type container: :class:`Container` :param object_name: Object name :type object_name: :class:`str` :return: A path for this object. :rtype: ``str`` z%s/%s)r� �_clean_object_name)r: r� r� Z container_urlZobject_name_cleanedr� r< r< r= r� � s z$BaseS3StorageDriver._get_object_pathc C s� | j r*td�}t|d�}| j |_t|�}nd}| jjd| |dd�}|jtj krbt |d | d�}|S |jtj kr~t d|| d ��n |jtj kr�td |j || d ��td |j | d ��d S ) NZCreateBucketConfigurationZLocationConstraintrU r� �PUT)�datarj r� zgContainer with this name already exists. The name must be unique among all the containers in the system�rq r� r@ z'Bad request when creating container: %sr� r? )�ex_location_namer r �textr rG r� r8 r r� r rP r rQ r rC r )r: r� �root�childr� r� r� r< r< r= �create_container� s8 � � �� �z$BaseS3StorageDriver.create_containerc C sd | j jd|j dd�}|jtjkr&dS |jtjkrDtd|j| d��n |jtjkr`t d | |jd��dS ) Nr� �DELETEr� Tz1Container must be empty before it can be deleted.r� r� F) rG r� r� r8 r � NO_CONTENTrP r rO r )r: r� r� r< r< r= �delete_container� s � � �z$BaseS3StorageDriver.delete_containerc C sH | � |j|j�}| jj|ddd�}| j|| j|||j|||d�tj d�S )N�GETT)rj �raw)r� r� �destination_path�overwrite_existing�delete_on_failure�r� �callbackr� �callback_kwargsZsuccess_status_code) r� r� r� rG r� � _get_object� _save_objectr� r r� )r: r� r� r� r� �obj_pathr� r< r< r= �download_object� s ��z#BaseS3StorageDriver.download_objectc C sF | � |j|j�}| jj|dddd�}| j|t||�t�|d�t j d�S )Nr� T)rj �streamr� ��iterator� chunk_sizer� ) r� r� r� rG r� r� r � iter_content� CHUNK_SIZEr r� )r: r� r� r� r� r< r< r= �download_object_as_stream� s ���z-BaseS3StorageDriver.download_object_as_streamc C sj | j ||d� | �|j|j�}d| �||�i}| jj|d|dd�} | j|| j| || j |||dd�t j d�S )N�� start_bytes� end_bytes�Ranger� T)rj rE r� )r� r� r� r� r� Zpartial_downloadr� ) � _validate_start_and_end_bytesr� r� r� �_get_standard_range_strrG r� r� r� r� r rR ) r: r� r� r� r� r� r� r� rE r� r< r< r= �download_object_range� s* �� � ��z)BaseS3StorageDriver.download_object_rangec C sf | j ||d� | �|j|j�}d| �||�i}| jj|d|ddd�}| j|t||� t �|d�t j d�S )Nr� r� r� T)rj rE r� r� r� r� ) r� r� r� r� r� rG r� r� r r� r� r rR )r: r� r� r� r� r� rE r� r< r< r= � download_object_range_as_stream� s& �� ���z3BaseS3StorageDriver.download_object_range_as_streamc C s | j |||||||d�S )z� @inherits: :class:`StorageDriver.upload_object` :param ex_storage_class: Storage class :type ex_storage_class: ``str`` )r� r� r� � file_path� verify_hashrE � storage_class)� _put_object)r: r� r� r� r� r� rE �ex_storage_classr< r< r= � upload_object s �z!BaseS3StorageDriver.upload_objectc C sZ |pi }| � ||�}ddi}| jj|d||d�}|jtjkrHtd| d��t|jd| j d�S ) a� Initiates a multipart upload to S3 :param container: The destination container :type container: :class:`Container` :param object_name: The name of the object which we are uploading :type object_name: ``str`` :keyword headers: Additional headers to send with the request :type headers: ``dict`` :return: The id of the newly created multipart upload :rtype: ``str`` �uploadsrU �POST)rj rE rk z!Error initiating multipart uploadr? �UploadId��elementr� rN ) r� rG r� r8 r r� r r r� rN )r: r� r� rE � request_pathrk r� r< r< r= �_initiate_multipart s � ��z'BaseS3StorageDriver._initiate_multipartc C s d}|r| � � }d}d}g } d|i} | �||�} t|tddd�D ]�} |t| �7 }|r^|�| � | � � } | �| � t�| �� �� d�} t| �| d�}|| d < | j j | d | || d �}|j t jkr�td | d ��|jd �dd�}| �||f� |d7 }q@|r�|�� }| ||fS )a� Uploads data from an iterator in fixed sized chunks to S3 :param container: The destination container :type container: :class:`Container` :param object_name: The name of the object which we are uploading :type object_name: ``str`` :param upload_id: The upload id allocated for this multipart upload :type upload_id: ``str`` :param stream: The generator for fetching the upload data :type stream: ``generator`` :keyword calculate_hash: Indicates if we must calculate the data hash :type calculate_hash: ``bool`` :return: A tuple of (chunk info, checksum, bytes transferred) :rtype: ``tuple`` Nr � �uploadIdT)r� Z fill_sizeZ yield_emptyrZ )�Content-Lengthz Content-MD5Z partNumberr� )rj r� rE rk zError uploading chunkr? �etag�"rU )Z_get_hash_functionr� r r� �len�updaterd re rh ri rG r� r8 r r� r rE �replacerb � hexdigest)r: r� r� � upload_idr� �calculate_hash� data_hash�bytes_transferred�count�chunksrk r� r� Z chunk_hashrE �resp� server_hashr< r< r= �_upload_multipart_chunks: sB � � � z,BaseS3StorageDriver._upload_multipart_chunksc C s� t d�}|D ]:\}}t|d�}t|d�} t|�| _t|d�} t|�| _q t|�} dt| �i} d|i} | �||�}| jj|| | | dd�}|j t j kr�|j }|j |d �\}}d ||f }t|| d ��|�� }|�td| jd ��j}|S ) a( Makes a final commit of the data. :param container: The destination container :type container: :class:`Container` :param object_name: The name of the object which we are uploading :type object_name: ``str`` :param upload_id: The upload id allocated for this multipart upload :type upload_id: ``str`` :param chunks: A list of (chunk_number, chunk_hash) tuples. :type chunks: ``list`` :return: The server side hash of the uploaded data :rtype: ``str`` ZCompleteMultipartUploadZPartZ PartNumber�ETagr� r� r� )rE rk r� rj )r� z"Error in multipart commit: %s (%s)r? r� )r r r` r� r r� r� rG r� r8 r r� r� Z_parse_error_detailsr � parse_body�findr rN )r: r� r� r r r� r r� �partZpart_noZetag_idr� rE rk r� r� r� �code�message�msgrC r r< r< r= �_commit_multipart� s2 � � z%BaseS3StorageDriver._commit_multipartc C sH d|i}| � ||�}| jj|d|d�}|jtjkrDtd|j | d��dS )a{ Aborts an already initiated multipart upload :param container: The destination container :type container: :class:`Container` :param object_name: The name of the object which we are uploading :type object_name: ``str`` :param upload_id: The upload id allocated for this multipart upload :type upload_id: ``str`` r� r� )rj rk z(Error in multipart abort. status_code=%dr? N)r� rG r� r8 r r� r )r: r� r� r rk r� r r< r< r= �_abort_multipart� s � ��z$BaseS3StorageDriver._abort_multipartc C sB d}d}| j r&| j||||d||d�S | j||||||d||d� S )z� @inherits: :class:`StorageDriver.upload_object_via_stream` :param ex_storage_class: Storage class :type ex_storage_class: ``str`` r� NF)r� r� r� r� r� rE r� ) r� r� r� rj � query_argsr� r� rE r� )� supports_s3_multipart_upload�_put_object_multipartr� ) r: r� r� r� r� rE r� rj rk r< r< r= �upload_object_via_stream� s" ��z,BaseS3StorageDriver.upload_object_via_streamc C sP | � |j|j�}| jj|dd�}|jtjkr0dS |jtjkrLt d | |jd��dS )Nr� r� Tr� F) r� r� r� rG r� r8 r r� rO r )r: r� r� r� r< r< r= � delete_object� s �z!BaseS3StorageDriver.delete_objectc # sj � j std� d��� �|�}tdd�}|r2||d< |r>||d< � fdd�}� jj||d �}|jtjkrxtd |j � d��|� � }|� t d � j d ��D ]p} | � t d � j d ��} | � t d� j d ��} || d�} || d�} || d�}|| d�} || d�} t| | || | �V q�|�t d� j d ��}|�� dk�r,�qf|�t d� j d ��}|�t d� j d ��}||d< ||d< qJdS )a� Extension method for listing all in-progress S3 multipart uploads. Each multipart upload which has not been committed or aborted is considered in-progress. :param container: The container holding the uploads :type container: :class:`Container` :keyword prefix: Print only uploads of objects with this prefix :type prefix: ``str`` :keyword delimiter: The object/key names are grouped based on being split by this delimiter :type delimiter: ``str`` :return: A generator of S3MultipartUpload instances. :rtype: ``generator`` of :class:`S3MultipartUpload` zFeature not supportedr? rU )z max-uploadsr� r� � delimiterc s | � t|� jd��S �Nr� )r r rN )�noder� r� r< r= �finder s �z@BaseS3StorageDriver.ex_iterate_multipart_uploads.<locals>.finderr� z.Error fetching multipart uploads. Got code: %sZUploadr� Z InitiatorZOwner�Keyr� Z InitiatedZ DisplayNamer� r� ZNextUploadIdMarkerZ NextKeyMarkerz key-markerzupload-id-markerN)r r r� �RESPONSES_PER_REQUESTrG r� r8 r r� r �findallr rN r r� r r] )r: r� r� r r� rk r r� rC r r� r� rp r r� r� Z upload_markerZ key_markerr< r� r= � ex_iterate_multipart_uploads� s^ ��� �� ����z0BaseS3StorageDriver.ex_iterate_multipart_uploadsc C s, | j ||dd�D ]}| �||j|j� qdS )a6 Extension method for removing all partially completed S3 multipart uploads. :param container: The container holding the uploads :type container: :class:`Container` :keyword prefix: Delete only uploads of objects with this prefix :type prefix: ``str`` N)r )r r rp r� )r: r� r� �uploadr< r< r= � ex_cleanup_all_multipart_uploadsI s � z4BaseS3StorageDriver.ex_cleanup_all_multipart_uploadsc C s t |dd�}|S )Nz/~)�safer )r: r� r< r< r= r� Z s z&BaseS3StorageDriver._clean_object_namer� c C sz | pi } |pi }| � | �| �� |�dd �} |�dd �} |�dd �} | rtt| �� �D ] \}}| jd| }|| |< qT| r�| | | jd < | �||�}|r�d�||f�}| j|| ||| ||d�}|d }|d }|j } |}| �d d �� d d �}| �d d �}|dk}|d |k}|�r8|�s8|�s8t d� ||d �|| d��n>|j tjk�rdt|||d| i| || d�}|S td|j | d��d S )N� content_type� meta_data�acl�-meta-%s�-acl�?)r� r$ r� �request_methodrE r� r� r� r r� rU r� z x-amz-server-side-encryptionzaws:kmsr z(MD5 hash {0} checksum does not match {1})rq r� r@ �r� �size�hashr� r% r� r@ z&Unexpected status code, status_code=%sr? )r� �_to_storage_class_headersrF r[ r\ r} r� rc Z_upload_objectrE r r �formatr8 r r� r r )r: r� r� rj r r� r� r� r� r� rE r$ r% r& rp rq r� Z result_dictr� r r Zserver_side_encryptionZaws_kms_encryptionZ hash_matchesr� r< r< r= r� ^ s` �� �� ��z BaseS3StorageDriver._put_objectc C s |pi }|pi }|� | �|�� |�dd�}|�dd�} |�dd�} | �||�|d< | r�t| �� �D ] \} } | jd| } | || < qd| r�| || jd < | j|||d�} z2| j||| ||d �}|\}}}| � ||| |�}W n" t y� | � ||| � � Y n0 t |||d| i| || d �S ) a1 Uploads an object using the S3 multipart algorithm. :param container: The destination container :type container: :class:`Container` :param object_name: The name of the object which we are uploading :type object_name: ``str`` :param stream: The generator for fetching the upload data :type stream: ``generator`` :keyword verify_hash: Indicates if we must calculate the data hash :type verify_hash: ``bool`` :keyword extra: Additional options :type extra: ``dict`` :keyword headers: Additional headers :type headers: ``dict`` :keyword storage_class: The name of the S3 object's storage class :type extra: ``str`` :return: The uploaded object :rtype: :class:`Object` r$ Nr% r& z Content-Typer' r( )rE )r r+ ) r� r. rF Z_determine_content_typer[ r\ r} r� r r � Exceptionr r )r: r� r� r� r� r� rE r� r$ r% r& rp rq r �resultr r r r� r< r< r= r � sF � �� � �z)BaseS3StorageDriver._put_object_multipartc C s: i }|p d}|dvr t d| ��| jd }|�� ||< |S )z� Generates request headers given a storage class name. :keyword storage_class: The name of the S3 object's storage class :type extra: ``str`` :return: Headers to include in a request :rtype: :dict: �standard)r2 Zreduced_redundancyz Invalid storage class value: %sz-storage-class)� ValueErrorr} �upper)r: r� rE rp r< r< r= r. � s � z-BaseS3StorageDriver._to_storage_class_headersc c s* |� t|| jd��D ]}| �|�V qd S r )r r rN � _to_container)r: r� r� r� r< r< r= r� � s � z"BaseS3StorageDriver._to_containersc s$ � �fdd�|� t|�jd��D �S )Nc s g | ]}�� |� ��qS r< )�_to_obj)�.0r� �r� r: r< r= � <listcomp> � z0BaseS3StorageDriver._to_objs.<locals>.<listcomp>r� )r r rN )r: r� r� r� r< r8 r= r� � s �z BaseS3StorageDriver._to_objsc C s2 dt |d| jd�i}tt |d| jd�|| d�}|S )NZ creation_dateZ CreationDater� �Namer� )r rN r )r: r� r� r� r< r< r= r5 s ����z!BaseS3StorageDriver._to_containerc C s� |d � dd�}|d |d d�}i }d|v r:|d |d< |�� D ]8\}}|�� �| jd �s`qB|� | jd d�}|||< qBt||d ||||| d �} | S ) Nr� r� rU rV )r$ r� z last-modified� last_modifiedz-meta-zcontent-lengthr+ )r r\ r] r_ r} r ) r: r� r� rE r- r� r% rp rq r� r< r< r= r� s& � �z&BaseS3StorageDriver._headers_to_objectc C s� t |d| jd�}t |d| jd�}d||d�i}t |d| jd�}d|i}tt |d| jd�tt |d | jd��t |d | jd��d d �|||| d �}|S )NzOwner/IDr� zOwner/DisplayNamer� )r� � display_nameZ LastModifiedr< r �Sizer r� rU r+ )r rN r r7 r ) r: r� r� Zowner_idZowner_display_namer% r< r� r� r< r< r= r6 ( s@ ��������� zBaseS3StorageDriver._to_obj)NN)FT)N)NFT)NN)NTNN)N)T)NNN)NN)N)r� NNNNTNN)NFNN),rK rL rM r� ZwebsiterT � connectionClsZ hash_typeZsupports_chunked_encodingr r� � NAMESPACErN r} r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r" r� r� r r. r� r� r5 r� r6 r< r< r< r= r� sx � 2 � � � � � I3 � � R � A � Hr� c sB e Zd ZdZeZdZd � fdd� Zedd� �Z e fd d �Z � Z S ) rI z Amazon S3r" NTc sz t | d�r|s| j}|| _|r6|t�� vr6td| ��d| | _|d u rPt| }tt| �jf |||||||d�|�� d S )N� region_namez!Invalid or unsupported region: %szAmazon S3 (%s))rp �secretr� r� r� rH r� ) �hasattrrA �REGION_TO_HOST_MAP�keysr3 r� r� rI r� ) r: rp rB r� r� r� rH r� �kwargsr� r< r= r� I s ��zS3StorageDriver.__init__c C s t �� S )N)rD rE r� r< r< r= � list_regions` s z S3StorageDriver.list_regionsc C s� | � |j|j�}t�� }t|d �}| j|�t�| j ddf}dd� |�|�t �|dd�}d| j j i}| j jj|||d|td �} |�� } | | d < d j| jr�d nd | j j | j j|t| �d�S )aI Return a "presigned URL" for read-only access to object AWS only - requires AWS signature V4 authenticaiton. :param obj: Object instance. :type obj: :class:`Object` :param ex_expiry: The number of hours after which the URL expires. Defaults to 24 hours or the value of the environment variable "LIBCLOUD_S3_STORAGE_CDN_URL_EXPIRY_HOURS", if set. :type ex_expiry: ``float`` :return: Presigned URL for the object. :rtype: ``str`` i r� Z aws4_requestzAWS4-HMAC-SHA256r� r� )zX-Amz-AlgorithmzX-Amz-Credentialz X-Amz-Datez X-Amz-ExpireszX-Amz-SignedHeadersr� )rk rE �dtrj rn r� zX-Amz-Signaturez'{scheme}://{host}:{port}{path}?{params}�https�http)�schemer� r� rn rk )r� r� r� r �utcnowr7 rp �strftime�S3_CDN_URL_DATE_FORMATrH rc �S3_CDN_URL_DATETIME_FORMATrG r� ZsignerZ_get_signaturer �copyr/ r� r� r ) r: r� Z ex_expiryr� �nowZduration_secondsZ credpartsZparams_to_signZheaders_to_sign� signaturerk r< r< r= �get_object_cdn_urld sB �� � �z"S3StorageDriver.get_object_cdn_url)NTNNNN) rK rL rM r� r� r? rA r� � classmethodrG �S3_CDN_URL_EXPIRY_HOURSrS r� r< r< r� r= rI D s � �rI c @ s e Zd ZeZdS )�S3USEast2ConnectionN)rK rL rM �S3_US_EAST2_HOSTr� r< r< r< r= rV � s rV c @ s e Zd ZdZeZdZdZdS )�S3USEast2StorageDriverzAmazon S3 (us-east-2)r# N)rK rL rM r� rV r? r� rA r< r< r< r= rX � s rX c @ s e Zd ZeZdS )�S3USWestConnectionN)rK rL rM �S3_US_WEST_HOSTr� r< r< r< r= rY � s rY c @ s e Zd ZdZeZdZdZdS )�S3USWestStorageDriverzAmazon S3 (us-west-1)r$ N)rK rL rM r� rY r? r� rA r< r< r< r= r[ � s r[ c @ s e Zd ZeZdS )�S3USWestOregonConnectionN)rK rL rM �S3_US_WEST_OREGON_HOSTr� r< r< r< r= r\ � s r\ c @ s e Zd ZdZeZdZdZdS )�S3USWestOregonStorageDriverzAmazon S3 (us-west-2)r% N)rK rL rM r� r\ r? r� rA r< r< r< r= r^ � s r^ c @ s e Zd ZeZdS )�S3USGovWestConnectionN)rK rL rM �S3_US_GOV_WEST_HOSTr� r< r< r< r= r_ � s r_ c @ s e Zd ZdZeZdZdZdS )�S3USGovWestStorageDriverzAmazon S3 (us-gov-west-1)r& N)rK rL rM r� r_ r? r� rA r< r< r< r= ra � s ra c @ s e Zd ZeZdS )�S3CNNorthWestConnectionN)rK rL rM �S3_CN_NORTHWEST_HOSTr� r< r< r< r= rb � s rb c @ s e Zd ZdZeZdZdZdS )�S3CNNorthWestStorageDriverzAmazon S3 (cn-northwest-1)r( N)rK rL rM r� rb r? r� rA r< r< r< r= rd � s rd c @ s e Zd ZeZdS )�S3CNNorthConnectionN)rK rL rM �S3_CN_NORTH_HOSTr� r< r< r< r= re � s re c @ s e Zd ZdZeZdZdZdS )�S3CNNorthStorageDriverzAmazon S3 (cn-north-1)r' N)rK rL rM r� re r? r� rA r< r< r< r= rg � s rg c @ s e Zd ZeZdS )�S3EUWestConnectionN)rK rL rM �S3_EU_WEST_HOSTr� r< r< r< r= rh � s rh c @ s e Zd ZdZeZdZdZdS )�S3EUWestStorageDriverzAmazon S3 (eu-west-1)ZEUr) N)rK rL rM r� rh r? r� rA r< r< r< r= rj � s rj c @ s e Zd ZeZdS )�S3EUWest2ConnectionN)rK rL rM �S3_EU_WEST2_HOSTr� r< r< r< r= rk � s rk c @ s e Zd ZdZeZdZdZdS )�S3EUWest2StorageDriverzAmazon S3 (eu-west-2)r* N)rK rL rM r� rk r? r� rA r< r< r< r= rm � s rm c @ s e Zd ZeZdS )�S3EUCentralConnectionN)rK rL rM �S3_EU_CENTRAL_HOSTr� r< r< r< r= rn � s rn c @ s e Zd ZdZeZdZdZdS )�S3EUCentralStorageDriverzAmazon S3 (eu-central-1)r, N)rK rL rM r� rn r? r� rA r< r< r< r= rp � s rp c @ s e Zd ZeZdS )�S3APSEConnectionN)rK rL rM �S3_AP_SOUTHEAST_HOSTr� r< r< r< r= rq s rq c @ s e Zd ZeZdS )�S3EUNorth1ConnectionN)rK rL rM �S3_EU_NORTH1_HOSTr� r< r< r< r= rs s rs c @ s e Zd ZdZeZdZdZdS )�S3EUNorth1StorageDriverzAmazon S3 (eu-north-1)r+ N)rK rL rM r� rs r? r� rA r< r< r< r= ru s ru c @ s e Zd ZdZeZdZdZdS )�S3APSEStorageDriverzAmazon S3 (ap-southeast-1)r. N)rK rL rM r� rq r? r� rA r< r< r< r= rv s rv c @ s e Zd ZeZdS )�S3APSE2ConnectionN)rK rL rM �S3_AP_SOUTHEAST2_HOSTr� r< r< r< r= rw s rw c @ s e Zd ZdZeZdZdZdS )�S3APSE2StorageDriverzAmazon S3 (ap-southeast-2)r/ N)rK rL rM r� rw r? r� rA r< r< r< r= ry s ry c @ s e Zd ZeZdS )�S3APNE1ConnectionN)rK rL rM �S3_AP_NORTHEAST1_HOSTr� r< r< r< r= rz & s rz c @ s e Zd ZdZeZdZdZdS )�S3APNE1StorageDriverzAmazon S3 (ap-northeast-1)r0 N)rK rL rM r� �S3APNEConnectionr? r� rA r< r< r< r= r| - s r| c @ s e Zd ZeZdS )�S3APNE2ConnectionN)rK rL rM �S3_AP_NORTHEAST2_HOSTr� r< r< r< r= r~ 7 s r~ c @ s e Zd ZdZeZdZdZdS )�S3APNE2StorageDriverzAmazon S3 (ap-northeast-2)r1 N)rK rL rM r� r~ r? r� rA r< r< r< r= r� ; s r� c @ s e Zd ZeZdS )�S3APSouthConnectionN)rK rL rM �S3_AP_SOUTH_HOSTr� r< r< r< r= r� B s r� c @ s e Zd ZdZeZdZdZdS )�S3APSouthStorageDriverzAmazon S3 (ap-south-1)r- N)rK rL rM r� r� r? r� rA r< r< r< r= r� F s r� c @ s e Zd ZeZdS )�S3SAEastConnectionN)rK rL rM �S3_SA_EAST_HOSTr� r< r< r< r= r� M s r� c @ s e Zd ZdZeZdZdZdS )�S3SAEastStorageDriverzAmazon S3 (sa-east-1)r2 N)rK rL rM r� r� r? r� rA r< r< r< r= r� Q s r� c @ s e Zd ZeZdS )�S3CACentralConnectionN)rK rL rM �S3_CA_CENTRAL_HOSTr� r< r< r< r= r� X s r� c @ s e Zd ZdZeZdZdZdS )�S3CACentralStorageDriverzAmazon S3 (ca-central-1)r3 N)rK rL rM r� r� r? r� rA r< r< r< r= r� \ s r� )~rd rf rw �hashlibr �osr Zlibcloud.utils.py3Zlibcloud�utils�py3Z DEFAULT_LXMLZ lxml.etreer r Zxml.etree.ElementTree� ImportErrorr r r r r Zlibcloud.utils.xmlr r Zlibcloud.utils.filesr Zlibcloud.common.typesr r Zlibcloud.common.baser r Zlibcloud.common.awsr r r r r Zlibcloud.storage.baser r r Zlibcloud.storage.typesr r r r r r rx ZS3_US_STANDARD_HOSTrW rZ r] r` rf rc ri rl ro rt r� rr rx r{ r ZS3_AP_NORTHEAST_HOSTr� ZS3_SA_SOUTHEAST2_HOSTr� rD r� r@ r� r rO rN �float�getenvrU r5 rS rT r� r� r� r� r� rI rV rX rY r[ r\ r^ r_ ra rb rd re rg rh rj rk rm rn rp rq rs ru rv rw ry rz r} r| ZS3APNEStorageDriverr~ r� r� r� r� r� r� r� r< r< r< r= �<module> s � �H" 5^
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка