Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/libcloud/storage/__pycache__/base.cpython-39.pyc
Ðазад
a q�hЈ � @ s d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddl Z ddl Z ddl Z ddl Z dd l mZ dd lmZ dd lmZ ddlZdd lmZ dd lmZ ddlmZmZ ddlm Z g d�Z dZ dZ G dd� de �Z!G dd� de �Z"G dd� de�Z#dS )z0 Provides base classes for working with storage � )�with_statement)�Dict)�Iterator)�List)�Optional)�TypeN)�join)�httplib)�b)� LibcloudError)� Connection)�ConnectionUserAndKey� BaseDriver)�ObjectDoesNotExistError)�Object� Container� StorageDriver� CHUNK_SIZE�DEFAULT_CONTENT_TYPEi� zapplication/octet-streamc @ s` e Zd ZdZdd� Zdd� Zdd� Zdd d �Zdd d�Zddd�Z ddd�Z dd� Z dd� Z d S )r z& Represents an object (BLOB). c C s6 || _ || _|| _|| _|p i | _|p(i | _|| _dS )au :param name: Object name (must be unique per container). :type name: ``str`` :param size: Object size in bytes. :type size: ``int`` :param hash: Object hash. :type hash: ``str`` :param container: Object container. :type container: :class:`libcloud.storage.base.Container` :param extra: Extra attributes. :type extra: ``dict`` :param meta_data: Optional object meta data. :type meta_data: ``dict`` :param driver: StorageDriver instance. :type driver: :class:`libcloud.storage.base.StorageDriver` N)�name�size�hash� container�extra� meta_data�driver)�selfr r r r r r r � r ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/libcloud/storage/base.py�__init__A s zObject.__init__c C s | j j| d�S �N)�obj)r �get_object_cdn_url�r r r r � get_cdn_urli s zObject.get_cdn_urlc C s | j j| d�S r )r �enable_object_cdnr# r r r � enable_cdnm s zObject.enable_cdnFTc C s | j j| |||d�S )N)r! �destination_path�overwrite_existing�delete_on_failure�r �download_object)r r' r( r) r r r �downloadq s �zObject.downloadNc C s | j j| |d�S )N)r! � chunk_size�r �download_object_as_stream)r r- r r r � as_streamz s �zObject.as_streamc C s | j j| |||||d�S �N)r! r' � start_bytes� end_bytesr( r) �r �download_object_range)r r' r2 r3 r( r) r r r �download_range s �zObject.download_rangec C s | j j| |||d�S �N)r! r2 r3 r- �r � download_object_range_as_stream)r r2 r3 r- r r r �range_as_stream� s �zObject.range_as_streamc C s | j �| �S �N�r � delete_objectr# r r r �delete� s z Object.deletec C s d| j | j| j| jj f S )Nz4<Object: name=%s, size=%s, hash=%s, provider=%s ...>)r r r r r# r r r �__repr__� s �zObject.__repr__)FT)N)NFT)NN) �__name__� __module__� __qualname__�__doc__r r$ r& r, r0 r6 r: r> r? r r r r r < s ( � � r c @ s� e Zd ZdZdd� Zd#dd�Zd$dd�Zd d � Zd d � Zd d� Z d%dd�Z d&dd�Z d'dd�Z d(dd�Z d)dd�Zd*dd �Zd d � Zd d � Zd!d"� ZdS )+r zJ Represents a container (bucket) which can hold multiple objects. c C s || _ |p i | _|| _dS )a :param name: Container name (must be unique). :type name: ``str`` :param extra: Extra attributes. :type extra: ``dict`` :param driver: StorageDriver instance. :type driver: :class:`libcloud.storage.base.StorageDriver` N)r r r )r r r r r r r r � s zContainer.__init__Nc C s | j j| ||d�S �N)r �prefix� ex_prefix)r �iterate_container_objects�r rE rF r r r �iterate_objects� s �zContainer.iterate_objectsc C s | j j| ||d�S rD )r �list_container_objectsrH r r r � list_objects� s �zContainer.list_objectsc C s | j j| d�S �N)r )r �get_container_cdn_urlr# r r r r$ � s zContainer.get_cdn_urlc C s | j j| d�S rL )r �enable_container_cdnr# r r r r& � s zContainer.enable_cdnc C s | j j| j|d�S )N)�container_name� object_name)r � get_objectr )r rP r r r rQ � s �zContainer.get_objectTc C s | j j|| ||||d�S )N)r � verify_hash�headers)r � upload_object)r � file_pathrP r rR rS r r r rT � s �zContainer.upload_objectc C s | j j|| |||d�S )N)r rS )r �upload_object_via_stream)r �iteratorrP r rS r r r rV � s �z"Container.upload_object_via_streamFc C s | j j||||d�S )N)r( r) r* �r r! r' r( r) r r r r+ � s �zContainer.download_objectc C s | j �||�S r; r. �r r! r- r r r r/ � s z#Container.download_object_as_streamc C s | j j||||||d�S r1 r4 �r r! r' r2 r3 r( r) r r r r5 � s �z Container.download_object_rangec C s | j j||||d�S r7 r8 �r r! r2 r3 r- r r r r9 � s �z)Container.download_object_range_as_streamc C s | j �|�S r; r< �r r! r r r r= � s zContainer.delete_objectc C s | j �| �S r; )r �delete_containerr# r r r r> � s zContainer.deletec C s d| j | jj f S )Nz!<Container: name=%s, provider=%s>)r r r# r r r r? s �zContainer.__repr__)NN)NN)NTN)NN)FT)N)NFT)NN)r@ rA rB rC r rI rK r$ r& rQ rT rV r+ r/ r5 r9 r= r> r? r r r r r � s4 � � � � � r c @ s* e Zd ZdZeZdZdZdZdZ dd� Z dd� Z dBd d �Z dCd d �Z d d� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � ZdDd d �ZdEd d!�ZdFd"d#�ZdGd$d%�ZdHd&d'�ZdId(d)�Zd*d+� Z d,d-� Z d.d/� Z dJd0d1�Z dKd2d3�Z dLd5d6�Z!dMd7d8�Z"dNd:d;�Z#d<d=� Z$dOd>d?�Z%dPd@dA�Z&dS )Qr z. A base StorageDriver to derive from. N�md5Fc C s t d��dS )z� Return a iterator of containers for the given account :return: A iterator of Container instances. :rtype: ``iterator`` of :class:`libcloud.storage.base.Container` z2iterate_containers not implemented for this driverN��NotImplementedErrorr# r r r �iterate_containers s �z StorageDriver.iterate_containersc C s t | �� �S )z� Return a list of containers. :return: A list of Container instances. :rtype: ``list`` of :class:`Container` )�listra r# r r r �list_containers! s z StorageDriver.list_containersc C s t d��dS )a� Return a iterator of objects for the given container. :param container: Container instance :type container: :class:`libcloud.storage.base.Container` :param prefix: Filter objects starting with a prefix. :type prefix: ``str`` :param ex_prefix: (Deprecated.) Filter objects starting with a prefix. :type ex_prefix: ``str`` :return: A iterator of Object instances. :rtype: ``iterator`` of :class:`libcloud.storage.base.Object` z9iterate_container_objects not implemented for this driverNr_ �r r rE rF r r r rG + s �z'StorageDriver.iterate_container_objectsc C s t | j|||d��S )a� Return a list of objects for the given container. :param container: Container instance. :type container: :class:`libcloud.storage.base.Container` :param prefix: Filter objects starting with a prefix. :type prefix: ``str`` :param ex_prefix: (Deprecated.) Filter objects starting with a prefix. :type ex_prefix: ``str`` :return: A list of Object instances. :rtype: ``list`` of :class:`libcloud.storage.base.Object` )rE rF )rb rG rd r r r rJ @ s �z$StorageDriver.list_container_objectsc C s |rt �dt� |S |S )NzOThe ``ex_prefix`` argument is deprecated - please update code to use ``prefix``)�warnings�warn�DeprecationWarningrH r r r �_normalize_prefix_argumentU s �z(StorageDriver._normalize_prefix_argumentc c sB |d urt �d| jj � |D ] }|d u s6|j�|�r |V q d S )NzgDriver %s does not implement native object filtering; falling back to filtering the full object stream.)re rf � __class__r@ r � startswith)r �objectsrE r! r r r � _filter_listed_container_objects^ s �z.StorageDriver._filter_listed_container_objectsc C s t d��dS )z� Return a container instance. :param container_name: Container name. :type container_name: ``str`` :return: :class:`Container` instance. :rtype: :class:`libcloud.storage.base.Container` �*get_object not implemented for this driverNr_ �r rO r r r � get_containerh s �zStorageDriver.get_containerc C s t d��dS )z� Return a container CDN URL. :param container: Container instance :type container: :class:`libcloud.storage.base.Container` :return: A CDN URL for this container. :rtype: ``str`` z5get_container_cdn_url not implemented for this driverNr_ �r r r r r rM v s �z#StorageDriver.get_container_cdn_urlc C s t d��dS )a3 Return an object instance. :param container_name: Container name. :type container_name: ``str`` :param object_name: Object name. :type object_name: ``str`` :return: :class:`Object` instance. :rtype: :class:`libcloud.storage.base.Object` rm Nr_ )r rO rP r r r rQ � s �zStorageDriver.get_objectc C s t d��dS )z� Return an object CDN URL. :param obj: Object instance :type obj: :class:`libcloud.storage.base.Object` :return: A CDN URL for this object. :rtype: ``str`` z2get_object_cdn_url not implemented for this driverNr_ r\ r r r r" � s �z StorageDriver.get_object_cdn_urlc C s t d��dS )z� Enable container CDN. :param container: Container instance :type container: :class:`libcloud.storage.base.Container` :rtype: ``bool`` z4enable_container_cdn not implemented for this driverNr_ rp r r r rN � s �z"StorageDriver.enable_container_cdnc C s t d��dS )z� Enable object CDN. :param obj: Object instance :type obj: :class:`libcloud.storage.base.Object` :rtype: ``bool`` z1enable_object_cdn not implemented for this driverNr_ r\ r r r r% � s �z StorageDriver.enable_object_cdnTc C s t d��dS )a� Download an object to the specified destination path. :param obj: Object instance. :type obj: :class:`libcloud.storage.base.Object` :param destination_path: Full path to a file or a directory where the incoming file will be saved. :type destination_path: ``str`` :param overwrite_existing: True to overwrite an existing file, defaults to False. :type overwrite_existing: ``bool`` :param delete_on_failure: True to delete a partially downloaded file if the download was not successful (hash mismatch / file size). :type delete_on_failure: ``bool`` :return: True if an object has been successfully downloaded, False otherwise. :rtype: ``bool`` z/download_object not implemented for this driverNr_ rX r r r r+ � s �z StorageDriver.download_objectc C s t d��dS )a$ Return a iterator which yields object data. :param obj: Object instance :type obj: :class:`libcloud.storage.base.Object` :param chunk_size: Optional chunk size (in bytes). :type chunk_size: ``int`` :rtype: ``iterator`` of ``bytes`` z9download_object_as_stream not implemented for this driverNr_ rY r r r r/ � s �z'StorageDriver.download_object_as_streamc C s t d��dS )a8 Download part of an object. :param obj: Object instance. :type obj: :class:`libcloud.storage.base.Object` :param destination_path: Full path to a file or a directory where the incoming file will be saved. :type destination_path: ``str`` :param start_bytes: Start byte offset (inclusive) for the range download. Offset is 0 index based so the first byte in file file is "0". :type start_bytes: ``int`` :param end_bytes: End byte offset (non-inclusive) for the range download. If not provided, it will default to the end of the file. :type end_bytes: ``int`` :param overwrite_existing: True to overwrite an existing file, defaults to False. :type overwrite_existing: ``bool`` :param delete_on_failure: True to delete a partially downloaded file if the download was not successful (hash mismatch / file size). :type delete_on_failure: ``bool`` :return: True if an object has been successfully downloaded, False otherwise. :rtype: ``bool`` z5download_object_range not implemented for this driverNr_ rZ r r r r5 � s &�z#StorageDriver.download_object_rangec C s t d��dS )a Return a iterator which yields range / part of the object data. :param obj: Object instance :type obj: :class:`libcloud.storage.base.Object` :param start_bytes: Start byte offset (inclusive) for the range download. Offset is 0 index based so the first byte in file file is "0". :type start_bytes: ``int`` :param end_bytes: End byte offset (non-inclusive) for the range download. If not provided, it will default to the end of the file. :type end_bytes: ``int`` :param chunk_size: Optional chunk size (in bytes). :type chunk_size: ``int`` :rtype: ``iterator`` of ``bytes`` z?download_object_range_as_stream not implemented for this driverNr_ r[ r r r r9 s �z-StorageDriver.download_object_range_as_streamc C s t d��dS )a Upload an object currently located on a disk. :param file_path: Path to the object on disk. :type file_path: ``str`` :param container: Destination container. :type container: :class:`libcloud.storage.base.Container` :param object_name: Object name. :type object_name: ``str`` :param verify_hash: Verify hash :type verify_hash: ``bool`` :param extra: Extra attributes (driver specific). (optional) :type extra: ``dict`` :param headers: (optional) Additional request headers, such as CORS headers. For example: headers = {'Access-Control-Allow-Origin': 'http://mozilla.com'} :type headers: ``dict`` :rtype: :class:`libcloud.storage.base.Object` z-upload_object not implemented for this driverNr_ )r rU r rP r rR rS r r r rT . s �zStorageDriver.upload_objectc C s t d��dS )a Upload an object using an iterator. If a provider supports it, chunked transfer encoding is used and you don't need to know in advance the amount of data to be uploaded. Otherwise if a provider doesn't support it, iterator will be exhausted so a total size for data to be uploaded can be determined. Note: Exhausting the iterator means that the whole data must be buffered in memory which might result in memory exhausting when uploading a very large object. If a file is located on a disk you are advised to use upload_object function which uses fs.stat function to determine the file size and it doesn't need to buffer whole object in the memory. :param iterator: An object which implements the iterator interface. :type iterator: :class:`object` :param container: Destination container. :type container: :class:`libcloud.storage.base.Container` :param object_name: Object name. :type object_name: ``str`` :param extra: (optional) Extra attributes (driver specific). Note: This dictionary must contain a 'content_type' key which represents a content type of the stored object. :type extra: ``dict`` :param headers: (optional) Additional request headers, such as CORS headers. For example: headers = {'Access-Control-Allow-Origin': 'http://mozilla.com'} :type headers: ``dict`` :rtype: ``libcloud.storage.base.Object`` z8upload_object_via_stream not implemented for this driverNr_ )r rW r rP r rS r r r rV M s +�z&StorageDriver.upload_object_via_streamc C s t d��dS )z� Delete an object. :param obj: Object instance. :type obj: :class:`libcloud.storage.base.Object` :return: ``bool`` True on success. :rtype: ``bool`` z-delete_object not implemented for this driverNr_ r\ r r r r= { s �zStorageDriver.delete_objectc C s t d��dS )z� Create a new container. :param container_name: Container name. :type container_name: ``str`` :return: Container instance on success. :rtype: :class:`libcloud.storage.base.Container` z0create_container not implemented for this driverNr_ rn r r r �create_container� s �z StorageDriver.create_containerc C s t d��dS )z� Delete a container. :param container: Container instance :type container: :class:`libcloud.storage.base.Container` :return: ``True`` on success, ``False`` otherwise. :rtype: ``bool`` z0delete_container not implemented for this driverNr_ rp r r r r] � s �z StorageDriver.delete_containerc C sn |pt j}t|ttf�s |g}n|}|j|v r<|f i |��S |jt jkrXt|jd| d��t d|j | d��dS )a Call passed callback and start transfer of the object' :param obj: Object instance. :type obj: :class:`Object` :param callback: Function which is called with the passed callback_kwargs :type callback: :class:`function` :param callback_kwargs: Keyword arguments which are passed to the callback. :type callback_kwargs: ``dict`` :param response: Response instance. :type response: :class:`Response` :param success_status_code: Status code which represents a successful transfer (defaults to httplib.OK) :type success_status_code: ``int`` :return: ``True`` on success, ``False`` otherwise. :rtype: ``bool`` � )rP �valuer zUnexpected status code: %s�rs r N) r �OK� isinstancerb �tuple�status� NOT_FOUNDr r r )r r! �callback�callback_kwargs�responseZsuccess_status_codeZsuccess_status_codesr r r � _get_object� s ���zStorageDriver._get_objectc C s |pt }tj�|�}|s4tj�|�s4td| | d��|sFt||j�} n|} tj�| �rn|sntd| d | d��d} t| d��<} |j � |�D ] } | � t | �� | t | �7 } q�W d � n1 s�0 Y |�st|j�t| �k�r|�r zt�| � W n t�y Y n0 dS d S ) a" Save object to the provided path. :param response: RawResponse instance. :type response: :class:`RawResponse` :param obj: Object instance. :type obj: :class:`Object` :param destination_path: Destination directory. :type destination_path: ``str`` :param delete_on_failure: True to delete partially downloaded object if the download fails. :type delete_on_failure: ``bool`` :param overwrite_existing: True to overwrite a local path if it already exists. :type overwrite_existing: ``bool`` :param chunk_size: Optional chunk size (defaults to ``libcloud.storage.base.CHUNK_SIZE``, 8kb) :type chunk_size: ``int`` :param partial_download: True if this is a range (partial) save, False otherwise. :type partial_download: ``bool`` :return: ``True`` on success, ``False`` otherwise. :rtype: ``bool`` zPath %s does not existrt z File %s already exists, but zoverwrite_existing=Falser �wbNFT)r �os�path�basename�existsr �pjoinr �open� _response� iter_content�writer �len�intr �unlink� Exception) r r| r! r' r( r) r- Zpartial_download� base_namerU �bytes_transferredZ file_handle�chunkr r r � _save_object� s< # ��� ,zStorageDriver._save_object�PUTc C s* |pi }|r$t j�|�s$td| ��|durHt|d�sHt|d�sHtd��| j|||d�|d< |r�| jj||||dd �} | � || � � �\} } n�t |d ��&} | jj||| |dd �} W d � n1 s�0 Y t |d ��$} | � | | � � �\} } W d � n1 �s0 Y | � � �s | � � | | | d �S ) z� Helper function for setting common request headers and calling the passed in callback which uploads an object. zFile %s does not existN�next�__next__z-iterator object must implement next() method.)rU z Content-TypeT)�method�datarS �raw�rb)r| r� Z data_hash)r r� r� �OSError�hasattr�AttributeError�_determine_content_type� connection�request�_hash_buffered_stream�_get_hash_functionr� �successZ parse_error)r rP � content_type� request_path�request_methodrS rU �stream�chunked� multipartr| Z stream_hashZ stream_lengthZ file_streamr r r �_upload_object sJ �� �� �$ �( �z StorageDriver._upload_objectc C s@ |r|S |p|}t jj�|�\}}| jr8|s8td| ��|p>tS )NzUFile content-type could not be guessed for "%s" and no content_type value is provided)�libcloud�utils�filesZguess_file_mime_type� strict_moder� r )r r� rP rU r �_r r r r� K s �z%StorageDriver._determine_content_type� c C sD d}t |d�st |d�r�t |d�rfz|�d� W n4 tyd } z |jtjkrP|�W Y d }~n d }~0 0 tjjj|d�D ] }|� t |�� |t |�7 }qv|� � |fS t |d�s�|D ]}|� |� |t |� }q�|� � |fS |�J |� |�}t |�dk�r|t |� }|� |� |� |�}q�W d � n1 �s.0 Y |� � |fS )Nr r� r� �seek)rW �__exit__)r� r� r� �errnoZESPIPEr� r� r� Zread_in_chunks�updater r� � hexdigest�read) r r� Zhasher� blocksizeZ total_len�er� �s�bufr r r r� Z s0 ,z#StorageDriver._hash_buffered_streamc C s8 zt t| j�� }W n ty2 td| j ��Y n0 |S )zh Return instantiated hash function for the hash type supported by the provider. z$Invalid or unsupported hash type: %s)�getattr�hashlib� hash_typer� � RuntimeError)r �funcr r r r� � s � z StorageDriver._get_hash_functionc C s> |dk rt d��|dur:||kr*t d��n||kr:t d��dS )zo Method which validates that start_bytes and end_bytes arguments contain valid values. r z"start_bytes must be greater than 0Nz*start_bytes must be smaller than end_byteszGstart_bytes and end_bytes can't be the same. end_bytes is non-inclusiveT)� ValueError)r r2 r3 r r r � _validate_start_and_end_bytes� s z+StorageDriver._validate_start_and_end_bytesc C s6 d| }|dur2|r"|t |�7 }n|t |d �7 }|S )a" Return range string which is used as a Range header value for range requests for drivers which follow standard Range header notation This returns range string in the following format: bytes=<start_bytes>-<end bytes>. For example: bytes=1-10 bytes=0-2 bytes=5- bytes=100-5000 :param end_bytes_inclusive: True if "end_bytes" offset should be inclusive (aka opposite from the Python indexing behavior where the end index is not inclusive). z bytes=%s-N� )�str)r r2 r3 Zend_bytes_inclusiveZ range_strr r r �_get_standard_range_str� s z%StorageDriver._get_standard_range_str)NN)NN)FT)N)NFT)NN)NTN)NN)N)FTNF)r� NNNFF)N)r� )N)NF)'r@ rA rB rC r Z connectionClsr r� Zsupports_chunked_encodingr� ra rc rG rJ rh rl ro rM rQ r" rN r% r+ r/ r5 r9 rT rV r= rq r] r} r� r� r� r� r� r� r� r r r r r sp � � � ) � � ! � . � , � M � 0 � + �r )$rC � __future__r �typingr r r r r �os.pathr r� re r� r r� Zlibcloud.utils.py3r r Zlibcloud.utils.filesr� Zlibcloud.common.typesr Zlibcloud.common.baser r r Zlibcloud.storage.typesr �__all__r r �objectr r r r r r r �<module> s0 `l
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка