Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/openstack/cloud/__pycache__/_object_store.cpython-39.pyc
Ðазад
a t�h � � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl m Z d dl m Z d dl mZ d dlmZ d dlmZ dZdZd d d �ZG d d � d e j�ZdS )� N)�exc)� _normalize)�_utils)� exceptions)�proxyi @g �Az.r:*,.rlistings� )�public�privatec @ sX e Zd Zedd� �ZdMdd�ZdNdd�ZdOd d �ZdPd d �Zdd� Z dd� Z dd� Z dd� Z dd� Z dd� Ze�� dd� �Zd d � ZdQd d �Zd d!� ZdRd"d#�Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd,d-� Zd.d/� Zd0d1� Z d2d3� Z dSd4d5�Z dTd6d7�Z dUd8d9�Z dVd:d;�Z!dWd<d=�Z"d>d?� Z#dXd@dA�Z$dYdBdC�Z%dZdEdF�Z&d[dGdH�Z'd\dIdJ�Z(dKdL� Z)dS )]�ObjectStoreCloudMixinc C s( d| j vr | �d�}|| j d< | j d S )Nz object-store)Z _raw_clientsZ_get_raw_client)�selfZ raw_client� r ��/root/rpmbuild/BUILDROOT/imh-python39-modules-3.9.7-92.el8.x86_64/opt/imh-python/lib/python3.9/site-packages/openstack/cloud/_object_store.py�_object_store_client. s z*ObjectStoreCloudMixin._object_store_clientTNc C s. t d|d�}| jjd|d�}| �dt�|��S )z�List containers. :param full_listing: Ignored. Present for backwards compat :returns: list of Munch of the container objects :raises: OpenStackCloudException on operation error. �json��format�prefix�/��paramsN)�dict� object_store�get�_get_and_munchifyr �_json_response)r � full_listingr r �responser r r �list_containers5 s z%ObjectStoreCloudMixin.list_containersc C s | � � }t�|||�S )a� Search containers. :param string name: container name. :param filters: a dict containing additional filters to use. OR A string containing a jmespath expression for further filtering. Example:: "[?last_name==`Smith`] | [?other.gender]==`Female`]" :returns: a list of ``munch.Munch`` containing the containers. :raises: ``OpenStackCloudException``: if something goes wrong during the OpenStack API call. )r r � _filter_list)r �name�filters� containersr r r �search_containersB s z'ObjectStoreCloudMixin.search_containersFc C s� |s|| j vr~z,| j�| �|��}t�|� |j| j |< W nB tjy| } z(|j j dkrfW Y d}~dS � W Y d}~n d}~0 0 | j | S )a Get metadata about a container. :param str name: Name of the container to get metadata for. :param bool skip_cache: Ignore the cache of container metadata for this container.o Defaults to ``False``. � N) �_container_cacher �head�_get_object_endpointr �raise_from_response�headersr �OpenStackCloudHTTPErrorr � status_code)r r � skip_cacher �er r r � get_containerS s � z#ObjectStoreCloudMixin.get_containerc C sH | � |�}|r|S t�| j�| �|��� |r:| �|d� | j |dd�S )z�Create an object-store container. :param str name: Name of the container to create. :param bool public: Whether to set this container to be public. Defaults to ``False``. r T�r+ )r- r r' r �putr& �set_container_access)r r r � containerr r r �create_containeri s � z&ObjectStoreCloudMixin.create_containerc C s� z,t �| j�| �|��� | j�|d� W dS tjy� } zF|j j dkrXW Y d}~dS |j j dkrvt� dj |d���� W Y d}~n d}~0 0 dS )zeDelete an object-store container. :param str name: Name of the container to delete. NTr# Fi� z�Attempt to delete container {container} failed. The container is not empty. Please delete the objects inside it before deleting the container)r1 ) r r' r �deleter& r$ �popr r) r r* �OpenStackCloudExceptionr )r r r, r r r �delete_container{ s � ��z&ObjectStoreCloudMixin.delete_containerc C s t �| jj| �|�|d�� dS )z�Update the metadata in a container. :param str name: Name of the container to create. :param dict headers: Key/Value headers to set on the container. �r( N)r r' r �postr& )r r r( r r r �update_container� s ��z&ObjectStoreCloudMixin.update_containerc C s> |t vr"t�d|tt �� �f ��dt | i}| �||� dS )a1 Set the access control list on a container. :param str name: Name of the container. :param str access: ACL string to set on the container. Can also be ``public`` or ``private`` which will be translated into appropriate ACL strings. z:Invalid container access specified: %s. Must be one of %s�x-container-readN)�OBJECT_CONTAINER_ACLSr r5 �list�keysr9 )r r �access�headerr r r r0 � s �� z*ObjectStoreCloudMixin.set_container_accessc C sh | j |dd�}|s t�d| ��|�dd�}t�� D ] \}}t|�t|�kr4| S q4t�d| ��dS )z`Get the control list from a container. :param str name: Name of the container. Tr. zContainer not found: %sr: r z1Could not determine container access for ACL: %s.N)r- r r5 r r; �items�str)r r r1 Zacl�key�valuer r r �get_container_access� s �z*ObjectStoreCloudMixin.get_container_accessc C s� dj |t�|�jd�}|| jvr�| j�dd|i� d\}}t|d�� }| �|�\}}W d � n1 sh0 Y t ||d�| j|< | j�d|| j| d | j| d d �� | j| d | j| d fS ) Nz{filename}:{mtime})�filename�mtimez#Calculating hashes for %(filename)srE )NN�rb)�md5�sha256z5Image file %(filename)s md5:%(md5)s sha256:%(sha256)srH rI )rE rH rI ) r �os�stat�st_mtimeZ_file_hash_cache�log�debug�open�_calculate_data_hashesr )r rE Zfile_keyrH rI Zfile_objr r r �_get_file_hashes� s0 � � ,� �� �z&ObjectStoreCloudMixin._get_file_hashesc sl t �� }t �� }t� d�rHt� fdd�d�D ]}|�|� |�|� q,n|�� � |�� � |�� |�� fS )N�readc s � � d�S )Ni )rR r ��datar r �<lambda>� � z>ObjectStoreCloudMixin._calculate_data_hashes.<locals>.<lambda>rV )�hashlibrH rI �hasattr�iter�update� hexdigest)r rT rH rI �chunkr rS r rP � s z,ObjectStoreCloudMixin._calculate_data_hashesc C s6 t j�| j�� �}dj|j|jd�}t� | j� |��S )z�Get infomation about the object-storage service The object-storage service publishes a set of capabilities that include metadata about maximum values and thresholds. z{scheme}://{netloc}/info)�scheme�netloc) �urllib�parse�urlparser � get_endpointr r] r^ r r r )r �endpoint�urlr r r �get_object_capabilities� s �z-ObjectStoreCloudMixin.get_object_capabilitiesc C s� |du r t }d}z | �� }W nF tjyb } z,|jjdv rLt}| j�d� n� W Y d}~n2d}~0 0 |� di �� dd�}|� di �� dd�}||kr�|S ||k r�|S |S ) z4Get a segment size that will work given capabilitiesNr )r# i� z>Swift capabilities not supported. Using default max file size.�swiftZ max_file_sizeZslo�min_segment_size) �DEFAULT_OBJECT_SEGMENT_SIZEre r r) r r* �DEFAULT_MAX_FILE_SIZErM �infor )r � segment_sizerg Zcapsr, Zserver_max_file_sizer r r �get_object_segment_size� s* ��z-ObjectStoreCloudMixin.get_object_segment_sizec C s� | � ||�}|s*| j�dj||d�� dS |s@|s@| �|�\}}|�| j|�| jd��}|�| j|�| j d��}| j ||||d�} | s�| j�d|||d�� dS | j�d||d�� d S ) a� Check to see if an object matches the hashes of a file. :param container: Name of the container. :param name: Name of the object. :param filename: Path to the file. :param file_md5: Pre-calculated md5 of the file contents. Defaults to None which means calculate locally. :param file_sha256: Pre-calculated sha256 of the file contents. Defaults to None which means calculate locally. z0swift stale check, no object: {container}/{name})r1 r Tr )rH rI �md5_key� sha256_keyz>swift checksum mismatch: %(filename)s!=%(container)s/%(name)s)rE r1 r z/swift object up to date: %(container)s/%(name)sF) �get_object_metadatarM rN r rQ r �_OBJECT_MD5_KEYZ_SHADE_OBJECT_MD5_KEY�_OBJECT_SHA256_KEYZ_SHADE_OBJECT_SHA256_KEY�_hashes_up_to_date) r r1 r rE Zfile_md5Z file_sha256�metadatarm rn � up_to_dater r r �is_object_stale sB ������ ��z%ObjectStoreCloudMixin.is_object_stalec K s" d|d< | j ||fddd�|��S )a@ Create a zero-byte directory marker object .. note:: This method is not needed in most cases. Modern swift does not require directory marker objects. However, some swift installs may need these. When using swift Static Web and Web Listings to serve static content one may need to create a zero-byte object to represent each "directory". Doing so allows Web Listings to generate an index of the objects inside of it, and allows Static Web to render index.html "files" that are "inside" the directory. :param container: The name of the container. :param name: Name for the directory marker object within the container. :param headers: These will be passed through to the object creation API as HTTP Headers. zapplication/directoryz content-typer F)rT �generate_checksums)� create_object)r r1 r r( r r r � create_directory_marker_object? s ���z4ObjectStoreCloudMixin.create_directory_marker_objectc K s� | dur|rt d��| dur(|s(t d��| dur<| r<t d��| du rV| durRd} nd} |s^i }|sn| du rn|}| r�|du s�|du r�| �|�\}}|r�|p�d| | j< |r�|p�d| | j< |�� D ],\} } | �� �d�s�| | d| < q�| | | < q�| �||�}| du�r | j� d d |i� | � || | �S |�r.t |�}| � |�}t j�|�}| �|||||��r�| j� d ||d �� ||k�r�| �||| � n| �||| |||� dS ) aB Create a file object. Automatically uses large-object segments if needed. :param container: The name of the container to store the file in. This container will be created if it does not exist already. :param name: Name for the object within the container. :param filename: The path to the local file whose contents will be uploaded. Mutually exclusive with data. :param data: The content to upload to the object. Mutually exclusive with filename. :param md5: A hexadecimal md5 of the file. (Optional), if it is known and can be passed here, it will save repeating the expensive md5 process. It is assumed to be accurate. :param sha256: A hexadecimal sha256 of the file. (Optional) See md5. :param segment_size: Break the uploaded object into segments of this many bytes. (Optional) Shade will attempt to discover the maximum value for this from the server if it is not specified, or will use a reasonable default. :param headers: These will be passed through to the object creation API as HTTP Headers. :param use_slo: If the object is large enough to need to be a Large Object, use a static rather than dynamic object. Static Objects will delete segment objects when the manifest object is deleted. (optional, defaults to True) :param generate_checksums: Whether to generate checksums on the client side that get added to headers for later prevention of double uploads of identical data. (optional, defaults to True) :param metadata: This dict will get changed into headers that set metadata of the object :raises: ``OpenStackCloudException`` on operation error. Nz0Both filename and data given. Please choose one.z/name is a required parameter when data is givenz1checksums cannot be generated with data parameterFTr �x-object-meta-z$swift uploading data to %(endpoint)src z,swift uploading %(filename)s to %(endpoint)s)rE rc )� ValueErrorrQ rp rq r@ �lower� startswithr& rM rN �_upload_object_data�intrl rJ �path�getsizeru �_upload_object�_upload_large_object)r r1 r rE rH rI rk �use_slors rv rT r( �k�vrc � file_sizer r r rw \ sh ' � � � � � �z#ObjectStoreCloudMixin.create_objectc C s t �| jj|||d��S )N�r( rT )r r r r/ )r rc rT r( r r r r} � s �z)ObjectStoreCloudMixin._upload_object_datac C s t �| jj||t|d�d��S )NrG r� )r r r r/ rO )r rc rE r( r r r r� � s �z$ObjectStoreCloudMixin._upload_objectc C sb t �� }ttd||��D ]D\}}||| }t�||||k r@|n|�} dj||d�} | || < q|S )Nr z{endpoint}/{index:0>6})rc �index)� collections� OrderedDict� enumerate�ranger Z FileSegmentr ) r rc rE r� rk �segmentsr� �offset� remaining�segmentr r r r �_get_file_segments� s �� z(ObjectStoreCloudMixin._get_file_segmentsc C s0 | j �� }|�|d�}|�d�r,|dd� }|S )z�Get container_name/object_name from the full URL called. Remove the Swift endpoint from the front of the URL, and remove the leaving / that will leave behind.r r � N)r rb �replacer| )r rd rc Z object_namer r r �_object_name_from_url� s z+ObjectStoreCloudMixin._object_name_from_urlc C sR |D ]H}d|j vrq| �|j�}|D ]&}|d dj|d�kr$|j d |d< q$qd S )NZEtagr �/{name}�r �etag)r( r� rd r )r �segment_results�manifest�resultr �entryr r r �_add_etag_to_manifest� s z+ObjectStoreCloudMixin._add_etag_to_manifestc C s� g }g }g } g } g } | � ||||�} | �� D ]H\} }| jj| jj| ||dd�}|�|� | �tdj| d�|j d�� q,| j |dd�\}} | � || � | D ]D}| � |j �} | | }|�d� | jj| jj| ||d�}| �|� q�| j | d d�\}} | � || � z(|�r| �||| �W S | �||�W S W nf t�y� z,|�d �d }| j�d |� | j|d � W n" t�y� | j�d|� Y n0 � Y n0 d S )NF)r( rT Z raise_excr� r� )r Z size_bytes)�raise_on_errorr r� Tr ���zHFailed to upload large object manifest for %s. Removing segment uploads.)�segment_prefixz'Failed to cleanup image objects for %s:)r� r@ Z_pool_executorZsubmitr r/ �appendr r �length�_wait_for_futuresr� r� rd �seek�_finish_large_object_slo�_finish_large_object_dlo� Exception�splitrM rN � delete_autocreated_image_objects� exception)r rc rE r( r� rk r� Zsegment_futuresr� Z retry_resultsZ retry_futuresr� r� r r� Zsegment_futurer� r� r r r r� � st �� � � � � ��� � z*ObjectStoreCloudMixin._upload_large_objectc C sX |� � }d}z | jj|ddi|t�|�d�W S tyP |d8 }|dkrL� Y q 0 q d S )N� �multipart-manifestr/ )r r( rT r� r )�copyr r/ r �dumpsr� )r rc r( r� �retriesr r r r� ; s � z.ObjectStoreCloudMixin._finish_large_object_sloc C sR |� � }||d< d}z| jj||d�W S tyJ |d8 }|dkrF� Y q0 qd S )NzX-Object-Manifestr� r7 r� r )r� r r/ r� )r rc r( r� r r r r� K s z.ObjectStoreCloudMixin._finish_large_object_dloc K sR |si }i }|� � D ]\}}||d| < qt|fi |��}| jj| �||�|d�S )a� Update the metadata of an object :param container: The name of the container the object is in :param name: Name for the object within the container. :param metadata: This dict will get changed into headers that set metadata of the object :param headers: These will be passed through to the object update API as HTTP Headers. :raises: ``OpenStackCloudException`` on operation error. ry r7 )r@ r r r8 r& )r r1 r rs r( Zmetadata_headersr� r� r r r � update_objectW s �z#ObjectStoreCloudMixin.update_objectc C s( t d|d�}| jj||d�}| �d|�S )a} List objects. :param container: Name of the container to list objects in. :param full_listing: Ignored. Present for backwards compat :param string prefix: only objects with this prefix will be returned. (optional) :returns: list of Munch of the objects :raises: OpenStackCloudException on operation error. r r r N)r r r r )r r1 r r r rT r r r � list_objectsq s z"ObjectStoreCloudMixin.list_objectsc C s | � |�}t�|||�S )a� Search objects. :param string name: object name. :param filters: a dict containing additional filters to use. OR A string containing a jmespath expression for further filtering. Example:: "[?last_name==`Smith`] | [?other.gender]==`Female`]" :returns: a list of ``munch.Munch`` containing the objects. :raises: ``OpenStackCloudException``: if something goes wrong during the OpenStack API call. )r� r r )r r1 r r �objectsr r r �search_objects� s z$ObjectStoreCloudMixin.search_objectsc C sp zT|s| � ||�}|s W dS i }|�dd�dkr8d|d< | jj| �||�|d� W dS tjyj Y dS 0 dS ) a� Delete an object from a container. :param string container: Name of the container holding the object. :param string name: Name of the object to delete. :param dict meta: Metadata for the object in question. (optional, will be fetched if not provided) :returns: True if delete succeeded, False if the object was not found. :raises: OpenStackCloudException on operation error. FzX-Static-Large-ObjectN�Truer3 r� r T)ro r r r3 r& r r) )r r1 r �metar r r r � delete_object� s �z#ObjectStoreCloudMixin.delete_objectc C st |du r| j }| jsdS d}| j||d�D ]D}| �||d �}|�| j|�| j��dkr*| �||d |�r*d}q*|S )a� Delete all objects autocreated for image uploads. This method should generally not be needed, as shade should clean up the objects it uses for object-based image creation. If something goes wrong and it is found that there are leaked objects, this method can be used to delete any objects that shade has created on the user's behalf in service of image uploads. :param str container: Name of the container. Defaults to 'images'. :param str segment_prefix: Prefix for the image segment names to delete. If not given, all image upload segments present are deleted. NF)r r �trueT)Z _OBJECT_AUTOCREATE_CONTAINERZimage_api_use_tasksr� ro r Z_OBJECT_AUTOCREATE_KEYZ _SHADE_OBJECT_AUTOCREATE_KEYr� )r r1 r� Zdeleted�objr� r r r r� � s" ���z6ObjectStoreCloudMixin.delete_autocreated_image_objectsc C s` z| j �| �||��jW S tjyZ } z(|jjdkrDW Y d }~d S � W Y d }~n d }~0 0 d S )Nr# )r r% r& r( r r5 r r* )r r1 r r, r r r ro � s � z)ObjectStoreCloudMixin.get_object_metadatac C s | � |||�}| jj||d�S )a� Get a raw response object for an object. :param string container: name of the container. :param string obj: name of the object. :param string query_string: query args for uri. (delimiter, prefix, etc.) :param bool stream: Whether to stream the response or not. :returns: A `requests.Response` :raises: OpenStackCloudException on operation error. ��stream)r& r r )r r1 r� � query_stringr� rc r r r �get_object_raw� s z$ObjectStoreCloudMixin.get_object_rawc C s< t j�|�}|r&dj|t j�|�d�}|r8dj||d�}|S )Nz{endpoint}/{object})rc �objectz{endpoint}?{query_string})rc r� )r_ r` �quoter )r r1 r� r� rc r r r r& � s ��z*ObjectStoreCloudMixin._get_object_endpoint� c c s� zL| j |||d��(}|j|d�D ] }|V q W d � n1 s@0 Y W nB tjy� } z(|jjdkrxW Y d}~dS � W Y d}~n d}~0 0 dS )a Download the content via a streaming iterator. :param string container: name of the container. :param string obj: name of the object. :param string query_string: query args for uri. (delimiter, prefix, etc.) :param int resp_chunk_size: chunk size of data to read. Only used if the results are :returns: An iterator over the content or None if the object is not found. :raises: OpenStackCloudException on operation error. )r� )� chunk_sizeNr# )r� � iter_contentr r) r r* )r r1 r� r� �resp_chunk_sizer �retr, r r r � stream_object� s �* z#ObjectStoreCloudMixin.stream_objectc C s4 | � |||�}z�|du}| jj||d���} dd� | j�� D �} |r�t|t�rXt|d�} n|} | j|dd�D ]} | � | � qjt|t�r�| � � n| � � | dfW d � W S | | j fW d � W S W d � n1 s�0 Y W nF t j�y. } z*| jjdk�rW Y d} ~ dS � W Y d} ~ n d} ~ 0 0 dS ) a~ Get the headers and body of an object :param string container: name of the container. :param string obj: name of the object. :param string query_string: query args for uri. (delimiter, prefix, etc.) :param int resp_chunk_size: chunk size of data to read. Only used if the results are being written to a file or stream is True. (optional, defaults to 1k) :param outfile: Write the object to a file instead of returning the contents. If this option is given, body in the return tuple will be None. outfile can either be a file path given as a string, or a File like object. :returns: Tuple (headers, body) of the object, or None if the object is not found (404). :raises: OpenStackCloudException on operation error. Nr� c S s i | ]\}}|� � |�qS r )r{ )�.0r� r� r r r � <dictcomp>/ s z4ObjectStoreCloudMixin.get_object.<locals>.<dictcomp>�wbF)�decode_unicoder# )r& r r r( r@ � isinstancerA rO r� �write�close�flush�textr r) r r* )r r1 r� r� r� �outfiler� rc � get_streamr �response_headersZoutfile_handler\ r, r r r � get_object s6 �� � <z ObjectStoreCloudMixin.get_objectc C s� g }g }t j�|�D ]�}z |�� }t�|� |�|� W q tjjtj fy� } zHd� t |��}|rt| j � |� � n | j �|� |�|�� � W Y d}~qd}~0 0 q||fS )z@Collect results or failures from a list of running future tasks.z#Exception processing async task: {}N)� concurrent�futuresZ as_completedr� r r' r� � keystoneauth1ZRetriableConnectionFailureZ HttpExceptionr rA rM r� rN ) r r� r� �resultsr� � completedr� r, Z error_textr r r r� E s& � � &z'ObjectStoreCloudMixin._wait_for_futuresc C sH d}|r||krd}|r$||kr$d}|r4||kr4d}|rD||krDd}|S )z�Compare md5 and sha256 hashes for being up to date md5 and sha256 are the current values. md5_key and sha256_key are the previous values. FTr )r rH rI rm rn rt r r r rr _ s z(ObjectStoreCloudMixin._hashes_up_to_date)TN)NN)F)F)NN)NNNNTNNN)N)TN)NN)N)NN)NF)NN)Nr� )Nr� NF)T)*�__name__� __module__� __qualname__�propertyr r r" r- r2 r6 r9 r0 rD rQ rP r Zcache_on_argumentsre rl ru rx rw r} r� r� r� r� r� r� r� r� r� r� r� r� ro r� r& r� r� r� rr r r r r r , s` � , � e Q # � � � 2 r )r� �concurrent.futuresr� rW r rJ �types� urllib.parser_ Zkeystoneauth1.exceptionsr� Zopenstack.cloudr r r Z openstackr r rh ri r; Z Normalizerr r r r r �<module> s$ �
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка