Файловый менеджер - Редактировать - /opt/imh-python/lib/python3.9/site-packages/restic/__pycache__/base.cpython-39.pyc
Ðазад
a � h�` � @ s d Z ddlmZmZmZmZmZ ddlmZ ddl m Z ddl Z ddl m Z ddlZddlmZmZ ddlZddlZddlmZ dd lmZmZ dd lm Z ddl Z d d l m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+ d d l,m-Z-m.Z.m/Z/ dZ0dd� Z1G dd� d�Z2G dd� d�Z3dS )z!Main Restic objects and functions� )�Literal�TextIO�Union�Optional�overload)� Generator)�PurePathN)�quote)�CalledProcessError�PIPE)�Config)� BotoCoreError� ClientError)�ServiceResource� ) � ResticRepo�Snapshot� ResticCmd�SnapPath�SnapFile�SnapDir�Backup�SQLBackupGroup� SQLBackupItem�UserBackupDicts� UserBackups� _tag_quote)� ResticError�ResticBadIndexError�ResticLockedErrorz/usr/bin/resticc s t �� �� fdd��}|S )zFWraps a function and makes it automatically retry on ResticLockedErrorc sf z� | g|�R i |��W S t yF } z|�� s2� W Y d }~n d }~0 0 | �� � | g|�R i |��S �N)r � unlock_ok�unlock)�self�args�kwargs�exc��func� �:/opt/imh-python/lib/python3.9/site-packages/restic/base.py� _locked_retry+ s z#locked_retry.<locals>._locked_retry)� functools�wraps)r( r+ r) r' r* � locked_retry( s r. c @ s e Zd ZdZdZdddddd�eeedf eeeee j df ee ef ee edf eedf d�d d �Z d d � Z eeeef d �dd��ZdPed �dd�Zeedf d �dd�Zed �dd�Zed �dd�Zdd� Zedd � �ZedQed �d d ��Zed �d!d"�Z ee e d �d#d$��Z eddd%�ee e df eeedf e e d&�d'd(��Z dddd d)�e eee f e e eedf e!e eee f e!e eee f eed*�d+d,�Z"dReee f e e eedf eeee#f dd-�d.d/�Z$dSeee f e e eedf eed0�d1d2�Z%ee ef eee f ed3�d4d5�Z&ddd6d7�ee ef e!e eee f e!e eee f eee f ed8�d9d:�Z'e(e e eedf ee e d;�d<d=��Z)ed>d d?�eed?�d@dA��Z*ee ef eee f e ee+e,f dB�dCdD�Z-eee ef eee f e.ee+e,f ddf dB�dEdF��Z/e0dTdddG�e!e eeedf e1d e!e e eee2f dH�dIdJ��Z3e0dUdddG�e!e eeedf e1d> e!e e eee4f dH�dKdJ��Z3dVdd ddL�e!e eeedf ee!e e eeeee f f dH�dMdJ�Z3e(dNdO� �Z5dS )W�Restica1 Handles restic commands Args: endpoint (str): S3 server base url with https:// (excluding s3: prefix) cluster (str | None): Optional cluster name. Only used by repr() repo (ResticRepo): dataclass containing bucket name and key info lim (int, float, ProcLimit, None): max load limit. This can be a static limit if you set it to a float or int, or for more flexibility, use a ``ProcLimit`` instance. If unset, processes will not be ratelimited tmp_dir (Path | str): TMPDIR to use. Defaults to '/var/tmp/restic'. cache_dir (Path, str | None): RESTIC_CACHE_DIR to use. Set this to None to disable cache. Defaults to '/var/cache/restic/%(bucket)s' gomaxprocs (int, None): max CPU cores to allow restic to use �resticNz/var/tmp/resticz /var/cache/restic/%(bucket)s� )�cluster�lim�tmp_dir� cache_dir� gomaxprocs)�endpointr2 �repor3 r4 r5 r6 c C sX || _ || _|| _|| _t|�| _|| _|d u r8d | _nt|�d|ji | _| j | _ d S )N�bucket) r7 r2 r8 r3 �strr4 r6 r5 r9 � repair_index� rebuild_index)r# r7 r2 r8 r3 r4 r5 r6 r) r) r* �__init__K s zRestic.__init__c C s. | j r d| j � d| jj� d�S d| jj� d�S )NzRestic<�:�>)r2 r8 r9 �r# r) r) r* �__repr__b s zRestic.__repr__)�returnc C sT | j d| jj| jj| jjd�}| jr.| j|d< | jdurP| jdkrPt| j�|d< |S )z Restic environment variable dict�1)�TMPDIRZGOGCZRESTIC_PASSWORDZAWS_ACCESS_KEY_IDZAWS_SECRET_ACCESS_KEYZRESTIC_CACHE_DIRNr Z GOMAXPROCS)r4 r8 � restic_pass� access_key� secret_keyr5 r6 r: )r# �retr) r) r* �envg s � z Restic.env� c C s: t |d|i|d�}tjd| j| jj| jj|d��| jj�S )z�Gets a boto3 s3.Bucket for this repo Args: timeout (int): network timeout in secs retries (int): times to retry on timeout Returns: s3.Bucket: boto3 resource for this bucket Z max_attempts)�connect_timeout�retries� read_timeoutZs3)Z endpoint_urlZaws_access_key_idZaws_secret_access_key�config) � BotoConfig�boto3�resourcer7 r8 rF rG �Bucketr9 )r# �timeoutrL rN r) r) r* � s3_bucketw s ���zRestic.s3_bucketc C sf z t t| �� jjdd���dkW S ty` } z(dt|�v rJW Y d}~dS � W Y d}~n d}~0 0 dS )a� Check if the /keys/ path has items in it, meaning that restic has been initialized Raises: botocore.exceptions.ClientError: connection problem botocore.exceptions.BotoCoreError: boto3 error Returns: (bool | None): whether the keys path existed in the bucket, or None if the bucket did not exist at all zkeys/)ZPrefixr Z NoSuchBucketN)�len�listrT Zobjects�filterr r: �r# r& r) r) r* �init_key_exists� s � zRestic.init_key_existsc C s� z| � � W �n" ttfyN } z$t�d| t|�j|� W Y d}~dS d}~0 ty� } zR|�� s�t�d|j |� W Y d}~dS z | � � W n t y� Y n0 W Y d}~n�d}~0 t � y� } z,z | � � W n t y� Y n0 W Y d}~n@d}~0 t �y0 } z t�d|j |� W Y d}~dS d}~0 0 z | � � W nx ttf�y� } z$t�d| t|�j|� W Y d}~dS d}~0 t �y� } z t�d|j |� W Y d}~dS d}~0 0 dS )z�Prepare access to this repo if needed and preemptively fix issues connecting to it. Plugins should probably run this first Returns: bool: whether this repo is ready for access z %s %s: %sNFz%%s: could not automatically unlock %sz%s: %sT)� init_repor r �logging�error�type�__name__r r! �namer" r r r< rX r) r) r* �prepare� s@ � zRestic.preparec C sh | � � }rdS |du r0| �� }|�� |�� | �d�jtdd�}d|jv rRdS d|jvrdt |��dS )af Initializes a restic repo if it hasn't been done already Raises: botocore.exceptions.ClientError: connection problem botocore.exceptions.BotoCoreError: boto3 error ResticError: if the restic init command fails with an error Returns: bool: True if initialized or False if already done FN�initT)�stdout�no_limzalready initializedzcreated restic repository) rY rT �createZwait_until_exists�build�runr �stderrrb r )r# �existsr9 rH r) r) r* rZ � s zRestic.init_repoc C sL z| � d�jddd� W n. tyF } zt|�|�W Y d}~n d}~0 0 dS )zgRun restic unlock Raises: ResticError: if the restic unlock command fails r" T��checkrc N�re rf r r rX r) r) r* r" � s z Restic.unlockc C sP z | � ddd�jddd� W n. tyJ } zt|�|�W Y d}~n d}~0 0 dS )z_Run restic repair index Raises: ResticError: if the command fails Zrepair�indexz--read-all-packsTri Nrk rX r) r) r* r; � s � zRestic.repair_indexT)rc c C s\ | j r d}nd}z| j|� jd|d� W n. tyV } zt|�|�W Y d}~n d}~0 0 dS )z�Run restic prune Args: no_lim (bool): do not CPU limit the command as it runs regardless of the lim arg in Restic Raises: ResticError: if the command fails )�prune�--cleanup-cache)rm Tri N)r5 re rf r r )r# rc r$ r& r) r) r* rm � s z Restic.prunec G s | j }|�|� t|| d�S )z�Build a ResticCmd object that can be used to execute the requested restic command Args: *args (tuple[str]): restic subcommand and args Returns: ResticCmd: a restic command executor )r0 )�_basecmd�extendr )r# r$ �cmdr) r) r* re s z Restic.buildc C s. t d| j� d| jj� �g}| js*|�d� |S )Nz --repo=s3:�/z --no-cache)� RESTIC_PATHr7 r8 r9 r5 �append)r# rq r) r) r* ro ! s � zRestic._basecmd��tagsrS )rv rS rB c s� ddg}|r*|D ]}|� dt|t�g� qz � j|� jtdd|d�}W n. tyt } zt|�|�W Y d}~n d}~0 0 � fdd�t� |j �D �S ) a� Get a list of restic snapshots in this repo. If this server is a Backup Manager client, see the ``get_backups()`` function instead args: tags (list[str], optional): only consider snapshots which include this tag list. To check with AND logic, specify a single tag as ``["tag1,tag2"]``. To check for either tag, specify independently as ``["tag1", "tag2"]`` timeout (float | int | None): optional command timeout Raises: ResticError: if the restic snapshots command failed subprocess.TimeoutExpired: if timeout was specified and exceeded Returns: list[Snapshot]: Snapshots found in the repo � snapshots�--json�--tagT)rb rj rc rS Nc s g | ]}t � |d ��qS )�r0 �data)r ��.0�xr@ r) r* � <listcomp>M � z$Restic.snapshots.<locals>.<listcomp>) rp r � url_quotere rf r r r �json�loadsrb )r# rv rS r$ �tagrH r& r) r@ r* rw + s � zRestic.snapshots)�bwlimit�excludes� exclude_files�quiet)�pathsrv r� r� r� r� rB c C st | � |||�}|dur2|D ]}|�dt|�g� q|durV|D ]} |�dt| �g� q>|�dd� |D �� | j|� S )a Crafts a ResticCmd to backup a list of paths. Warning: return codes 0 and 3 should be considered success. See https://github.com/restic/restic/pull/2546 Args: paths (list[str | PurePath]): list of paths to backup tags (list[str]): list of labels for the snapshot bwlimit (int | None): limits uploads to a max in KiB/s. Defaults to unlimited excludes (list[str | PurePath], optional): list of paths to exclude exclude_files (list[str | PurePath], optional): list of paths of files containing glob patterns to exclude quiet (bool): add the --quiet flag. Defaults True Returns: ResticCmd: a restic command executor N� --excludez--exclude-filec S s g | ] }t |��qS r) )r: r| r) r) r* r s r� z!Restic.backup.<locals>.<listcomp>�� _backup_argsrp r: re ) r# r� rv r� r� r� r� r$ �excludeZ exclude_filer) r) r* �backupO s z Restic.backup)�pathrv r� r� �streamrB c C sp | � ||||�}z,t|t�r,|j|dd� n|j|dd� W n. tyj } zt|�|�W Y d}~n d}~0 0 dS )a� Uploads a stream or str to the restic repo Args: stream (str | TextIO): data source to upload, such as the stdout of a mysqldump process path (str | PurePath): the --stdin-filename to use. This isn't necessarily where the data came from, but is where restic will say it did in the snapshot's metadata tags (list[str]): list of labels for the snapshot bwlimit (int | None): limits uploads to a max in KiB/s. Defaults to unlimited quiet (bool): add the --quiet flag. Defaults True Raises: ResticError: if the restic command failed T)�inputrj )�stdinrj N)� upload_cmd� isinstancer: rf r r )r# r� r� rv r� r� rq r& r) r) r* �uploadv s z Restic.upload)r� rv r� r� rB c C s, | � |||�}|�ddt|�g� | j|� S )aQ Like `upload` but returns a ResticCmd rather than running directly Args: path (str | PurePath): the --stdin-filename to use. This isn't necessarily where the data came from, but is where restic will say it did in the snapshot's metadata tags (list[str]): list of labels for the snapshot bwlimit (int | None): limits uploads to a max in KiB/s. Defaults to unlimited quiet (bool): add the --quiet flag. Defaults True Returns: ResticCmd: restic command executor z--stdinz--stdin-filenamer� )r# r� rv r� r� r$ r) r) r* r� � s zRestic.upload_cmd)�snap�filenamerB c C s& t |t�r|jn|}| �d|t|��S )a" Crafts a ResticCmd to dump a file from the specified snapshot ID Args: snap (Snapshot | str): snapshot or snapshot ID to dump data from filename (str | PurePath): filename to retrieve Returns: ResticCmd: restic command executor �dump)r� r �idre r: )r# r� r� �snap_idr) r) r* r� � s z Restic.dumprr )�includesr� �target)r� r� r� r� rB c C s~ t |t�r|jn|}ddt|�g}|durF|D ]}|�dt|�g� q.|durj|D ]}|�dt|�g� qR|�|� | j|� S )a� Crafts a ResticCmd to restore a snapshot Args: snap (str): snapshot or snapshot ID to restore from includes (list[str | PurePath], optional): --include paths excludes (list[str | PurePath], optional): --exclude paths target (str | PurePath): base directory prefix to restore to. Defaults to '/', which restores to the original path Returns: ResticCmd: restic command executor �restorez--targetNz --includer� )r� r r� r: rp rt re ) r# r� r� r� r� r� r$ Zincluder� r) r) r* r� � s zRestic.restore)rv r� r� rB c C sX dg}|r|� d� |dur6|dkr6|�dt|�g� | D ]}|�dt|t�g� q:|S )z!Builds the base backup subcommandr� z--quietNr z--limit-uploadry )rt rp r: r r� )rv r� r� r$ r� r) r) r* r� � s zRestic._backup_argsF)rm rc c G s� dg}|r*| j r |�ddg� n |�d� |�dd� |D �� z| j|� jd|d� W n. ty� } zt|�|�W Y d}~n d}~0 0 dS ) a� Run restic forget Args: *ids (Snapshot | str): snapshots to remove, specified by either a Snapshot object or snapshot ID str prune (bool): whether to automatically run prune if at least one snapshot was removed. Defaults to False no_lim (bool): do not CPU limit the command as it runs regardless of the lim arg in Restic Raises: ResticError: if the restic forget command fails �forgetz--prunern c S s g | ]}t |t�r|jn|�qS r) )r� r r� r| r) r) r* r r� z!Restic.forget.<locals>.<listcomp>Tri N)r5 rp rt re rf r r )r# rm rc Zidsr$ r& r) r) r* r� � s z Restic.forget)r� r� rB c C s t | j||d��S )am Like ``scandir`` but return a list instead of a Generator. Returns files/dirs found in a requested path in a Snapshot Args: snap (Snapshot | str): snapshot to list the contents of, supplied either by its Snapshot instance of snapshot ID path (str | PurePath): full path inside the snapshot to list the contents of Raises: ValueError: requested path was not a full path ResticError: Any error listing snapshot contents from restic Returns: list[SnapFile | SnapDir]: files or directories )r� r� )rV �scandir)r# r� r� r) r) r* �listdir s zRestic.listdirc c s$ t |t�r|jn|}t|�}|�d�s.td��|�d�}|dkrDd}| �ddd||�}z|jt ddd�j � � }W n. t y� } zt |�|�W Y d }~n d }~0 0 t|�d k r�d S t| t�|�d ��d �}|�r t�|�d ��}t|| |d |d |d |d |d |�dd �|�dd �d� V q�d S )a@ Iterates over files/dirs found in a requested path in a Snapshot Args: snap (Snapshot | str): snapshot to list the contents of, supplied either by its Snapshot instance of snapshot ID path (str | PurePath): full path inside the snapshot to list the contents of Raises: ValueError: requested path was not a full path ResticError: Any error listing snapshot contents from restic Yields: Generator[SnapFile | SnapDir, None, None]: files or directories rr zpath must be a full path� �lsrx z--longT)rb rj rc Nr1 r rz r_ r] r� �uid�gid�mode� permissions) �snapshotr0 r_ r] r� r� r� r� r� )r� r r� r: � startswith� ValueError�rstripre rf r rb � splitlinesr r rU r� r� �popr �get) r# r� r� r� rq �linesr& r� r{ r) r) r* r� s< � �zRestic.scandir)rS rw )�userrS � serializerw rB c C s d S r r) �r# r� rS r� rw r) r) r* � get_backupsP s zRestic.get_backupsc C s d S r r) r� r) r) r* r� Z s )rS r� rw c s^ |du r dnd|� �� |r:|� � }� rV� fdd�|D �}n | j|du rJdn� g|d�}i }g }i }|�rzt|�� �} W n ttfy� Y qbY n0 t| t�r�|�| � qb| j |vr�i || j < | j || j vr�g || j | j < || j | j �| � t| t �rb| || j | j | j f< qb|D ]0} | j | j | j f} | |v �r| || j | j< �q|�rZ| �|� |S )aE Get backups for a backups 3.x Backup Manager client Args: user (str, optional): only list backups found for this user timeout (int | float | None): timeout for the underlying restic snapshots command serialize (bool): if True, return as a json-serializable dict. If False, return as Backup, SQLBackupGroup, and SQLBackupItem objects snapshots (list[Snapshot], optional): if provided, scan the backups found in this list rather than executing ``restic snapshots`` Returns: dict[str, dict[str, list]]: Top-level keys are usernames. Second-level are the type of backup. Values are a list of backups found which may be dicts or objects depending on the serialize arg Nzuser:c s g | ]}� |j v r|�qS r) )rv r| �r� r) r* r � r� z&Restic.get_backups.<locals>.<listcomp>ru )�copyrw r r� r� �KeyErrorr� r rt r� r] r �time�dbs�dbnamer� ) r# r� rS r� rw Z all_snaps�outZsqlsZsql_mapZbak�keyr) r� r* r� d sB � c C s: | D ]0}| | � � D ] \}}dd� |D �| | |< qqdS )zWConverts the return of get_backups(serialize=False) to a json-serializable dictc S s g | ] }|� � �qS r) )r� r| r) r) r* r � r� z$Restic.serialize.<locals>.<listcomp>N)�items)�backupsr� Zbak_type�objsr) r) r* r� � s zRestic.serialize)rJ r1 )T)NT)NT)N)N)N)6r^ � __module__� __qualname__�__doc__r: r r �int�float�cproc� ProcLimitr r= rA �property�dictrI �S3BucketrT �boolrY r` rZ r" r. r; rm r re rV ro r rw r r� r r� r� r� r� � staticmethodr� r� r r r� r r� r r r r� r r� r) r) r) r* r/ 8 s � � ( � �(� � - � � � & � � � � � � � �2 �� � �� � �� � ?r/ c @ sL e Zd ZdZed�dd�Zeed�dd�Zed�d d �Zeed�d d �Z d S )�S3Toolz�Wrapper object for moving items around in an S3 Bucket Args: s3_bucket (S3Bucket): service resource from ``Restic.s3_bucket()`` )rT c C s g | _ || _d S r )�movedr9 )r# rT r) r) r* r= � s zS3Tool.__init__)�src�destc C s | j �| j j|d�|�S )z Copy an item in the S3 bucket)rR �Key)r9 r� r_ �r# r� r� r) r) r* r� � s z S3Tool.copy)r� c C s | j j| j jdd|igid�S )z Delete an item in the S3 bucketZObjectsr� )rR �Delete)r9 Zdelete_objectsr_ )r# r� r) r) r* �delete� s �z S3Tool.deletec C s& | � ||� | �|� | j�|� dS )z Move an item in the S3 bucketN)r� r� r� rt r� r) r) r* �move� s z S3Tool.moveN) r^ r� r� r� r� r= r: r� r� r� r) r) r) r* r� � s r� )4r� �typingr r r r r �collections.abcr �pathlibr r� � urllib.parser r� r, � subprocessr r r[ rP Zbotocore.clientr rO Zbotocore.exceptionsr r Zboto3.resources.baser r� r� r{ r r r r r r r r r r r r r& r r r rs r. r/ r� r) r) r) r* �<module> s. 8 x
| ver. 1.1 | |
.
| PHP 8.3.30 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка