File: //opt/cppython/lib/python3.8/site-packages/s3transfer/__pycache__/copies.cpython-38.pyc
U
LD�g�8 � @ st d dl Z d dlZd dlmZmZmZmZ d dlmZm Z m
Z
m Z G dd� de�Z G dd� de�Z
G dd � d e�ZdS )
� N)�CompleteMultipartUploadTask�CreateMultipartUploadTask�SubmissionTask�Task)�ChunksizeAdjuster�calculate_range_parameter�
get_callbacks�get_filtered_dictc @ s� e Zd ZdZdddddddd d
d � Zd d
ddddddddd d
g Zd d
dddddddg Zdddd d
gZdd� Zdd� Z dd� Z
dd � Z d d � Z d d � Z
d!d"� Zd#S )$�CopySubmissionTaskz+Task for submitting tasks to execute a copyZIfMatchZIfModifiedSinceZ IfNoneMatchZIfUnmodifiedSinceZSSECustomerKeyZSSECustomerAlgorithmZSSECustomerKeyMD5� RequestPayer�ExpectedBucketOwner) �CopySourceIfMatch�CopySourceIfModifiedSince�CopySourceIfNoneMatch�CopySourceIfUnmodifiedSince�CopySourceSSECustomerKey� CopySourceSSECustomerAlgorithm�CopySourceSSECustomerKeyMD5r r r
r r r r r r ZMetadataDirectiveZTaggingDirectivec C s� |j jdkrn|j j}| �|j�}|j}|�� D ] \} }
| | jkr.|
|| j| < q.|jj f |�} |j �
| d � |j j|j k r�| � |||||� n| �
|||||� dS )a�
:param client: The client associated with the transfer manager
:type config: s3transfer.manager.TransferConfig
:param config: The transfer config associated with the transfer
manager
:type osutil: s3transfer.utils.OSUtil
:param osutil: The os utility associated to the transfer manager
:type request_executor: s3transfer.futures.BoundedExecutor
:param request_executor: The request executor associated with the
transfer manager
:type transfer_future: s3transfer.futures.TransferFuture
:param transfer_future: The transfer future associated with the
transfer request that tasks are being submitted for
NZ
ContentLength)�meta�size� call_args�)_get_head_object_request_from_copy_source� copy_source�
extra_args�items� EXTRA_ARGS_TO_HEAD_ARGS_MAPPINGZ
source_clientZ head_objectZprovide_transfer_sizeZmultipart_threshold�_submit_copy_request�_submit_multipart_request) �self�client�config�osutil�request_executor�transfer_futurer Zhead_object_requestr �param�value�response� r' �>/opt/cppython/lib/python3.8/site-packages/s3transfer/copies.py�_submitP sD ��
���� � �zCopySubmissionTask._submitc
C sL |j j}t|d�}| j�|t| j||j|j|j|j ||j j
d�dd�� d S )N�progress)r r �bucket�keyr � callbacksr T)�transfer_coordinator� main_kwargs�is_final) r r r �_transfer_coordinator�submit�CopyObjectTaskr r+ r, r r )r r r r! r" r# r �progress_callbacksr' r' r( r � s"
� ��z'CopySubmissionTask._submit_copy_requestc C sx |j j}i }|j�� D ]\}} || jkr| ||< q| j�|t| j||j|j |d�d��}
|j
} t � } | � | |j j
�} tt�|j j
t| � ��}
g }t|d�}td|
d �D ]�}| �|j�}t| |d |
|j j
�|d< | �| |d |
|j j
�}|j�d�}|�| j�|t| j||j|j|j |||||d� d|
id ��� q�| �|j�}| j�|t | j||j|j |d�|
|d
�d d �� d S )
N)r r+ r, r )r. r/ r* � ZCopySourceRangeZChecksumAlgorithm) r r r+ r, � part_numberr r- r �checksum_algorithm� upload_id)r. r/ �pending_main_kwargs)r8 �partsT)r. r/ r9 r0 ) r r r r � CREATE_MULTIPART_ARGS_BLACKLISTr1 r2 r r+ r, Zmultipart_chunksizer Zadjust_chunksizer �int�math�ceil�floatr �range�_extra_upload_part_argsr �_get_transfer_size�get�append� CopyPartTaskr � _extra_complete_multipart_argsr )r r r r! r" r# r Zcreate_multipart_extra_argsr$ �valZcreate_multipart_future� part_sizeZadjuster� num_partsZ part_futuresr4 r6 Zextra_part_argsr r7 Z complete_multipart_extra_argsr' r' r( r � s�
��� ��
��� � ���������z,CopySubmissionTask._submit_multipart_requestc C s2 t |t�rt�|�S td|� dt|�� d���d S )NzLExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got z or type �.)�
isinstance�dict�copy� TypeError�type)r r r' r' r( r s
�z<CopySubmissionTask._get_head_object_request_from_copy_sourcec C s t || j�S �N)r �UPLOAD_PART_COPY_ARGS�r r r' r' r( rA s z*CopySubmissionTask._extra_upload_part_argsc C s t || j�S rP )r �COMPLETE_MULTIPART_ARGSrR r' r' r( rF # s z1CopySubmissionTask._extra_complete_multipart_argsc C s ||d kr||| S |S )Nr5 r' )r rH Z
part_indexrI Ztotal_transfer_sizer' r' r( rB & s z%CopySubmissionTask._get_transfer_sizeN)�__name__�
__module__� __qualname__�__doc__r rQ r; rS r) r r r rA rF rB r' r' r' r( r
s^ �
��
�>l
r
c @ s e Zd ZdZdd� ZdS )r3 z Task to do a nonmultipart copyc C s0 |j f |||d�|�� |D ]}||d� q dS )a�
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to copy to
:param key: The name of the key to copy to
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy
:param size: The size of the transfer. This value is passed into
the callbacks
)�
CopySource�Bucket�Key�Zbytes_transferredN)Z copy_object) r r r r+ r, r r- r �callbackr' r' r( �_main3 s ��zCopyObjectTask._mainN�rT rU rV rW r] r' r' r' r( r3 0 s r3 c @ s e Zd ZdZddd�ZdS )rE z)Task to upload a part in a multipart copyNc C sx |j f |||||d�|��} |D ]} | | d� q | d d }
|
|d�}|
rtd|
�� � �}|| d krt| d | ||< |S )a<
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to upload to
:param key: The name of the key to upload to
:param upload_id: The id of the upload
:param part_number: The number representing the part of the multipart
upload
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy part
:param size: The size of the transfer. This value is passed into
the callbacks
:param checksum_algorithm: The algorithm that was used to create the multipart
upload
:rtype: dict
:returns: A dictionary representing a part::
{'Etag': etag_value, 'PartNumber': part_number}
This value can be appended to a list to be used to complete
the multipart upload. If a checksum is in the response,
it will also be included.
)rX rY rZ ZUploadId�
PartNumberr[ ZCopyPartResult�ETag)r` r_ ZChecksum)Zupload_part_copy�upper)r r r r+ r, r8 r6 r r- r r7 r& r\ �etagZ
part_metadataZchecksum_memberr' r' r( r] L s( &��
�zCopyPartTask._main)Nr^ r' r' r' r( rE I s
�rE )rM r= Zs3transfer.tasksr r r r Zs3transfer.utilsr r r r r
r3 rE r' r' r' r( �<module>
s