File: //opt/cppython/lib/python3.8/site-packages/botocore/__pycache__/httpchecksum.cpython-38.pyc
U
KD�g�H � @ s d Z ddlZddlZddlZddlmZ ddlmZmZ ddl m
Z
m Z m Z ddl
mZmZmZ ddlmZ ddlmZ dd lmZmZmZ e
r�dd
lmZ ndZe� e �Z d Z G d d
� d
�Z G dd� de �Z!G dd� de �Z"G dd� de �Z#G dd� de �Z$G dd� de �Z%G dd� de �Z&G dd� d�Z'G d d � d e�Z(d d � Z)d<d d!�Z*d"d#� Z+d$d%� Z,d&d'� Z-d(d)� Z.d=d*d+�Z/d,d-� Z0d.d/� Z1d0d1� Z2e!e%e&d2�Z3d3d4d5gZ4e
�r�e"e#d6�Z5e d7��r�e$e5d5< e3�6e5� e7d8d9� e5�8� D ���s�t9�e:e3�8� �Z;d5d4d3d:d;gZ<dS )>aB The interfaces in this module are not intended for public use.
This module defines interfaces for applying checksums to HTTP requests within
the context of botocore. This involves both resolving the checksum to be used
based on client configuration and environment, as well as application of the
checksum to the request.
� N)�crc32)�sha1�sha256)�HAS_CRT�has_minimum_crt_version�urlparse)�AwsChunkedWrapperError�FlexibleChecksumError�MissingDependencyException)�StructureShape)�
StreamingBody)�conditionally_calculate_md5�determine_content_length�has_checksum_header)� checksumsZCRC32c @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd S )
� BaseChecksum� c C s d S �N� ��self�chunkr r �B/opt/cppython/lib/python3.8/site-packages/botocore/httpchecksum.py�update7 s zBaseChecksum.updatec C s d S r r �r r r r �digest: s zBaseChecksum.digestc C s | � � }t�|��d�S )N�ascii)r �base64� b64encode�decode)r �bsr r r � b64digest= s zBaseChecksum.b64digestc s: � � � }t� �fdd�d�D ]}��|� q � �|� d S )Nc s � � �j�S r )�read� _CHUNK_SIZEr ��fileobjr r r �<lambda>C � z.BaseChecksum._handle_fileobj.<locals>.<lambda>r' )�tell�iterr �seek)r r% Zstart_positionr r r$ r �_handle_fileobjA s z BaseChecksum._handle_fileobjc C s, t |ttf�r| �|� n
| �|� | �� S r )�
isinstance�bytes� bytearrayr r+ r! )r �bodyr r r �handleG s
zBaseChecksum.handleN) �__name__�
__module__� __qualname__r# r r r! r+ r0 r r r r r 4 s r c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�
Crc32Checksumc C s
d| _ d S �Nr ��
_int_crc32r r r r �__init__P s zCrc32Checksum.__init__c C s t || j�d@ | _d S �Nl �� )r r7 r r r r r S s zCrc32Checksum.updatec C s | j jddd�S �N� �big�� byteorder�r7 �to_bytesr r r r r V s zCrc32Checksum.digestN�r1 r2 r3 r8 r r r r r r r4 O s r4 c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�CrtCrc32Checksumc C s
d| _ d S r5 r6 r r r r r8 \ s zCrtCrc32Checksum.__init__c C s t �|| j�}|d@ | _d S r9 )�
crt_checksumsr r7 �r r Z new_checksumr r r r _ s zCrtCrc32Checksum.updatec C s | j jddd�S r: r? r r r r r c s zCrtCrc32Checksum.digestNrA r r r r rB Z s rB c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�CrtCrc32cChecksumc C s
d| _ d S r5 )� _int_crc32cr r r r r8 i s zCrtCrc32cChecksum.__init__c C s t �|| j�}|d@ | _d S r9 )rC �crc32crF rD r r r r l s zCrtCrc32cChecksum.updatec C s | j jddd�S r: )rF r@ r r r r r p s zCrtCrc32cChecksum.digestNrA r r r r rE g s rE c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�CrtCrc64NvmeChecksumc C s
d| _ d S r5 )�_int_crc64nvmer r r r r8 v s z CrtCrc64NvmeChecksum.__init__c C s t �|| j�}|d@ | _d S )Nl ���� )rC � crc64nvmerI rD r r r r y s zCrtCrc64NvmeChecksum.updatec C s | j jddd�S )N� r< r= )rI r@ r r r r r } s zCrtCrc64NvmeChecksum.digestNrA r r r r rH t s rH c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )� Sha1Checksumc C s t � | _d S r )r � _checksumr r r r r8 � s zSha1Checksum.__init__c C s | j �|� d S r �rM r r r r r r � s zSha1Checksum.updatec C s
| j �� S r �rM r r r r r r � s zSha1Checksum.digestNrA r r r r rL � s rL c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�Sha256Checksumc C s t � | _d S r )r rM r r r r r8 � s zSha256Checksum.__init__c C s | j �|� d S r rN r r r r r � s zSha256Checksum.updatec C s
| j �� S r rO r r r r r � s zSha256Checksum.digestNrA r r r r rP � s rP c @ sF e Zd ZdZddd�Zdd� Zdd d
�Zdd d �Zd
d� Zdd� Z dS )�AwsChunkedWrapperr N�x-amz-checksumc C s2 || _ || _|| _| �� |d kr(| j}|| _d S r )�_raw�_checksum_name�
_checksum_cls�_reset�_DEFAULT_CHUNK_SIZE� _chunk_size)r �raw� checksum_cls�
checksum_name�
chunk_sizer r r r8 � s zAwsChunkedWrapper.__init__c C s& d| _ d| _d | _| jr"| �� | _d S )Nr' F)�
_remaining� _completerM rU r r r r rV � s
zAwsChunkedWrapper._resetr c C s2 |dks|dkrt dd��| �� | j�d� d S )Nr z Can only seek to start of stream�� error_msg)r rV rS r* )r �offset�whencer r r r* � s �zAwsChunkedWrapper.seekc C s� |d k r|dkrd }| j r$| js$dS |d kp8|t| j�k}| j sn|rn| j| �� 7 _|d kpj|t| j�k}q:|d kr�t| j�}| jd |� }| j|d � | _|S )Nr r' )r^ r] �len� _make_chunk)r �sizeZwant_more_bytesZ to_returnr r r r" � s
zAwsChunkedWrapper.readc C s� | j �| j�}tt|��dd � �d�}| | _| jrB| j�|� | jrv| jrv| j �d�}| j�
� �d�}d||f S d||f S )N� r s 0
%s:%s
s %s
%s
) rS r" rX �hexrc �encoder^ rM r rT r! )r Z raw_chunk�hex_len�name�checksumr r r rd � s z AwsChunkedWrapper._make_chunkc c s | j s| �� V q d S r )r^ rd r r r r �__iter__� s zAwsChunkedWrapper.__iter__)NrR N)r )N)
r1 r2 r3 rW r8 rV r* r" rd rl r r r r rQ � s �
rQ c s2 e Zd Z� fdd�Zd� fdd� Zdd� Z� ZS ) �StreamingChecksumBodyc s t � �||� || _|| _d S r )�superr8 rM � _expected)r Z
raw_stream�content_lengthrk �expected�� __class__r r r8 � s z StreamingChecksumBody.__init__Nc s: t � j|d�}| j�|� |d ks.|s6|dkr6| �� |S )N)�amtr )rn r" rM r �_validate_checksum)r rt r rr r r r" � s
zStreamingChecksumBody.readc C s< | j �� t�| j�kr8d| j� d| j �� � �}t|d��d S )N�Expected checksum �$ did not match calculated checksum: r_ )rM r r � b64decodero r! r )r r` r r r ru � s �z(StreamingChecksumBody._validate_checksum)N)r1 r2 r3 r8 r" ru �
__classcell__r r rr r rm � s rm c C s t | ||� t| ||� d S r )�"resolve_request_checksum_algorithm�$resolve_response_checksum_algorithms)�request�operation_model�paramsr r r �resolve_checksum_context� s r c
C s^ t | �r d S | d �di �}| d d j}|j}|jp>|�d�}|�d�}|r�||kr�|d krbt}|| �� } | |kr�ts�| tkr�t d| �
� � d�d��t d | � �d
��nR|s�|r�|d kr�| d �d �r�d S t �� } t
|| |�}
|
d k r�|
t d
�|d< nd S d} |j�r4t| d �jdk�r4| d d jdk�r4d} | | d| � �d�} | |d< || d d< d S )N�contextrk Z
client_configZrequestChecksumRequiredZrequestAlgorithmMemberzUsing za requires an additional dependency. You will need to pip install botocore[crt] before proceeding.)�msgz Unsupported checksum algorithm: r_ Zwhen_supportedZis_presign_request)rj �value�request_algorithm_header�header�url�httpsZs3�trailer�x-amz-checksum-)� algorithm�inrj �request_algorithm)r �get� request_checksum_calculation�
http_checksumZhttp_checksum_required� _SUPPORTED_CHECKSUM_ALGORITHMS�lowerr �_CRT_CHECKSUM_ALGORITHMSr
�upperr �DEFAULT_CHECKSUM_ALGORITHM�$_get_request_algorithm_member_headerZhas_streaming_inputr �schemeZsignature_version)
r| r} r~ �supported_algorithms�checksum_contextr� r� Zrequest_checksum_required�algorithm_memberZalgorithm_nameZalgorithm_member_headerZ
location_typer� r r r rz sl ��
���� �� ���rz c C s4 | j }t|t�sdS |j�|�}|r0|j�d�S dS )zDGet the name of the header targeted by the "requestAlgorithmMember".Nrj )Z input_shaper, r �membersr� Z
serialization)r} r| r� Zoperation_input_shapeZalgorithm_member_shaper r r r� R s
�r� c C s� | � di �� di �}|� d�}|s&d S |dkr8t| � n@|d dkrNt| � n*|d dkrdt| � ntd�|d �d ��d
|kr�|d
}|d | d |d
< d S )Nr� rk r� zconditional-md5r� r� r� z Unknown checksum variant: {}r_ r� r� �headersrj )r� r
� _apply_request_header_checksum� _apply_request_trailer_checksumr �format)r| r� r� r� r r r �apply_request_checksumb s"
��r� c C sd | � di �� di �}|� d�}|d }|| d kr6d S t� |d �}|� �| d �}|| d |< d S )Nr� rk r� rj r� r� r/ )r� �
_CHECKSUM_CLSr0 )r| r� r� �
location_namerZ r r r r r� { s
r� c C s� | � di �� di �}|� d�}|d }t� |d �}| d }| d }||krPd S d|d < d
|krr|d
d 7 < nd |d
< ||d
< t|�}|d k r�t|�|d< d|kr�|d= t�d� t|ttf�r�t �
|�}t |||d�| d< d S )Nr� rk r� rj r� r� r/ �chunkedzTransfer-EncodingzContent-Encodingz ,aws-chunkedz aws-chunkedz
X-Amz-Trailerz X-Amz-Decoded-Content-LengthzContent-LengthzVRemoving the Content-Length header since 'chunked' is specified for Transfer-Encoding.)rZ r[ ) r� r� r �str�logger�debugr, r- r. �io�BytesIOrQ )r| r� r� r� rZ r� r/ rp r r r r� � s8
�
�r� c
C s� |j }|�d�}|r�||kr�|d kr(t}dd� |�dg �D �}g }tD ] }||krTqF||krF|�|� qF| d �di �} || d< | | d d< d S )NZrequestValidationModeMemberc S s h | ] }|� � �qS r )r� )�.0�ar r r � <setcomp>� s z7resolve_response_checksum_algorithms.<locals>.<setcomp>ZresponseAlgorithmsr� rk �response_algorithms)r� r� r� �_ALGORITHMS_PRIORITY_LIST�append)
r| r} r~ r� r� Z mode_memberr� Zusable_algorithmsr� r� r r r r{ � s"
� r{ c C s� |d }|� di �}|� d�}|s&d S |D ]v}d|� �}||krBq*d|| krPq*|jrht| ||�|d< nt| ||�|d< |d � di �}||d< ||d d< d S t�d |� d
�� d S ) Nr� rk r� r� �-r/ r� Zresponse_algorithmzXSkipping checksum validation. Response did not contain one of the following algorithms: �.)r� Zhas_streaming_output�_handle_streaming_response�_handle_bytes_responser� r� ) �
http_response�responser� r} r� r� Z
algorithmsr� � header_namer r r �handle_checksum_body� s:
�
�
�r� c C s8 t �|�}d|� �}t| j|d �d�|� |d | �S )Nr� r� zcontent-length)r� r� rm rY )r� r� r� rZ r� r r r r� � s
�r� c C sj | j }d|� �}t�|�}|� }|�|� |d | }|�� t�|�krfd|� d|�� � �}t|d��|S )Nr� r� rv rw r_ ) �contentr� r� r r r rx r! r ) r� r� r� r/ r� rZ rk rq r` r r r r� � s
�
r� )r r r r rG rJ )r rG )r � r; c c s | ]}|t kV qd S r )r� )r� rj r r r � <genexpr>" s r� r r )N)N)=�__doc__r r� �logging�binasciir �hashlibr r Zbotocore.compatr r r Zbotocore.exceptionsr r r
Zbotocore.modelr Zbotocore.responser Zbotocore.utilsr
r r Zawscrtr rC � getLoggerr1 r� r� r r4 rB rE rH rL rP rQ rm r rz r� r� r� r� r{ r� r� r� r� r� Z_CRT_CHECKSUM_CLSr �all�keys�AssertionError�listr� r� r r r r �<module> sj
R �
N - �
) �
�
�