File: //opt/cppython/lib/python3.8/site-packages/botocore/__pycache__/utils.cpython-38.pyc
U
KD�g? � D @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlZd dlmZ d dlmZ d dlmZ d dlmZmZ d dlZd dlmZ d dl m Z d dl Z d dl Z d dl Z d dl!m"Z" d d l!m#Z# d d
l!m$Z$ d d l!m%Z% d d l!m&Z& d d
l!m'Z' d dl!m(Z( d dl!m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6 d dl7m8Z8m9Z9m:Z:m;Z;m<Z<m=Z=m>Z>m?Z?m@Z@mAZAmBZBmCZCmDZDmEZEmFZFmGZGmHZHmIZImJZJmKZKmLZLmMZMmNZN e�OeP�ZQdZRdZSdZTdZUdZVe �Wd�ZXeGe<e:e;fZYdgZZddddd d d d d d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4d2d5d6d7d8d9d9d&d'd:d;d<d=d>d?d7d@dAdAdBd<dCdDdEdFdGdHd=dIdJdKdLdMdNdNdOd/dFdP�CZ[e jWdQe j\dR�Z]dSdT� Z^dUdV� Z_dWdX� Z`dYdZ� Zad[d\� Zbd]d^� Zcd_d`� Zddadb� Zedcdd� Zf�ddfdg�Zgdhdi� ZhG djdk� dkei�ZjG dldm� dmei�ZkG dndo� do�ZlG dpdq� dqel�ZmG drds� ds�ZnG dtdu� duel�Zo�ddwdx�Zpdydz� Zqerfd{d|�Zsd}d~� ZteVfdd��ZueVfd�d��Zvd�d�� Zwd�d�� Zxd�d�� Zyd�d�� Zz�dd�d��Z{�d d�d��Z|d�d�� Z}d�d�� Z~G d�d�� d��ZG d�d�� d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z��d
d�d��Z��d d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z��d d�d��Z��d
d�d��Z�d�d�� Z�d�d�� Z�G d�d�� d��Z�G d�d�� d�e��Z�G d�d�� d��Z�G d�d�� d��Z�G d�d dZ�G d�dĄ d�e��Z�G d�dƄ dƃZ�G d�dȄ dȃZ�G d�dʄ dʃZ�G d�d̄ d̃Z�G d�d΄ dZ�G d�dЄ d�e��Z�G d�d҄ d҃Z�d�dԄ Z�d�dք Z�d�d Z��dd�dۄZ�d�d݄ Z�d�d߄ Z�d�d� Z�d�d� Z�d�d� Z�d�d� Z�d�d� Z�d�d� Z�G d�d� d�Z�G d�d� d�Z�G d�d� d�Z�d�d� Z�G d�d�� d��Z�d�d�� Z�d�dIiZ�dd d�d d d d!d"d#d$d%d)d+d*d,d-d.d�d/d0d4d2d5d8d9d�d&d'd�d�d�d:d�d;d<�d d=�dd>d?d@d7dAdB�ddFdGdH�ddJdKdLdM�ddNdO�d�8Z�dS ( � N)�datetime)�
ip_address)�Path)�
getproxies� proxy_bypass)�tzutc)�LocationParseError)�HEX_PAT)�IPV4_PAT)�IPV6_ADDRZ_PAT)�IPV6_PAT)�LS32_PAT)�UNRESERVED_PAT)� ZONE_ID_PAT)�HAS_CRT�IPV4_RE�
IPV6_ADDRZ_RE�
MD5_AVAILABLE�UNSAFE_URL_CHARS� OrderedDict�get_md5�get_tzinfo_options�json�quote�urlparse�urlsplit�
urlunsplit� zip_longest)� ClientError�ConfigNotFound�ConnectionClosedError�ConnectTimeoutError�EndpointConnectionError�HTTPClientError�InvalidDNSNameError�!InvalidEndpointConfigurationError�InvalidExpressionError�InvalidHostLabelError�InvalidIMDSEndpointError� InvalidIMDSEndpointModeError�InvalidRegionError�MetadataRetrievalError�MissingDependencyException�ReadTimeoutError�SSOTokenLoadError� UnsupportedOutpostResourceError�*UnsupportedS3AccesspointConfigurationError�UnsupportedS3ArnError� UnsupportedS3ConfigurationError� UnsupportedS3ControlArnError�&UnsupportedS3ControlConfigurationError� zhttp://169.254.169.254/zhttp://[fd00:ec2::254]/)�ipv4�ipv6z-._~z[a-z0-9][a-z0-9\-]*[a-z0-9]� dualstackZ mediatailorZpricingZ sagemakerz api-gatewayzapplication-auto-scalingZ appstreamz auto-scalingzauto-scaling-plansz
cost-explorerz cloudhsm-v2zcloudsearch-domainzcognito-identity-providerzconfig-servicez cost-and-usage-report-serviceziot-data-planeziot-jobs-data-planezmediastore-dataz
data-pipelinez device-farmzdirect-connectz application-discovery-servicezdatabase-migration-servicezdirectory-servicezdynamodb-streamszelastic-beanstalkZefszelastic-load-balancingZemrzelastic-transcoderzelastic-load-balancing-v2Zsesz marketplace-entitlement-servicezelasticsearch-serviceZ eventbridgezkinesis-analyticsz
kinesis-videozlex-model-building-servicezlex-runtime-servicezcloudwatch-logszmachine-learningz marketplace-commerce-analyticszmarketplace-meteringz
migration-hubZ
cloudwatchZmturkZ
opsworkscmzresource-groups-tagging-apizroute-53zroute-53-domainszsagemaker-runtimeZsimpledbzsecrets-managerZ serverlessapplicationrepositoryzservice-catalog�sfnzstorage-gateway)Czapi.mediatailorz api.pricingz
api.sagemaker�
apigateway�application-autoscalingZ
appstream2� autoscaling�autoscaling-plans�ce�
cloudhsmv2�cloudsearchdomain� cognito-idp�config�curzdata.iotz
data.jobs.iotzdata.mediastore� datapipeline�
devicefarm�
directconnect� discovery�dms�ds�dynamodbstreams�elasticbeanstalkZelasticfilesystemZelasticloadbalancingZelasticmapreduce�elastictranscoder�elb�elbv2�emailzentitlement.marketplace�es�eventszcloudwatch-events�iot-data�
iot-jobs-data�kinesisanalytics� kinesisvideo�
lex-models� lex-runtime�logs�machinelearning�marketplace-entitlement� marketplacecommerceanalyticszmetering.marketplace�meteringmarketplace�mghz
models.lexZ
monitoringzmturk-requesterz opsworks-cm�resourcegroupstaggingapi�route53�route53domainsz runtime.lex�runtime.sagemaker�sdb�secretsmanager�serverlessrepo�servicecatalogZstates�
stepfunctions�storagegatewayzstreams.dynamodbZtaggingz ^X-Amz-Checksum-([a-z0-9]*)$)�flagsc C s, t | t�r| S t | t�r$| �� dkS dS dS )z~Ensures a boolean value if a string or boolean is provided
For strings, the value for True/False is case insensitive
�trueFN)�
isinstance�bool�str�lower��val� rp �;/opt/cppython/lib/python3.8/site-packages/botocore/utils.py�ensure_boolean� s
rr c C sL | � d�}|dk r:|�� }|tkr6|td�}tf |��|S | � d�rHdS dS )z�Resolving IMDS endpoint mode to either IPv6 or IPv4.
ec2_metadata_service_endpoint_mode takes precedence over imds_use_ipv6.
�"ec2_metadata_service_endpoint_modeN)�modeZ valid_modesZ
imds_use_ipv6r7 r6 )�get_config_variablerm �METADATA_ENDPOINT_MODESr) )�sessionZ
endpoint_modeZlendpoint_modeZerror_msg_kwargsrp rp rq �resolve_imds_endpoint_mode� s ��
rx c C s2 t | d�o0| j�dd�o0| j�d�dko0| jdkS )z�Determines if the provided shape is the special header type jsonvalue.
:type shape: botocore.shape
:param shape: Shape to be inspected for the jsonvalue trait.
:return: True if this type is a jsonvalue, False otherwise
:rtype: Bool
�
serializationZ jsonvalueF�location�header�string)�hasattrry �get� type_name)�shaperp rp rq �is_json_value_header� s
���r� c C s@ | dkr dS t |tjj�r"| |kS | �� dd� |�� D �kS dS )z&Case-insensitive check for header key.NFc S s g | ] }|� � �qS rp �rm )�.0�keyrp rp rq �
<listcomp>� s z has_header.<locals>.<listcomp>)rj �botocore�
awsrequestZ HeadersDictrm �keys)� header_name�headersrp rp rq �
has_header� s
r� c C sD | j �d| j �d| j��}|�dd�}|�dd�}t�dd|�}|S )zvReturns the module name for a service
This is the value used in both the documentation and client class name
ZserviceAbbreviationZserviceFullNameZAmazon� ZAWSz\W+)�metadatar~ � service_name�replace�re�sub)Z
service_model�namerp rp rq �get_service_module_name� s �� r� c C s | sdS t | �S )N�/)�remove_dot_segments��pathrp rp rq �normalize_url_path s r� c C s | dkr | S t | �S dS )zLReturns None if val is None, otherwise ensure value
converted to booleanN)rr rn rp rp rq �normalize_boolean s r� c C s� | sdS | � d�}g }|D ]0}|r|dkr|dkr@|rJ|�� q|�|� q| d dkr^d}nd}| d dkrx|rxd}nd}|d�|� | S )Nr� r� �.z..r ���)�split�pop�append�join)�urlZ input_urlZ output_list�x�first�lastrp rp rq r� s"
r� c C s6 | r | dkrt | d��dD ]}|| krt | d��qd S )Nr� ��
expression)�[�]�*)r& )r� �invalidrp rp rq �validate_jmespath_for_set6 s
r� Tc C s| |r t |� |�dd�}|d t|�dkr2|d nd }}|sHt|d��|rp|| kr\i | |< t| | ||dd�S || |< d S )Nr� r5 r r� r� F)�is_first)r� r� �lenr& �set_value_from_jmespath)�sourcer� �valuer� �bits� current_key� remainderrp rp rq r� A s "
�r� c C s | � di �}|� d�dk}|S )z9Determine if request is intended for an MRAP accesspoint.�s3_accesspoint�regionr� �r~ )�contextr� � is_globalrp rp rq �is_global_accesspoint_ s r� c @ s e Zd ZdZdS )�_RetriesExceededErrorz@Internal exception used when the number of retries are exceeded.N)�__name__�
__module__� __qualname__�__doc__rp rp rp rq r� f s r� c @ s e Zd Zdd� ZdS )�BadIMDSRequestErrorc C s
|| _ d S �N��request��selfr� rp rp rq �__init__m s z BadIMDSRequestError.__init__N)r� r� r� r� rp rp rp rq r� l s r� c @ s� e Zd ZeZdZdZededddfdd�Z dd� Z
d d
� Z d d � Z d
d� Z
d dd�Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd!d d �ZdS )"� IMDSFetcherzlatest/api/tokenZ21600r5 Nc C s� || _ || _|d kri }| �||�| _|| _|d kr>tj�� }|�dd�� � dk| _
|�d�| _ || _ t
jj| j t| j�d�| _d S )NZAWS_EC2_METADATA_DISABLED�falseri �ec2_metadata_v1_disabled)�timeout�proxies)�_timeout�
_num_attempts�_select_base_url� _base_url�_config�os�environ�copyr~ rm � _disabled�_imds_v1_disabled� _user_agentr� � httpsession�URLLib3Session�get_environ_proxies�_session)r� r� � num_attempts�base_url�env�
user_agentrB rp rp rq r� v s
� �zIMDSFetcher.__init__c C s | j S r� )r� �r� rp rp rq � get_base_url� s zIMDSFetcher.get_base_urlc C s� |d kr i }|� d�dk}|� d�}|r6|r6t�d� d }|tkrH|}n|rR|}n|r\t}nt}t�d|� �� t|�s�t|d��|S )Nrs r7 � ec2_metadata_service_endpointzFCustom endpoint and IMDS_USE_IPV6 are both set. Using custom endpoint.zIMDS ENDPOINT: )�endpoint)r~ �logger�warning�METADATA_BASE_URL�METADATA_BASE_URL_IPv6�debug� is_valid_urir( )r� r� rB Z
requires_ipv6Zcustom_metadata_endpointZchosen_base_urlrp rp rq r� � s* �
�
z IMDSFetcher._select_base_urlc C s, d}| j r| j �d�sd}| j � |� |� �S )Nr� r� )r� �endswith)r� r� �seprp rp rq �_construct_url� s zIMDSFetcher._construct_urlc C s. | � � | �| j�}d| ji}| �|� tjjd||d�}t| j �D ]�}zN| j
� |� � �}|j
dkrp|jW S |j
dkr�W d S |j
dkr�t|��W qD tk
r� Y d S tk
r� } ztjd||dd � W 5 d }~X Y qD tk
�r& } z(t|j�d
�t��rt||d ��n� W 5 d }~X Y qDX qDd S ) Nz$x-aws-ec2-metadata-token-ttl-seconds�PUT��methodr� r� �� )i� i� i� )i� �OCaught retryable HTTP exception while making metadata service request to %s: %sT��exc_info�error)r� r� )�_assert_enabledr� � _TOKEN_PATH�
_TOKEN_TTL�_add_user_agentr� r� �
AWSRequest�ranger� r� �send�prepare� status_code�textr� r- �RETRYABLE_HTTP_ERRORSr� r� r# rj �kwargsr~ r r( )r� r� r� r� �i�response�erp rp rq �_fetch_metadata_token� sD �
�
�z!IMDSFetcher._fetch_metadata_tokenc
C s� | � � |s| �� |dkr"| j}| �|�}i }|dk r@||d< | �|� t| j�D ]r}z8tjj d||d�}| j
� |� � �}||�s�|W S W qT t
k
r� } ztjd|| dd� W 5 d} ~ X Y qTX qT| �� �dS )aZ Make a get request to the Instance Metadata Service.
:type url_path: str
:param url_path: The path component of the URL to make a get request.
This arg is appended to the base_url that was provided in the
initializer.
:type retry_func: callable
:param retry_func: A function that takes the response as an argument
and determines if it needs to retry. By default empty and non
200 OK responses are retried.
:type token: str
:param token: Metadata token to send along with GET requests to IMDS.
Nzx-aws-ec2-metadata-token�GETr� r� Tr� )r� �_assert_v1_enabled�_default_retryr� r� r� r� r� r� r� r� r� r� r� r� r� �_RETRIES_EXCEEDED_ERROR_CLS)
r� �url_path�
retry_func�tokenr� r� r� r� r� r rp rp rq � _get_request� s8
��zIMDSFetcher._get_requestc C s | j d k r| j |d< d S )Nz
User-Agent)r� )r� r� rp rp rq r�
s
zIMDSFetcher._add_user_agentc C s | j rt�d� | �� �d S )Nz)Access to EC2 metadata has been disabled.)r� r� r� r r� rp rp rq r� s
zIMDSFetcher._assert_enabledc C s | j rtdd��d S )NzLUnable to retrieve token for use in IMDSv2 call and IMDSv1 has been disabled�� error_msg)r� r+ r� rp rp rq r s �z IMDSFetcher._assert_v1_enabledc C s | � |�p| �|�S r� ��_is_non_ok_response� _is_empty�r� r� rp rp rq r s zIMDSFetcher._default_retryc C s" |j dkr | j|ddd� dS dS )Nr� znon-200T��log_bodyF)r� �_log_imds_responser rp rp rq r
s
z IMDSFetcher._is_non_ok_responsec C s |j s| j|ddd� dS dS )Nzno bodyTr F)�contentr r rp rp rq r " s zIMDSFetcher._is_emptyFc C s> d}||j |jg}|r*|d7 }|�|j� tj|f|�� d S )NzHMetadata service returned %s response with status code of %s for url: %sz, content body: %s)r� r� r� r r� r� )r� r� Z
reason_to_logr Z statementZ logger_argsrp rp rq r ( s � z IMDSFetcher._log_imds_response)N)F)r� r� r� r� r r� r� � DEFAULT_METADATA_SERVICE_TIMEOUTr� r� r� r� r� r r r� r� r r r
r r rp rp rp rq r� q s, �
$
,r� c @ s` e Zd ZdZddddgZdd� Zdd d
�Zdd d �Zd
d� Zdd� Z dd� Z
dd� Z dd� Z dS )�InstanceMetadataFetcherz*latest/meta-data/iam/security-credentials/� AccessKeyId�SecretAccessKey�Token�
Expirationc
C s� z~| � � }| �|�}| �||�}| �|�rZ||d |d |d |d d�}| �|� |W S d|krvd|krvt�d|� i W S W nR | jk
r� t�d | j� Y n0 t k
r� } zt�d
|j
� W 5 d }~X Y nX i S ) Nr r r r )� role_name�
access_key�
secret_keyr � expiry_time�Code�Messagez7Error response received when retrievingcredentials: %s.�\Max number of attempts exceeded (%s) when attempting to retrieve data from metadata service.zBad IMDS request: %s) r �
_get_iam_role�_get_credentials� _contains_all_credential_fields�_evaluate_expirationr� r� r r� r� r� )r� r r � credentialsr rp rp rq � retrieve_iam_role_credentials= s6
�
�
� z5InstanceMetadataFetcher.retrieve_iam_role_credentialsNc C s | j | j| j|d�jS �N�r r r )r � _URL_PATH�_needs_retry_for_role_namer� )r� r rp rp rq r! f s
�z%InstanceMetadataFetcher._get_iam_rolec C s$ | j | j| | j|d�}t�|j�S r' )r r) � _needs_retry_for_credentialsr �loadsr� )r� r r �rrp rp rq r" m s �z(InstanceMetadataFetcher._get_credentialsc C s: zt �|j� W dS tk
r4 | �|d� Y dS X d S )NFz invalid jsonT)r r, r� �
ValueErrorr r rp rp rq �_is_invalid_jsonu s z(InstanceMetadataFetcher._is_invalid_jsonc C s | � |�p| �|�S r� r r rp rp rq r* } s z2InstanceMetadataFetcher._needs_retry_for_role_namec C s | � |�p | �|�p | �|�S r� )r
r r/ r rp rp rq r+ � s
��z4InstanceMetadataFetcher._needs_retry_for_credentialsc C s* | j D ] }||krt�d|� dS qdS )Nz3Retrieved credentials is missing required field: %sFT)�_REQUIRED_CREDENTIAL_FIELDSr� r� )r� r% �fieldrp rp rq r# � s
�z7InstanceMetadataFetcher._contains_all_credential_fieldsc
C s� |� d�}|d krd S z�tj�|d�}| j� dd�}t�dd�}|| }tj�� }tj|d�}|| }||kr�|| } | �d�|d< t �
d|d d �d
�� W n( t k
r� t � d |d � �� Y nX d S ) Nr z%Y-%m-%dT%H:%M:%SZZ ec2_credential_refresh_windowiX �x ��secondsz�Attempting credential expiration extension due to a credential service availability issue. A refresh of these credentials will be attempted again within the next �< z.0fz minutes.z Unable to parse expiry_time in )
r~ r �strptimer� �random�randint�utcnow� timedelta�strftimer� �infor. r� )
r� r% �
expirationZrefresh_intervalZjitterZ refresh_interval_with_jitter� current_timeZrefresh_offsetZextension_timeZnew_timerp rp rq r$ � s>
� �
��� �z,InstanceMetadataFetcher._evaluate_expiration)N)N)
r� r� r� r) r0 r& r! r" r/ r* r+ r# r$ rp rp rp rq r 4 s �)
r c @ s6 e Zd Zd dd�Zdd� Zdd� Zdd � Zd
d � ZdS )
�IMDSRegionProviderNc C s$ || _ |dkrtj}|| _|| _dS )aU Initialize IMDSRegionProvider.
:type session: :class:`botocore.session.Session`
:param session: The session is needed to look up configuration for
how to contact the instance metadata service. Specifically the
whether or not it should use the IMDS region at all, and if so how
to configure the timeout and number of attempts to reach the
service.
:type environ: None or dict
:param environ: A dictionary of environment variables to use. If
``None`` is the argument then ``os.environ`` will be used by
default.
:type fecther: :class:`botocore.utils.InstanceMetadataRegionFetcher`
:param fetcher: The class to actually handle the fetching of the region
from the IMDS. If not provided a default one will be created.
N)r� r� r� �_environ�_fetcher)r� rw r� �fetcherrp rp rq r� � s
zIMDSRegionProvider.__init__c C s | � � }|S )z#Provide the region value from IMDS.)� _get_instance_metadata_region)r� Zinstance_regionrp rp rq �provide� s zIMDSRegionProvider.providec C s | � � }|�� }|S r� )� _get_fetcher�retrieve_region)r� rB r� rp rp rq rC � s z0IMDSRegionProvider._get_instance_metadata_regionc C s | j d kr| �� | _ | j S r� )rA �_create_fetcherr� rp rp rq rE � s
z IMDSRegionProvider._get_fetcherc C sX | j �d�}| j �d�}| j �d�t| j �| j �d�d�}t||| j| j �� |d�}|S )NZmetadata_service_timeoutZ metadata_service_num_attemptsr� r� )r� rs r� )r� r� r� r� rB )r� ru rx � InstanceMetadataRegionFetcherr@ r� )r� Zmetadata_timeoutZmetadata_num_attemptsZ imds_configrB rp rp rq rG � s0 ������ �z"IMDSRegionProvider._create_fetcher)NN)r� r� r� r� rD rC rE rG rp rp rp rq r? � s
r? c @ s e Zd ZdZdd� Zdd� ZdS )rH z-latest/meta-data/placement/availability-zone/c C s8 z| � � }|W S | jk
r2 t�d| j� Y nX dS )aR Get the current region from the instance metadata service.
:rvalue: str
:returns: The region the current instance is running in or None
if the instance metadata service cannot be contacted or does not
give a valid response.
:rtype: None or str
:returns: Returns the region as a string if it is configured to use
IMDS as a region source. Otherwise returns ``None``. It will also
return ``None`` if it fails to get the region from IMDS due to
exhausting its retries or not being able to connect.
r N)� _get_regionr r� r� r� )r� r� rp rp rq rF � s �
z-InstanceMetadataRegionFetcher.retrieve_regionc C s2 | � � }| j| j| j|d�}|j}|d d� }|S )Nr( r� )r r r) r r� )r� r r� Zavailability_zoner� rp rp rq rI s � z)InstanceMetadataRegionFetcher._get_regionN)r� r� r� r) rF rI rp rp rp rq rH � s rH Fc C s� |D ]�}t || t�rH|| kr:||kr:t| | || � q�|| | |< qt || t�r�|r�|| kr�t | | t�r�| | �|| � q�|| | |< q|| | |< qdS )z�Given two dict, merge the second dict into the first.
The dicts can have arbitrary nesting.
:param append_lists: If true, instead of clobbering a list with the new
value, append all of the new values onto the original list.
N)rj �dict� merge_dicts�list�extend)Zdict1Zdict2Z append_listsr� rp rp rq rK s rK c C s" i }| D ]}| | ||� � < q|S )zDCopies the given dictionary ensuring all keys are lowercase strings.r� )�originalr� r� rp rp rq �lowercase_dict9 s rO c
C sV z2|| �� }|� � }t|�W 5 Q R � W S Q R X W n tk
rP t| d��Y nX d S )Nr� )�read�parse_key_val_file_contents�OSErrorr )�filename�_open�f�contentsrp rp rq �parse_key_val_fileA s
rW c C sH i }| � � D ]6}d|krq |�dd�\}}|�� }|�� }|||< q |S )N�=r5 )�
splitlinesr� �strip)rV �final�liner� ro rp rp rq rQ J s
rQ c C s� g }t | d�r| �� }n| }|D ]V\}}t|t�rZ|D ] }|�t|�� dt|�� �� q6q |�t|�� dt|�� �� q d�|�S )af Urlencode a dict or list into a string.
This is similar to urllib.urlencode except that:
* It uses quote, and not quote_plus
* It has a default list of safe chars that don't need
to be encoded, which matches what AWS services expect.
If any value in the input ``mapping`` is a list type,
then each list element wil be serialized. This is the equivalent
to ``urlencode``'s ``doseq=True`` argument.
This function should be preferred over the stdlib
``urlencode()`` function.
:param mapping: Either a dict to urlencode or a list of
``(key, value)`` pairs.
�itemsrX �&)r} r] rj rL r� �percent_encoder� )�mapping�safeZ
encoded_pairs�pairsr� r� �elementrp rp rq �percent_encode_sequenceY s
��rd c C s6 t | ttf�st| �} t | t�s*| �d�} t| |d�S )a� Urlencodes a string.
Whereas percent_encode_sequence handles taking a dict/sequence and
producing a percent encoded string, this function deals only with
taking a string (not a dict/sequence) and percent encoding it.
If given the binary type, will simply URL encode it. If given the
text type, will produce the binary type by UTF-8 encoding the
text. If given something else, will convert it to the text type
first.
�utf-8)ra )rj �bytesrl �encoder )� input_strra rp rp rq r_ s
r_ c C s6 t j ddddddt� d�}|�|� �}|t j| d� S )a� Parse numerical epoch timestamps (seconds since 1970) into a
``datetime.datetime`` in UTC using ``datetime.timedelta``. This is intended
as fallback when ``fromtimestamp`` raises ``OverflowError`` or ``OSError``.
:type value: float or int
:param value: The Unix timestamps as number.
:type tzinfo: callable
:param tzinfo: A ``datetime.tzinfo`` class or compatible callable.
� r5 r ��tzinfor3 )r r �
astimezoner: )r� rk Z
epoch_zeroZepoch_zero_localizedrp rp rq �_epoch_seconds_to_datetime� s rm c
C s� t | ttf�r tj�| |� �S ztj�t| �|� �W S ttfk
rL Y nX ztjj | dt
� id�W S ttfk
r� } ztd| � d|� ���W 5 d}~X Y nX dS )z.Parse timestamp with pluggable tzinfo options.�GMT)ZtzinfoszInvalid timestamp "z": N) rj �int�floatr �
fromtimestamp� TypeErrorr. �dateutil�parser�parser )r� rk r rp rp rq � _parse_timestamp_with_tzinfo� s rv c C s� t � }|D ]N}zt| |�W S ttfk
rV } ztjd|j|d� W 5 d}~X Y q
X q
z t| �}W n tt fk
r~ Y nZX z |D ]}t
||d� W S W n8 ttfk
r� } ztjd|j|d� W 5 d}~X Y nX t d| � d���dS )z�Parse a timestamp into a datetime object.
Supported formats:
* iso8601
* rfc822
* epoch (value is an integer)
This will return a ``datetime.datetime`` object.
z2Unable to parse timestamp with "%s" timezone info.r� Nrj zHUnable to parse timestamp using fallback method with "%s" timezone info.z1Unable to calculate correct timezone offset for "�") r rv rR �
OverflowErrorr� r� r� rp rr r. rm � RuntimeError)r� Ztzinfo_optionsrk r Z
numeric_valuerp rp rq �parse_timestamp� s4 � �
�rz c C sB t | t�r| }nt| �}|jdkr2|jt� d�}n |�t� �}|S )a� Converted the passed in value to a datetime object with tzinfo.
This function can be used to normalize all timestamp inputs. This
function accepts a number of different types of inputs, but
will always return a datetime.datetime object with time zone
information.
The input param ``value`` can be one of several types:
* A datetime object (both naive and aware)
* An integer representing the epoch time (can also be a string
of the integer, i.e '0', instead of 0). The epoch time is
considered to be UTC.
* An iso8601 formatted timestamp. This does not need to be
a complete timestamp, it can contain just the date portion
without the time component.
The returned value will be a datetime object that will have tzinfo.
If no timezone info was provided in the input value, then UTC is
assumed, not local time.
Nrj )rj �_DatetimeClassrz rk r� r rl )r� � datetime_objrp rp rq �parse_to_aware_datetime� s
r} c C sR t � ddd�}| jdkr2|dkr&t� }| j|d�} | jdd�| �� | }|�� S )aw Calculate the timestamp based on the given datetime instance.
:type dt: datetime
:param dt: A datetime object to be converted into timestamp
:type default_timezone: tzinfo
:param default_timezone: If it is provided as None, we treat it as tzutc().
But it is only used when dt is a naive datetime.
:returns: The timestamp
ri r5 Nrj )r rk r r� � utcoffset�
total_seconds)�dtZdefault_timezone�epoch�drp rp rq �datetime2timestamp s
r� c sB t �� }t� fdd�d�D ]}|�|� q|r6|�� S |�� S dS )a� Calculate a sha256 checksum.
This method will calculate the sha256 checksum of a file like
object. Note that this method will iterate through the entire
file contents. The caller is responsible for ensuring the proper
starting position of the file and ``seek()``'ing the file back
to its starting location if other consumers need to read from
the file like object.
:param body: Any file like object. The file must be opened
in binary mode such that a ``.read()`` call returns bytes.
:param as_hex: If True, then the hex digest is returned.
If False, then the digest (as binary bytes) is returned.
:returns: The sha256 checksum
c s
� � d�S �N� �rP rp ��bodyrp rq �<lambda>: � z"calculate_sha256.<locals>.<lambda>r� N)�hashlib�sha256�iter�update� hexdigest�digest)r� Zas_hex�checksum�chunkrp r� rq �calculate_sha256' s r� c s� g }d�t j}t� �fdd�d�D ]}|�||��� � q"|sJ|d��� S t|�dkr�g }t|�D ]2\}}|dk r�|�||| ��� � qb|�|� qb|}qJt� |d ��
d�S ) a\ Calculate a tree hash checksum.
For more information see:
http://docs.aws.amazon.com/amazonglacier/latest/dev/checksum-calculations.html
:param body: Any file like object. This has the same constraints as
the ``body`` param in calculate_sha256
:rtype: str
:returns: The hex version of the calculated tree hash
r� c s
� � ��S r� r� rp �r� Zrequired_chunk_sizerp rq r� S r� z%calculate_tree_hash.<locals>.<lambda>r� r5 Nr �ascii) r� r� r� r� r� r� r� � _in_pairs�binascii�hexlify�decode)r� �chunksr� r� Z
new_chunksr� �secondrp r� rq �calculate_tree_hashB s r� c C s t | �}t||�S r� )r� r )�iterableZ shared_iterrp rp rq r� c s r� c @ s e Zd ZdZdd� Zdd� ZdS )�CachedPropertyz�A read only property that caches the initially computed value.
This descriptor will only call the provided ``fget`` function once.
Subsequent access to this property will return the cached value.
c C s
|| _ d S r� )�_fget)r� �fgetrp rp rq r� | s zCachedProperty.__init__c C s, |d kr | S | � |�}||j| j j< |S d S r� )r� �__dict__r� )r� �obj�clsZcomputed_valuerp rp rq �__get__ s
zCachedProperty.__get__N)r� r� r� r� r� r� rp rp rp rq r� t s r� c @ sD e Zd ZdZddd�Zdd� Zddd �Zd
d � Zd d
� Zdd� Z dS )�ArgumentGeneratora Generate sample input based on a shape model.
This class contains a ``generate_skeleton`` method that will take
an input/output shape (created from ``botocore.model``) and generate
a sample dictionary corresponding to the input/output shape.
The specific values used are place holder values. For strings either an
empty string or the member name can be used, for numbers 0 or 0.0 is used.
The intended usage of this class is to generate the *shape* of the input
structure.
This can be useful for operations that have complex input shapes.
This allows a user to just fill in the necessary data instead of
worrying about the specific structure of the input arguments.
Example usage::
s = botocore.session.get_session()
ddb = s.get_service_model('dynamodb')
arg_gen = ArgumentGenerator()
sample_input = arg_gen.generate_skeleton(
ddb.operation_model('CreateTable').input_shape)
print("Sample input for dynamodb.CreateTable: %s" % sample_input)
Fc C s
|| _ d S r� )�_use_member_names)r� Zuse_member_namesrp rp rq r� � s zArgumentGenerator.__init__c C s g }| � ||�S )z�Generate a sample input.
:type shape: ``botocore.model.Shape``
:param shape: The input shape.
:return: The generated skeleton input corresponding to the
provided input shape.
)�_generate_skeleton)r� r� �stackrp rp rq �generate_skeleton� s
z#ArgumentGenerator.generate_skeletonr� c C s� |� |j� z�|jdkr(| �||�W ��S |jdkrB| �||�W ��S |jdkr\| �||�W ��S |jdkr�| jrt|W �|S |jr�t �
|j�W �fS W �`dS |jdkr�W �NdS |jdkr�W �<d S |jd
kr�W �*d S |jd kr�t � d
ddddd�W �S W 5 |�� X d S )NZ structurerL �mapr| r� )�integer�longr )rp �doubleg �booleanT� timestampri r5 ) r� r� r� r �_generate_type_structure�_generate_type_list�_generate_type_mapr� �enumr7 �choicer �r� r� r� r� rp rp rq r� � s.
z$ArgumentGenerator._generate_skeletonc C sF |� |j�dkri S t� }|j�� D ] \}}| j|||d�||< q$|S )Nr5 )r� )�countr� r �membersr] r� )r� r� r� Zskeleton� member_nameZ member_shaperp rp rq r� � s � z*ArgumentGenerator._generate_type_structurec C s$ d}| j r|jj}| �|j||�gS )Nr� )r� �memberr� r� r� rp rp rq r� � s
�z%ArgumentGenerator._generate_type_listc C s0 |j }|j}|jdkst�td| �||�fg�S )Nr| ZKeyName)r� r� r �AssertionErrorr r� )r� r� r� Z key_shapeZ value_shaperp rp rq r� � s ��z$ArgumentGenerator._generate_type_mapN)F)r� )
r� r� r� r� r� r� r� r� r� r� rp rp rp rq r� � s
r� c C s. t �| �rdS dt| �j� d�}t�|�d k S )NFr� r� )r � intersectionr �hostnamer �match�� endpoint_urlr� rp rp rq �is_valid_ipv6_endpoint_url� s
r� c C s t | �j}t�|�d k S r� )r r� r r� r� rp rp rq �is_valid_ipv4_endpoint_url� s
r� c C sh t �| �rdS t| �}|j}|dkr(dS t|�dkr8dS |d dkrP|dd� }t�dtj�}|�|�S )z�Verify the endpoint_url is valid.
:type endpoint_url: string
:param endpoint_url: An endpoint_url. Must have at least a scheme
and a hostname.
:return: True if the endpoint url is valid. False otherwise.
FN� r� r� z;^((?!-)[A-Z\d-]{1,63}(?<!-)\.)*((?!-)[A-Z\d-]{1,63}(?<!-))$) r r� r r� r� r� �compile�
IGNORECASEr� )r� �partsr� �allowedrp rp rq �is_valid_endpoint_url� s
�r� c C s t | �pt| �S r� )r� r� )r� rp rp rq r� s
�r� c C s2 | dkr dS t �d�}|�| �}|s.t| d��dS )z0Provided region_name must be a valid host label.Nz)^(?![0-9]+$)(?!-)[a-zA-Z0-9-]{,63}(?<!-)$)� region_name)r� r� r� r* )r� Zvalid_host_labelZvalidrp rp rq �validate_region_name s
r� c C sR d| kr dS t | �}|dk s$|dkr(dS t�| �}|dksJ|�� t | �krNdS dS )a�
Check to see if the ``bucket_name`` complies with the
restricted DNS naming conventions necessary to allow
access via virtual-hosting style.
Even though "." characters are perfectly valid in this DNS
naming scheme, we are going to punt on any name containing a
"." character because these will cause SSL cert validation
problems if we try to use virtual-hosting style addressing.
r� F� �? NT)r� �LABEL_REr� �end)� bucket_name�nr� rp rp rq �check_dns_name% s
r� c
K s` | j �dd�rd}zt| ||� W n8 tk
rZ } z|jd }t�d|� W 5 d}~X Y nX dS )ar
This handler looks at S3 requests just before they are signed.
If there is a bucket name on the path (true for everything except
ListAllBuckets) it checks to see if that bucket name conforms to
the DNS naming conventions. If it does, it alters the request to
use ``virtual hosting`` style addressing rather than ``path-style``
addressing.
Zuse_global_endpointFzs3.amazonaws.comr� z2Not changing URI, bucket is not DNS compatible: %sN)r� r~ � switch_to_virtual_host_styler$ r� r� r� )r� �signature_versionr� �default_endpoint_urlr� r r� rp rp rq � fix_s3_host< s �
�r� c K s | j dk rdS t| �r$t�d� dS t| j�}|j| _ |j�d�}|dkrP|j}t |�dk�r|d }|sndS t�d| j� t
|��rt |�dkr�| j d dkr�| j d7 _ |� |� d� |�p�d}|}|d | } |j
| ||jd f}
t|
�} | | _t�d
| � n
t|d ��dS ) a)
This is a handler to force virtual host style s3 addressing no matter
the signature version (which is taken in consideration for the default
case). If the bucket is not DNS compatible an InvalidDNSName is thrown.
:param request: A AWSRequest object that is about to be sent.
:param signature_version: The signature version to sign with
:param default_endpoint_url: The endpoint to use when switching to a
virtual style. If None is supplied, the virtual host will be
constructed from the url of the request.
NzKRequest is GetBucketLocation operation, not checking for DNS compatibility.r� r5 z*Checking for DNS compatible bucket for: %s� r� r� r� zURI updated to: %s)r� )Z auth_path� _is_get_bucket_location_requestr� r� r r� r� r� �netlocr� r� �remover� �scheme�queryr r$ ) r� r� r� r� r� �
path_partsr� r� Zglobal_endpoint�hostZ new_tupleZnew_urirp rp rq r� Y s<
�
r� c C s | j �d�S )Nz ?location)r� r� r� rp rp rq r� � s r� c s" � j �t�� �� �fdd��}|S )a Method decorator for caching method calls to a single instance.
**This is not a general purpose caching decorator.**
In order to use this, you *must* provide an ``_instance_cache``
attribute on the instance.
This decorator is used to cache method calls. The cache is only
scoped to a single instance though such that multiple instances
will maintain their own cache. In order to keep things simple,
this decorator requires that you provide an ``_instance_cache``
attribute on your instance.
c s\ �|f}|r&t t|�� ��}�||f}| j�|�}|d k r>|S � | f|�|�}|| j|< |S r� )�tuple�sortedr] Z_instance_cacher~ )r� �argsr� � cache_keyZ kwarg_items�result��func� func_namerp rq � _cache_guard� s
z$instance_cache.<locals>._cache_guard)r� � functools�wraps)r� r� rp r� rq �instance_cache� s r� c s � �fdd�}|S )a
Version of functools.lru_cache that stores a weak reference to ``self``.
Serves the same purpose as :py:func:`instance_cache` but uses Python's
functools implementation which offers ``max_size`` and ``typed`` properties.
lru_cache is a global cache even when used on a method. The cache's
reference to ``self`` will prevent garbage collection of the object. This
wrapper around functools.lru_cache replaces the reference to ``self`` with
a weak reference to not interfere with garbage collection.
c s: t j���� fdd���t �� ��fdd��}�j|_|S )Nc s � | � f|�|�S r� rp )Zweakref_to_selfr� r� )r� rp rq �func_with_weakref� s z=lru_cache_weakref.<locals>.wrapper.<locals>.func_with_weakrefc s> |� � D ] \}}t|t�rt|�||< q� t�| �f|�|�S r� )r] rj rL r� �weakref�ref)r� r� r� Z kwarg_keyZ kwarg_value)r� rp rq �inner� s
z1lru_cache_weakref.<locals>.wrapper.<locals>.inner)r� � lru_cacher� �
cache_info)r� r� ��
cache_args� cache_kwargs)r� r� rq �wrapper� s
z"lru_cache_weakref.<locals>.wrapperrp )r� r� r� rp r� rq �lru_cache_weakref� s
r� c K sh t | j�j�d�}dd� |D �}d}t|�dkrB|d�|�d 7 }|d7 }|dkrVdS t| |d d
� dS ) z?Switches the current s3 endpoint with an S3 Accelerate endpointr� c S s g | ]}|t kr|�qS rp ��S3_ACCELERATE_WHITELIST�r� �prp rp rq r� � s z-switch_host_s3_accelerate.<locals>.<listcomp>zhttps://s3-accelerate.r �
amazonaws.com)Z ListBuckets� CreateBucketZ DeleteBucketNF)�use_new_scheme)r r� r� r� r� r� �
_switch_hosts)r� �operation_namer� r� r� rp rp rq �switch_host_s3_accelerate� s r� c C s2 t �| j�d��}|�|�r.|| }t| |� dS )zBSwitches the host using a parameter value from a JSON request bodyre N)r r, �datar� r~ r� )r� �
param_nameZ request_json� new_endpointrp rp rq �switch_host_with_param� s
r c C s t | j||�}|| _d S r� )�_get_new_endpointr� )r� r r� �final_endpointrp rp rq r� � s �r� c C sV t |�}t | �}|j}|r |j}||j|j|jdf}t|�}t�d| � d|� �� |S �Nr� zUpdating URI from � to )r r� r� r� r� r r� r� )Zoriginal_endpointr r� Znew_endpoint_componentsZ original_endpoint_componentsr� Zfinal_endpoint_componentsr rp rp rq r � s �r c C sR |D ]H}|| kr@t | | t�r@t || t�r@t| | || � q|| | |< qdS )z�Deeply two dictionaries, overriding existing keys in the base.
:param base: The base dictionary which will be merged into.
:param extra: The dictionary to merge into the base. Keys from this
dictionary will take precedence.
N)rj rJ �
deep_merge)�base�extrar� rp rp rq r s � � �r c C s | � dd��� S )zcTranslate the form used for event emitters.
:param service_id: The service_id to convert.
� �-)r� rm )Z
service_idrp rp rq �hyphenize_service_id& s r c @ s, e Zd ZdZdZdd� Zdd� Zdd� Zd S )
�
IdentityCachez�Base IdentityCache implementation for storing and retrieving
highly accessed credentials.
This class is not intended to be instantiated in user code.
Zbase_identity_cachec C s || _ || _d S r� ��_client�_credential_cls�r� �client�credential_clsrp rp rq r� 7 s zIdentityCache.__init__c K s. | j f |�}|� }| jj||| jddd�}|S )N�- �
)r� Z
refresh_usingr� Zadvisory_timeoutZmandatory_timeout)�build_refresh_callbackr Zcreate_from_metadata�METHOD)r� r� �callbackr� Zcredential_entryrp rp rq �get_credentials; s �z IdentityCache.get_credentialsc K s
t � �dS )z�Callback to be implemented by subclasses.
Returns a set of metadata to be converted into a new
credential instance.
N)�NotImplementedError)r� rp rp rq r G s z$IdentityCache.build_refresh_callbackN)r� r� r� r� r r� r r rp rp rp rq r . s
r c sJ e Zd ZdZdZdd� Zejdd�� fdd��Zd d
� Z dd d
�Z
� Z S )�S3ExpressIdentityCachez�S3Express IdentityCache for retrieving and storing
credentials from CreateSession calls.
This class is not intended to be instantiated in user code.
� s3expressc C s || _ || _d S r� r
r rp rp rq r� Y s z S3ExpressIdentityCache.__init__�d )�maxsizec s t � j|d�S )N��bucket)�superr )r� r �� __class__rp rq r ] s z&S3ExpressIdentityCache.get_credentialsc s � �fdd�}|S )Nc sB �j j� d�} | d }�j|d dd�}|d |d |d |d �S )
N��Bucket� Credentialsr T)�isor r Z SessionToken)r r r r )r Zcreate_session�_serialize_if_needed)r� �credsr= �r r� rp rq � refresherb s ��z@S3ExpressIdentityCache.build_refresh_callback.<locals>.refresherrp )r� r r* rp r) rq r a s
z-S3ExpressIdentityCache.build_refresh_callbackFc C s$ t |t�r |r|�� S |�d�S |S �Nz%Y-%m-%dT%H:%M:%S%Z�rj r{ � isoformatr; �r� r� r& rp rp rq r' q s
z+S3ExpressIdentityCache._serialize_if_needed)F) r� r� r� r� r r� r� r� r r r' �
__classcell__rp rp r! rq r P s
r c @ s0 e Zd Zd
dd�Zd dd�Zdd� Zdd � ZdS ) �S3ExpressIdentityResolverNc C s* t �|�| _|d kr t| j|�}|| _d S r� )r� �proxyr r �_cache)r� r r �cacherp rp rq r� z s z"S3ExpressIdentityResolver.__init__c C s8 t �d� |p| jjj}|�d| j� |�d| j� d S )Nz'Registering S3Express Identity Resolver�before-call.s3�before-sign.s3)r� r� r �metarQ �register�apply_signing_cache_key�resolve_s3express_identity�r� �
event_emitterZemitterrp rp rq r7 � s
z"S3ExpressIdentityResolver.registerc K sV |� di �}|� dd �}|� di �� d�}|dkrR|d k rR|�di � ||d d< d S )N�endpoint_properties�backendZ input_paramsr$ � S3Express�signingr� )r~ �
setdefault)r� �paramsr� r� r< r= r� rp rp rq r8 � s z1S3ExpressIdentityResolver.apply_signing_cache_keyc K s` |j �di �}|�d�}|dkr\|�d�r\| j|d< d|kr\|j �di ��di ��d �|d< d S )
Nr? � signing_namer z v4-s3expressZidentity_cacher� � s3_redirectrA r$ )r� r~ �
startswithr2 ) r� r� rB r� r� Zrequest_signerr� r� �signing_contextrp rp rq r9 � s
�
���z4S3ExpressIdentityResolver.resolve_s3express_identity)N)N)r� r� r� r� r7 r8 r9 rp rp rp rq r0 y s
r0 c @ sL e Zd ZdZddd�Zddd�Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dS )�S3RegionRedirectorv2a
Updated version of S3RegionRedirector for use when
EndpointRulesetResolver is in use for endpoint resolution.
This class is considered private and subject to abrupt breaking changes or
removal without prior announcement. Please do not use it directly.
Nc C s |pi | _ t�|�| _d S r� )r2 r� r1 r �r� Zendpoint_bridger r3 rp rp rq r� � s
z S3RegionRedirectorv2.__init__c C sF t �d� |p| jjj}|�d| j� |�d| j� |�d| j� d S )Nz(Registering S3 region redirector handler�needs-retry.s3�before-parameter-build.s3z before-endpoint-resolution.s3) r� r� r r6 rQ r7 �redirect_from_error�annotate_request_context�redirect_from_cacher: rp rp rq r7 � s
� �z S3RegionRedirectorv2.registerc K s, |dkr dS |� di �� di �}t�|� d��r>t�d� dS |� d�rVt�d� dS |d � d i �}|� d
�}|d � d i �}|d ko�|jd
k} |d ko�|jdko�d|� di �k}
|dko�d|k} |d dk o�|d jdk} |dk}
|dko�|jdk}t| | |
|
| |g��sdS |d d d }|d � d�}| �||�}|dk�rbt�d|� d|� d�� dS t�d|� d|� d |� d �� || j |< | j
j }|j ||d d d |d d �}| �
|d |j�|d < d!|d d d< |j� d"�}|dk �r(|�|�}|\}}||d d#< |d � d$i �|�|d d$< dS )%�
An S3 request sent to the wrong region will return an error that
contains the endpoint the request should be sent to. This handler
will add the redirect information to the signing context and then
redirect the request.
Nr� rC r zBS3 request was previously for an Accesspoint ARN, not redirecting.�
redirected�6S3 request was previously redirected, not redirecting.r5 �Errorr �ResponseMetadata�Z301Z400�
HeadObject�
HeadBucket�x-amz-bucket-region� HTTPHeaders� AuthorizationHeaderMalformed�Regionr �i- i. i3 �PermanentRedirectZ"IllegalLocationConstraintExceptionr� �
client_region� S3 client configured for region � but the bucket �S is not in that region and the proper region could not be automatically determined.� is in region �b; Please configure the proper region to avoid multiple unnecessary redirects and signing attempts.rA )Zoperation_modelZ call_args�request_contextr� TZ authSchemes� auth_typer? )r~ � ArnParser�is_arnr� r� r� r� �any�get_bucket_regionr2 r Z_ruleset_resolver�construct_endpoint�set_request_urlr� �
propertiesZauth_schemes_to_signing_ctx)r� � request_dictr� � operationr� Z redirect_ctxr� �
error_code�response_metadata�is_special_head_object�is_special_head_bucket�is_wrong_signing_region�is_redirect_status�is_permanent_redirectZis_opt_in_region_redirectr r[ �
new_regionZ ep_resolverZep_infoZ auth_schemesZ auth_inforb rE rp rp rq rJ � s� �
�
��
��������
��
� �
� z(S3RegionRedirectorv2.redirect_from_errorc
C s� |d }|d d }d|kr$|d S |� di �� dd�}|dk rD|S z | jj|d�}|d d }W n0 tk
r� } z|jd d }W 5 d}~X Y nX |� dd�}|S � a.
There are multiple potential sources for the new region to redirect to,
but they aren't all universally available for use. This will try to
find region from response elements, but will fall back to calling
HEAD on the bucket if all else fails.
:param bucket: The bucket to find the region for. This is necessary if
the region is not available in the error response.
:param response: A response representing a service request that failed
due to incorrect region configuration.
r5 rQ rV rU rP rX Nr# �r~ r Z head_bucketr r� �r� r r� Zservice_response�response_headersr� r� r rp rp rq rf 0 s
z&S3RegionRedirectorv2.get_bucket_regionc K s t ||d�S )z�
Splice a new endpoint into an existing URL. Note that some endpoints
from the the endpoint provider have a path component which will be
discarded by this function.
F)r )r� �old_urlr r� rp rp rq rh Q s z$S3RegionRedirectorv2.set_request_urlc K s4 |� d�}|dk r0|| jkr0| j� |�}||d< dS )a
If a bucket name has been redirected before, it is in the cache. This
handler will update the AWS::Region endpoint resolver builtin param
to use the region from cache instead of the client region to avoid the
redirect.
r$ Nz AWS::Region)r~ r2 )r� �builtinsrA r� r rs rp rp rq rL Y s
z(S3RegionRedirectorv2.redirect_from_cachec K s |� d�}d||d�|d< dS )z�Store the bucket name in context for later use when redirecting.
The bucket name may be an access point ARN or alias.
r$ F)rN r rA rC Nr� )r� rA r� r� r rp rp rq rK e s
�z-S3RegionRedirectorv2.annotate_request_context)N)N) r� r� r� r� r� r7 rJ rf rh rL rK rp rp rp rq rF � s
p! rF c @ sL e Zd ZdZddd�Zddd�Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dS )�S3RegionRedirectorz�This handler has been replaced by S3RegionRedirectorv2. The original
version remains in place for any third-party libraries that import it.
Nc C s: || _ || _| jd kr i | _t�|�| _tjdtd� d S )Nz�The S3RegionRedirector class has been deprecated for a new internal replacement. A future version of botocore may remove this class.��category)�_endpoint_resolverr2 r� r1 r �warnings�warn�
FutureWarningrG rp rp rq r� v s
�zS3RegionRedirector.__init__c C s< |p | j jj}|�d| j� |�d| j� |�d| j� d S )NrH r4 rI )r r6 rQ r7 rJ rh rL r: rp rp rq r7 � s zS3RegionRedirector.registerc K s� |dkr dS | � |�di ��r,t�d� dS |�di ��d�rLt�d� dS |d �di �}|�d�}|d �d i �}|d
ko�|jd k}|d
ko�|jd ko�d
|�di �k} |dko�d|k}
|d dk o�|d jdk} |dk} t||
| | | g�s�dS |d d d }
|d �d�}| �|
|�}|dk�rBt�d|� d|
� d�� dS t�d|� d|
� d|� d�� | j� d |�}|d }||
|d �}||d d< || j
|
< | � ||d � d |d d< dS ) rM Nr� z=S3 request was previously to an accesspoint, not redirecting.Z
s3_redirectedrO r5 rP r rQ rR rS rT rU rV rW rX r rY rZ r? r r[ r\ r] r^ r_ r` �s3r� )r� r r� T) �_is_s3_accesspointr~ r� r� r� r� re rf r} �resolver2 rh )r� rj r� rk r� r� rl rm rn ro rp rq rr r r[ rs r� rE rp rp rq rJ � s~ ��
��
�������
���
z&S3RegionRedirector.redirect_from_errorc
C s� |d }|d d }d|kr$|d S |� di �� dd�}|dk rD|S z | jj|d�}|d d }W n0 tk
r� } z|jd d }W 5 d}~X Y nX |� dd�}|S rt ru rv rp rp rq rf � s
z$S3RegionRedirector.get_bucket_regionc K s4 |� di �� dd �}|d k r0t|d |d�|d< d S )Nr? r� r� F)r~ r �r� rA r� r� r� rp rp rq rh s z"S3RegionRedirector.set_request_urlc K sF | � |�rdS |�d�}| j�|�}|dk r6||d< n d|i|d< dS )z�
This handler retrieves a given bucket's signing context from the cache
and adds it into the request context.
Nr$ r? r )r� r~ r2 )r� rA r� r� r rE rp rp rq rL s
z&S3RegionRedirector.redirect_from_cachec C s d|kS �Nr� rp )r� r� rp rp rq r� s z%S3RegionRedirector._is_s3_accesspoint)N)N) r� r� r� r� r� r7 rJ rf rh rL r� rp rp rp rq rz q s
^!rz c @ s e Zd ZdS )�InvalidArnExceptionN)r� r� r� rp rp rp rq r� # s r� c @ s e Zd Zdd� Zedd� �ZdS )rc c C sL |� dd�}t|�dk r(td|� d���|d |d |d |d |d d
�S ) N�:� � zProvided ARN: zE must be of the format: arn:partition:service:region:account:resourcer5 r� r� � )� partition�servicer� �account�resource)r� r� r� )r� �arnZ arn_partsrp rp rq � parse_arn( s
��zArnParser.parse_arnc C sJ t | t�r| �d�sdS t� }z|�| � W dS tk
rD Y dS X d S )Nzarn:FT)rj rl rD rc r� r� )r� �
arn_parserrp rp rq rd 7 s
zArnParser.is_arnN)r� r� r� r� � staticmethodrd rp rp rp rq rc ' s rc c @ s` e Zd Ze�d�Ze�d�ZdgZddd�Zdd� Z d d
� Z
d d � Z d
d� Z dd� Z
dd� ZdS )�S3ArnParamHandlerzA^(?P<resource_type>accesspoint|outpost)[/:](?P<resource_name>.+)$zc^(?P<outpost_name>[a-zA-Z0-9\-]{1,63})[/:]accesspoint[/:](?P<accesspoint_name>[a-zA-Z0-9\-]{1,63}$)r� Nc C s || _ |d krt� | _ d S r� �� _arn_parserrc �r� r� rp rp rq r� M s zS3ArnParamHandler.__init__c C s |� d| j� d S )NrI �r7 �
handle_arn�r� r; rp rp rq r7 R s zS3ArnParamHandler.registerc K s` |j | jkrd S | �|�}|d kr&d S |d dkrB| �|||� n|d dkr\| �|||� d S )N�
resource_type� accesspoint�outpost)r� �_BLACKLISTED_OPERATIONS�"_get_arn_details_from_bucket_param�_store_accesspoint�_store_outpost)r� rA �modelr� r� � arn_detailsrp rp rq r� U s
z S3ArnParamHandler.handle_arnc C sH d|krDz&|d }| j �|�}| �||� |W S tk
rB Y nX d S )Nr$ )r� r� �_add_resource_type_and_namer� )r� rA r� r� rp rp rq r� ` s z4S3ArnParamHandler._get_arn_details_from_bucket_paramc C s@ | j �|d �}|r2|�d�|d< |�d�|d< n
t|d��d S )Nr� r� �
resource_name)r� )�_RESOURCE_REGEXr� �groupr1 )r� r� r� r� rp rp rq r� k s
z-S3ArnParamHandler._add_resource_type_and_namec C s8 |d |d< |d |d |d |d |d d�|d< d S ) Nr� r$ r� r� r� r� )r� r� r� r� r� r� rp �r� rA r� r� rp rp rq r� s s �z$S3ArnParamHandler._store_accesspointc C sd |d }| j �|�}|s"t|d��|�d�}||d< |�d�||d |d |d |d d
�|d < d S ) Nr� )r� �accesspoint_namer$ � outpost_namer� r� r� r� )r� r� r� r� r� r� r� )�_OUTPOST_RESOURCE_REGEXr� r/ r� )r� rA r� r� r� r� r� rp rp rq r� � s
�z S3ArnParamHandler._store_outpost)N)r� r� r� r� r� r� r� r� r� r7 r� r� r� r� r� rp rp rp rq r� C s ��
r� c @ s� e Zd ZdZdZd7dd�Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zed1d2� �Z ed3d4� �Z ed5d6� �Z dS )8�S3EndpointSetter�awsr� NFc C sF || _ || _|| _|| _|d kr&i | _|| _|| _|d krB| j| _d S r� �r} �_region�
_s3_config�_use_fips_endpoint�
_endpoint_url�
_partition�_DEFAULT_PARTITION�r� �endpoint_resolverr� � s3_configr� r� �use_fips_endpointrp rp rq r� � s
zS3EndpointSetter.__init__c C s. |� d| j� |� d| j� |� d| j� d S )Nr5 zchoose-signer.s3z%before-call.s3.WriteGetObjectResponse)r7 � set_endpoint�
set_signer�#update_endpoint_to_s3_object_lambdar� rp rp rq r7 � s �zS3EndpointSetter.registerc K sh | j rtdd��| �|d� | jr&d S | j}|�d| j�}dj|d |d d�}t|d |d �|d< d S )
NzOS3 client does not support accelerate endpoints for S3 Object Lambda operations��msg�s3-object-lambdaz https://{host_prefix}{hostname}� host_prefixr� )r� r� r� F) �_use_accelerate_endpointr2 �_override_signing_namer� r} rg r� �formatr )r� rA r� r� �resolver�resolvedr rp rp rq r� � s" � ��z4S3EndpointSetter.update_endpoint_to_s3_object_lambdac K s� | � |�rL| �|� | �|� | �|� | �|�}| �|� | �||� d S | jr~| jrlt d| j
� d�d��t f d|i|�� | j r�| j f d|i|�� d S )Nz8Client is configured to use the FIPS psuedo region for "zA", but S3 Accelerate does not have any FIPS compatible endpoints.r� r� )
�_use_accesspoint_endpoint� _validate_accesspoint_supported�_validate_fips_supported�_validate_global_regions�(_resolve_region_for_accesspoint_endpoint�._resolve_signing_name_for_accesspoint_endpoint� _switch_to_accesspoint_endpointr� r� r2 r� r� �_s3_addressing_handler)r� r� r� r� rp rp rq r� � s$
�
�z S3EndpointSetter.set_endpointc C s
d|j kS r� �r� r� rp rp rq r� � s z*S3EndpointSetter._use_accesspoint_endpointc C s� | j s
d S d|jd d kr(tdhd��d|jd krJtd| j� d�d��|jd d }|| jkr�| j�d d
�s�td | j� d |� d
�d��d S )N�fipsr� r� �,Invalid ARN, FIPS region not allowed in ARN.r� r� z4Client is configured to use the FIPS psuedo-region "z2", but outpost ARNs do not support FIPS endpoints.�use_arn_regionTz8Client is configured to use the FIPS psuedo-region for "z1", but the access-point ARN provided is for the "zn" region. For clients using a FIPS psuedo-region calls to access-point ARNs in another region are not allowed.)r� r� r0 r� r� r~ �r� r� Zaccesspoint_regionrp rp rq r� � s � �
�z)S3EndpointSetter._validate_fips_supportedc C s4 | j �dd�rd S | jdkr0td| j� d�d��d S )Nr� T)z
aws-globalz
s3-external-1z6Client is configured to use the global psuedo-region "zJ". When providing access-point ARNs a regional endpoint must be specified.r� )r� r~ r� r0 r� rp rp rq r�
s
�z)S3EndpointSetter._validate_global_regionsc C s� | j rtdd��|jd d }|| jkrBtd| j� d|� d�d��|jd �d�}|d krp| j�d
�rptd d��|jd �d �}|r�| j�d
�r�td
d��| �|� d S )NzZClient does not support s3 accelerate configuration when an access-point ARN is specified.r� r� r� �Client is configured for "z3" partition, but access-point ARN provided is for "zE" partition. The client and access-point partition must be the same.r� r� �use_dualstack_endpointzjClient does not support s3 dualstack configuration when an S3 Object Lambda access point ARN is specified.r� zTClient does not support s3 dualstack configuration when an outpost ARN is specified.)r� r0 r� r� r~ r� �_validate_mrap_s3_config)r� r� Zrequest_partitionZ
s3_servicer� rp rp rq r� s, �
����z0S3EndpointSetter._validate_accesspoint_supportedc C s@ t |j�sd S | j�d�r&tdd��n| j�d�r<tdd��d S )NZ$s3_disable_multiregion_access_pointszCInvalid configuration, Multi-Region Access Point ARNs are disabled.r� r� zeClient does not support s3 dualstack configuration when a Multi-Region Access Point ARN is specified.)r� r� r� r~ r0 r� rp rp rq r� > s
� �z)S3EndpointSetter._validate_mrap_s3_configc C sJ t |j�r| �|d� n,| j�dd�rD|jd d }| �||� |S | jS )Nr� r� Tr� r� )r� r� �_override_signing_regionr� r~ r� r� rp rp rq r� P s
z9S3EndpointSetter._resolve_region_for_accesspoint_endpointc K s t |�rtrdS tdd��d S )NZs3v4azzUsing S3 with an MRAP arn requires an additional dependency. You will need to pip install botocore[crt] before proceeding.r� )r� r r, )r� r� r� rp rp rq r� ] s �zS3EndpointSetter.set_signerc C s |j d d }| �|j |� d S )Nr� r� �r� r� )r� r� Zaccesspoint_servicerp rp rq r� h s z?S3EndpointSetter._resolve_signing_name_for_accesspoint_endpointc C sX t |j�}t|j| �|j|�| �|j|j�|jdf�}t �
d|j� d|� �� ||_d S r ) r r� r r� � _get_netlocr� �_get_accesspoint_pathr� r� r� r� )r� r� r� �original_componentsZaccesspoint_endpointrp rp rq r� l s
��� �z0S3EndpointSetter._switch_to_accesspoint_endpointc C s" t |�r| �|�S | �||�S d S r� )r� �_get_mrap_netloc�_get_accesspoint_netloc)r� ra r� rp rp rq r� ~ s
z S3EndpointSetter._get_netlocc C s\ |d }d}|d g}| j r4t| j �j}|�|� n |d }|�d|| �|�g� d�|�S )Nr� z s3-globalr� r� r� r� )r� r r� r� rM �_get_partition_dns_suffixr� )r� ra r� r� Zmrap_netloc_components�endpoint_url_netlocr� rp rp rq r� � s
��z!S3EndpointSetter._get_mrap_netlocc C s� |d }d� |d |d �g}|�d�}| jrT|r<|�|� t| j�j}|�|� n||rl|dg}|�|� n:|d dkr�| �d|�}|�|� n| �d |�}|�|� | j�d
�r�|�d � |�|| � |�g� d �
|�S )
Nr� z{}-{}r� r� r� � s3-outpostsr� r� zs3-accesspointr� r8 r� ) r� r~ r� r� r r� rM �_inject_fips_if_neededr� �_get_dns_suffixr� ) r� ra r� r� Z accesspoint_netloc_componentsr� r� Z outpost_host� componentrp rp rq r� � s: �
� �
�z(S3EndpointSetter._get_accesspoint_netlocc C s | j r|� d�S |S )N�-fips�r� )r� r� ra rp rp rq r� � s
z'S3EndpointSetter._inject_fips_if_neededc C s" |d d }|� d| dd�p dS )Nr� r� r� r� r5 )r� )r� Z
original_pathra r� rp rp rq r� � s z&S3EndpointSetter._get_accesspoint_pathc C s | j �|�}|d kr| j}|S r� )r} �get_partition_dns_suffix�_DEFAULT_DNS_SUFFIX)r� Zpartition_name�
dns_suffixrp rp rq r� � s �z*S3EndpointSetter._get_partition_dns_suffixc C s, | j �d|�}| j}|r(d|kr(|d }|S �Nr� Z dnsSuffix�r} rg r� �r� r� r� r� rp rp rq r� � s � z S3EndpointSetter._get_dns_suffixc C s$ |j �di �}||d< ||j d< d S �Nr? r� �r� r~ �r� r� r� rE rp rp rq r� � s z)S3EndpointSetter._override_signing_regionc C s |� di �}||d< ||d< d S �Nr? rB r� )r� r� rB rE rp rp rq r� � s z'S3EndpointSetter._override_signing_namec C s� | j �d�rdS | jd kr dS t| j�j}|�d�s8dS |�d�}|d dkrRdS |dd � }t|�tt|��krvdS t d
d � |D ��S ) N�use_accelerate_endpointTFr� r� r �
s3-accelerater5 ���c s s | ]}|t kV qd S r� r� r� rp rp rq � <genexpr>
s z<S3EndpointSetter._use_accelerate_endpoint.<locals>.<genexpr>)
r� r~ r� r r� r� r� r� �set�all)r� r� r� �
feature_partsrp rp rq r� � s
z)S3EndpointSetter._use_accelerate_endpointc C s" | j r
dS | j�d�}|r |S d S )N�virtualZaddressing_style)r� r� r~ )r� Zconfigured_addressing_stylerp rp rq �_addressing_style
s
z"S3EndpointSetter._addressing_stylec C sH | j dkrt�d� tS | j dks,| jd k r:t�d� d S t�d� tS )Nr� z'Using S3 virtual host style addressing.r� z Using S3 path style addressing.zSDefaulting to S3 virtual host style addressing with path style addressing fallback.)r� r� r� r� r� r� r� rp rp rq r�
s
�z'S3EndpointSetter._s3_addressing_handler)NNNNF) r� r� r� r� r� r� r7 r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� rp rp rp rq r� � sF �
%
"
r� c @ s� e Zd ZdZdZe�d�Zd6dd�Zdd � Z d
d � Z
d d
� Z dd� Z dd� Z
dd� Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd,d-� Zd.d/� Z d0d1� Z d2d3� Z d4d5� Z dS )7�S3ControlEndpointSetterr� r� z^[a-zA-Z0-9\-]{1,63}$NFc C sF || _ || _|| _|| _|d kr&i | _|| _|| _|d krB| j| _d S r� r� r� rp rp rq r� 4
s z S3ControlEndpointSetter.__init__c C s |� d| j� d S )Nzbefore-sign.s3-control)r7 r� r� rp rp rq r7 H
s z S3ControlEndpointSetter.registerc K s| | � |�r@| �|� | �|�}| �|� | �||� | �|� n8| �|�rx| �|� | �|d� | � | j
�}| � ||� d S �Nr� ) � _use_endpoint_from_arn_details�-_validate_endpoint_from_arn_details_supported� _resolve_region_from_arn_details�&_resolve_signing_name_from_arn_details�"_resolve_endpoint_from_arn_details� _add_headers_from_arn_details� _use_endpoint_from_outpost_id�#_validate_outpost_redirection_validr� �_construct_outpost_endpointr� �_update_request_netloc)r� r� r� r� �
new_netlocrp rp rq r� K
s
z$S3ControlEndpointSetter.set_endpointc C s
d|j kS )Nr� r� r� rp rp rq r� X
s z6S3ControlEndpointSetter._use_endpoint_from_arn_detailsc C s
d|j kS )N�
outpost_idr� r� rp rp rq r� [
s z5S3ControlEndpointSetter._use_endpoint_from_outpost_idc C s� d|j d d kr(t|j d d dd��| j�dd�sl|j d d }|| jkrld |� d
| j� d �}t|d ��|j d d
}|| jkr�td| j� d|� d�d ��| j�d�r�tdd ��d|j d kr�| �|� d S )Nr� r� r� rN r� �r� r� r� FzCThe use_arn_region configuration is disabled but received arn for "z(" when the client is configured to use "rw r� r� r� z&" partition, but arn provided is for "z;" partition. The client and arn partition must be the same.r� �7S3 control client does not support accelerate endpointsr� )r� r3 r� r~ r� r4 r� r� )r� r� �
arn_regionr Zrequest_partionrp rp rq r� ^
s, �
�
� �zES3ControlEndpointSetter._validate_endpoint_from_arn_details_supportedc C s | j �d�rtdd��d S )Nr� zPClient does not support s3 dualstack configuration when an outpost is specified.r� )r� r~ r4 r� rp rp rq r� }
s �z;S3ControlEndpointSetter._validate_outpost_redirection_validc C s2 | j �dd�r,|jd d }| �||� |S | jS )Nr� Fr� r� )r� r~ r� r� r� )r� r� r rp rp rq r� �
s
z8S3ControlEndpointSetter._resolve_region_from_arn_detailsc C s |j d d }| �||� |S )Nr� r� r� )r� r� Z arn_servicerp rp rq r� �
s z>S3ControlEndpointSetter._resolve_signing_name_from_arn_detailsc C s | � ||�}| �||� d S r� )� _resolve_netloc_from_arn_detailsr )r� r� r� r rp rp rq r� �
s
�z:S3ControlEndpointSetter._resolve_endpoint_from_arn_detailsc C sD t |j�}t|j||j|jdf�}t�d|j� d|� �� ||_d S r )r r� r r� r� r� r� r� )r� r� r r� Zarn_details_endpointrp rp rq r �
s
�� �z.S3ControlEndpointSetter._update_request_netlocc C s0 |j d }d|kr | �|�S |d }| �||�S )Nr� r� r� )r� r � _construct_s3_control_endpoint)r� r� r� r� r� rp rp rq r �
s
z8S3ControlEndpointSetter._resolve_netloc_from_arn_detailsc C s | j �|�S r� )�_HOST_LABEL_REGEXr� )r� �labelrp rp rq �_is_valid_host_label�
s z,S3ControlEndpointSetter._is_valid_host_labelc G s" |D ]}| � |�st|d��qd S )N)r
)r r' )r� �labelsr
rp rp rq �_validate_host_labels�
s
z-S3ControlEndpointSetter._validate_host_labelsc C s\ | � ||� | jr(t| j�j}||g}n*|dg}| �|� | �|�}|�||g� | �|�S )N�
s3-control)r
r� r r� �_add_dualstackr� rM �_construct_netloc)r� r� r� r� r� r� rp rp rq r �
s
�
z6S3ControlEndpointSetter._construct_s3_control_endpointc C s@ | � |� | jr t| j�jS d|| �|�g}| �|� | �|�S r� )r
r� r r� r� � _add_fipsr )r� r� r� rp rp rq r �
s
�
z3S3ControlEndpointSetter._construct_outpost_endpointc C s
d� |�S )Nr� )r� �r� r� rp rp rq r �
s z)S3ControlEndpointSetter._construct_netlocc C s | j r|d d |d< d S )Nr r� r� r rp rp rq r �
s z!S3ControlEndpointSetter._add_fipsc C s | j �d�r|�d� d S )Nr� r8 )r� r~ r� r rp rp rq r �
s z&S3ControlEndpointSetter._add_dualstackc C s, | j �d|�}| j}|r(d|kr(|d }|S r� r� r� rp rp rq r� �
s � z'S3ControlEndpointSetter._get_dns_suffixc C s$ |j �di �}||d< ||j d< d S r� r� r� rp rp rq r� �
s z0S3ControlEndpointSetter._override_signing_regionc C s$ |j �di �}||d< ||j d< d S r� r� )r� r� rB rE rp rp rq r� �
s z.S3ControlEndpointSetter._override_signing_namec C s( |j d }|�d�}|r$| �||� d S )Nr� r� )r� r~ �_add_outpost_id_header)r� r� r� r� rp rp rq r� �
s
z5S3ControlEndpointSetter._add_headers_from_arn_detailsc C s ||j d< d S )Nzx-amz-outpost-id)r� )r� r� r� rp rp rq r s z.S3ControlEndpointSetter._add_outpost_id_header)NNNNF) r� r� r� r� r� r� r� r r� r7 r� r� r� r� r� r� r� r� r r r r
r r r r r r� r� r� r� r rp rp rp rq r� /
s@
�
r� c @ s� e Zd ZdZe�d�Zd dd�Zdd� Zdd � Z d
d � Z
d d
� Z dd� Z dd� Z
dd� Zdd� Zdd� Zdd� Zdd� Zd d � ZdS ) �S3ControlArnParamHandlerz�This handler has been replaced by S3ControlArnParamHandlerv2. The
original version remains in place for any third-party importers.
z[/:]Nc C s( || _ |d krt� | _ tjdtd� d S )Nz�The S3ControlArnParamHandler class has been deprecated for a new internal replacement. A future version of botocore may remove this class.r{ )r� rc r~ r r� r� rp rp rq r� s �z!S3ControlArnParamHandler.__init__c C s |� d| j� d S )Nz!before-parameter-build.s3-controlr� r� rp rp rq r7 s �z!S3ControlArnParamHandler.registerc K s: |j dkr| �|||� n | �|||� | �|||� d S )N)r� ZListRegionalBuckets)r� �_handle_outpost_id_param�_handle_name_param�_handle_bucket_param)r� rA r� r� r� rp rp rq r� s
z#S3ControlArnParamHandler.handle_arnc C sX ||kr d S z0|| }| j �|�}||d< | �|�|d< |W S tk
rR Y d S X d S )NrN � resources)r� r� �_split_resourcer� )r� rA r� r� r� rp rp rq �_get_arn_details_from_param' s z4S3ControlArnParamHandler._get_arn_details_from_paramc C s | j �|d �S )Nr� )�_RESOURCE_SPLIT_REGEXr� )r� r� rp rp rq r 3 s z(S3ControlArnParamHandler._split_resourcec C sF |d }d|kr:|d |kr:d� |d �}t|d |d��||d< d S )Nr� Z AccountIdzGAccount ID in arn does not match the AccountId parameter provided: "{}"rN r )r� r3 )r� rA r� Z
account_idr rp rp rq �_override_account_id_param6 s ���z3S3ControlArnParamHandler._override_account_id_paramc C s d|kr d S |d |d< d S )NZ OutpostIdr rp )r� rA r� r� rp rp rq r C s z1S3ControlArnParamHandler._handle_outpost_id_paramc C sX |j dkrd S | �|d�}|d kr&d S | �|�r@| �|||� nd}t|d |d��d S �NZCreateAccessPoint�Namez4The Name parameter does not support the provided ARNrN r )r� r �_is_outpost_accesspoint�_store_outpost_accesspointr3 �r� rA r� r� r� r rp rp rq r H s
�z+S3ControlArnParamHandler._handle_name_paramc C s@ |d dkrdS |d }t |�dkr(dS |d dko>|d d kS )
Nr� r� Fr r� r r� r� r� �r� �r� r� r rp rp rq r X s z0S3ControlArnParamHandler._is_outpost_accesspointc C sD | � ||� |d d }||d< ||d< |d d |d< ||d< d S )Nr r� r r� r5 r� r� �r )r� rA r� r� r� rp rp rq r a s z3S3ControlArnParamHandler._store_outpost_accesspointc C sJ | � |d�}|d krd S | �|�r2| �|||� nd}t|d |d��d S �Nr$ z6The Bucket parameter does not support the provided ARNrN r )r �_is_outpost_bucket�_store_outpost_bucketr3 r! rp rp rq r i s
��z-S3ControlArnParamHandler._handle_bucket_paramc C s@ |d dkrdS |d }t |�dkr(dS |d dko>|d d kS )
Nr� r� Fr r� r r� r� r r" r# rp rp rq r& x s z+S3ControlArnParamHandler._is_outpost_bucketc C sD | � ||� |d d }||d< ||d< |d d |d< ||d< d S )Nr r� r$ r� r5 r� r� r$ )r� rA r� r� r� rp rp rq r' � s z.S3ControlArnParamHandler._store_outpost_bucket)N)r� r� r� r� r� r� r r� r7 r� r r r r r r r r r& r' rp rp rp rq r s
r c @ sR e Zd ZdZddd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dS )�S3ControlArnParamHandlerv2a Updated version of S3ControlArnParamHandler for use when
EndpointRulesetResolver is in use for endpoint resolution.
This class is considered private and subject to abrupt breaking changes or
removal without prior announcement. Please do not use it directly.
Nc C s || _ |d krt� | _ d S r� r� r� rp rp rq r� � s z#S3ControlArnParamHandlerv2.__init__c C s |� d| j� d S )Nz%before-endpoint-resolution.s3-controlr� r� rp rp rq r7 � s �z#S3ControlArnParamHandlerv2.registerc C sl |j dkrd S | �|d�}|d kr&d S | �|� | �|� | �|�rT| �|||� nd}t|d |d��d S r )r� r � _raise_for_fips_pseudo_region� _raise_for_accelerate_endpointr r r3 r! rp rp rq r � s
�z-S3ControlArnParamHandlerv2._handle_name_paramc C s | � ||� d S r� r$ r� rp rp rq r � s z5S3ControlArnParamHandlerv2._store_outpost_accesspointc C s^ | � |d�}|d krd S | �|� | �|� | �|�rF| �|||� nd}t|d |d��d S r% )r r) r* r& r' r3 r! rp rp rq r � s
��z/S3ControlArnParamHandlerv2._handle_bucket_paramc C s | � ||� d S r� r$ r� rp rp rq r' � s z0S3ControlArnParamHandlerv2._store_outpost_bucketc C s0 |d }|� d�s |�d�r,t|d dd��d S )Nr� zfips-rN r� r )rD r� r3 )r� r� r rp rp rq r) � s �z8S3ControlArnParamHandlerv2._raise_for_fips_pseudo_regionc C s& |d j p i }|�d�r"tdd��d S )N�
client_configr� r r� )r� r~ r4 )r� r� r� rp rp rq r* � s
�z9S3ControlArnParamHandlerv2._raise_for_accelerate_endpoint)N) r� r� r� r� r� r7 r r r r' r) r* rp rp rp rq r( � s
r( c @ s| e Zd ZdZdZdZdZedddgZdej fd d
�Z
dd d �Z d
d� Z dd� Z
dd� Zdd� Zd dd�Zdd� Zdd� ZdS ) �ContainerMetadataFetcherr� r� r5 z
169.254.170.2z169.254.170.23z fd00:ec2::23� localhostNc C s( |d krt jj| jd�}|| _|| _d S )N)r� )r� r� r� �TIMEOUT_SECONDSr� �_sleep)r� rw �sleeprp rp rq r� � s �z!ContainerMetadataFetcher.__init__c C s | � |� | �||�S )z�Retrieve JSON metadata from container metadata.
:type full_url: str
:param full_url: The full URL of the metadata service.
This should include the scheme as well, e.g
"http://localhost:123/foo"
)�_validate_allowed_url�_retrieve_credentials)r� �full_urlr� rp rp rq �retrieve_full_uri� s
z*ContainerMetadataFetcher.retrieve_full_uric C sN t j�|�}| �|j�r d S | �|j�}|sJtd|j� dd�| j�� ���d S )NzUnsupported host 'zN'. Can only retrieve metadata from a loopback address or one of these hosts: z, ) r� �compatr �_is_loopback_addressr� �_check_if_whitelisted_hostr. r� �_ALLOWED_HOSTS)r� r3 �parsedZis_whitelisted_hostrp rp rq r1 � s �z.ContainerMetadataFetcher._validate_allowed_urlc C s, zt |�}|jW S tk
r& Y dS X d S )NF)r � is_loopbackr. )r� r� �iprp rp rq r6 s
z-ContainerMetadataFetcher._is_loopback_addressc C s || j krdS dS )NTF)r8 )r� r� rp rp rq r7 s
z3ContainerMetadataFetcher._check_if_whitelisted_hostc C s | � |�}| �|�S )z�Retrieve JSON metadata from container metadata.
:type relative_uri: str
:param relative_uri: A relative URI, e.g "/foo/bar?id=123"
:return: The parsed JSON response.
)r3 r2 )r� � relative_urir3 rp rp rq � retrieve_uri s
z%ContainerMetadataFetcher.retrieve_uric
C s� ddi}|d k r|� |� d}z| �||| j�W S tk
r� } z4tjd|dd� | �| j� |d7 }|| jkrr� W 5 d }~X Y q X q d S )N�Acceptzapplication/jsonr zAReceived error when attempting to retrieve container metadata: %sTr� r5 ) r� �
_get_responser. r+ r� r� r/ �
SLEEP_TIME�RETRY_ATTEMPTS)r� r3 �
extra_headersr� Zattemptsr rp rp rq r2 s(
��
z.ContainerMetadataFetcher._retrieve_credentialsc
C s� z�t jj}|d||d�}| j�|�� �}|j�d�}|jdkrVt d|j� d|� �d��zt
� |�W W S t k
r� d}t
�d ||� t |d��Y nX W n6 tk
r� } zd
| � �}t |d��W 5 d } ~ X Y nX d S ) Nr r� re r� zReceived non 200 response z from container metadata: r
z>Unable to parse JSON returned from container metadata servicesz%s:%sz?Received error when attempting to retrieve container metadata: )r� r� r� r� r� r� r r� r� r+ r r, r. r� r� r� )
r� r3 r� r� r� r� r� Z
response_textr r rp rp rq r? 0 s&
��z&ContainerMetadataFetcher._get_responsec C s d| j � |� �S )Nzhttp://)�
IP_ADDRESS)r� r< rp rp rq r3 J s z!ContainerMetadataFetcher.full_url)N)N)r� r� r� r. rA r@ rC r8 �timer0 r� r4 r1 r6 r7 r= r2 r? r3 rp rp rp rq r, � s$ �
r, c C s t | �r i S t� S d S r� )�should_bypass_proxiesr �r� rp rp rq r� N s r� c C s8 zt t| �j�rW dS W n ttjfk
r2 Y nX dS )z:
Returns whether we should bypass proxies or not.
TF)r r r� rr �socket�gaierrorrF rp rp rq rE U s
rE c C s� | sdS z
t | �W S ttfk
r* Y nX t| d�r�t| d�r�z0| �� }| �dd� | �� }| �|� || W S tjk
r� Y nX d S )Nr �seek�tellr� )r� �AttributeErrorrr r} rJ rI �io�UnsupportedOperation)r� Zorig_posZ end_file_posrp rp rq �determine_content_lengthj s
rN �
ISO-8859-1c C sJ | � d�}|sdS tj�� }||d< |�d�}|dk r:|S d|krF|S dS )z�Returns encodings from given HTTP Header Dict.
:param headers: dictionary to extract encoding from.
:param default: default encoding if the content-type is text
z content-typeN�charsetr� )r~ rO �messager � get_param)r� �default� content_typerQ rP rp rp rq �get_encoding_from_headers� s
rU c K s0 t | ttf�rt| �}nt| �}t�|��d�S )�KThis function has been deprecated, but is kept for backwards compatibility.r� )rj rf � bytearray�_calculate_md5_from_bytes�_calculate_md5_from_file�base64� b64encoder� )r� r� Z
binary_md5rp rp rq �
calculate_md5� s
r\ c C s t | �}|�� S )rV )r r� )Z
body_bytes�md5rp rp rq rX � s rX c sB � � � }t� }t� fdd�d�D ]}|�|� q � �|� |�� S )rV c s
� � d�S r� r� rp ��fileobjrp rq r� � r� z*_calculate_md5_from_file.<locals>.<lambda>r� )rJ r r� r� rI r� )r_ Zstart_positionr] r� rp r^ rq rY � s
rY c C s" | � di �� di �}|� d�dkS )Nr� r< r= r> r� )rA r< rp rp rq �_is_s3express_request� s
�r` c C s& | d }|D ]}t �|�r dS q dS )z�
Checks if a header starting with "x-amz-checksum-" is provided in a request.
This function is considered private and subject to abrupt breaking changes or
removal without prior announcement. Please do not use it directly.
r� TF)�CHECKSUM_HEADER_PATTERNr� )rA r� r{ rp rp rq �has_checksum_header� s
rb c K s$ t | �s t| f|� t| f|� dS )rV N)rb �conditionally_calculate_md5�conditionally_enable_crc32)rA r� rp rp rq � conditionally_calculate_checksum� s re c K sV | � di �� di �}|� d�}t| �rR| d dk rR|dkrRdddd d
�i| d d< dS ) rV r� r� �request_algorithmr� N)N�conditional-md5�crc32r{ zx-amz-checksum-crc32)� algorithm�inr� )r~ r` )rA r� �checksum_context�checksum_algorithmrp rp rq rd � s
�
����rd c K sv | d }| � di �� di �}|� d�}|r6|dkr6dS t| �rBdS t| �rNdS trr|dk rrt|f|�}|| d d< dS ) z�Only add a Content-MD5 if the system supports it.
This function has been deprecated, but is kept for backwards compatibility.
r� r� r� rf rg Nr� z Content-MD5)r~ rb r` r r\ )rA r� r� rk rl Z
md5_digestrp rp rq rc � s
rc c @ s e Zd Zefdd�Zdd� ZdS )�FileWebIdentityTokenLoaderc C s || _ || _d S r� )�_web_identity_token_pathrT )r� Zweb_identity_token_pathrT rp rp rq r�
s z#FileWebIdentityTokenLoader.__init__c
C s, | � | j��}|�� W 5 Q R � S Q R X d S r� )rT rn rP )r� Z
token_filerp rp rq �__call__
s z#FileWebIdentityTokenLoader.__call__N)r� r� r� �openr� ro rp rp rp rq rm
s rm c @ s2 e Zd Zd
dd�Zdd� Zd dd�Zd dd �ZdS )
�SSOTokenLoaderNc C s |d kr i }|| _ d S r� )r2 )r� r3 rp rp rq r�
s zSSOTokenLoader.__init__c C s$ |}|d k r|}t �|�d���� S )Nre )r� �sha1rg r� )r� � start_url� session_namerh rp rp rq �_generate_cache_key
s z"SSOTokenLoader._generate_cache_keyc C s | � ||�}|| j|< d S r� )ru r2 )r� rs r rt r� rp rp rq �
save_token
s zSSOTokenLoader.save_tokenc C s� | � ||�}t�d|� �� || jkrL|}|d k r6|}d|� d�}t|d��| j| }d|ksfd|kr|d|� d�}t|d��|S )Nz Checking for cached token at: z
Token for z does not existr
Z accessTokenZ expiresAtz is invalid)ru r� r� r2 r. )r� rs rt r� r� r r rp rp rq ro
s
zSSOTokenLoader.__call__)N)N)N)r� r� r� r� ru rv ro rp rp rp rq rq
s
rq c @ s@ e Zd ZdZdZddd�Zdd� Zdd � Zd
d � Zdd d
�Z dS )�EventbridgeSignerSetterr� r� Nc C s || _ || _|| _d S r� )r} r� r� )r� r� r� r� rp rp rq r� 1
s z EventbridgeSignerSetter.__init__c C s |� d| j� |� d| j� d S )Nz'before-parameter-build.events.PutEventsz before-call.events.PutEvents)r7 �check_for_global_endpoint�set_endpoint_urlr� rp rp rq r7 6
s � �z EventbridgeSignerSetter.registerc K s6 d|kr2|d }t �d|d � d|� �� ||d< d S )N�eventbridge_endpointzRewriting URL from r� r )r� r� r� rp rp rq ry ?
s z(EventbridgeSignerSetter.set_endpoint_urlc K s� |� d�}|d krd S t|�dkr,tdd��ts:tdd��|� d�}d }|d k rl|jr`tdd��|jrldg}| jd kr�td |� ��}|j |kr�td
d��| j
||d �}n| j}||d < d
|d< d S )NZ
EndpointIdr z+EndpointId must not be a zero length stringr� zqUsing EndpointId requires an additional dependency. You will need to pip install botocore[crt] before proceeding.r+ z>FIPS is not supported with EventBridge multi-region endpoints.r8 �https://z-EndpointId is not a valid hostname component.��endpoint_variant_tagsrz Zv4arb ) r~ r� r% r r, r� r� r� r r� �_get_global_endpoint) r� rA r� r� r� rB r} r� Zresolved_endpointrp rp rq rx E
sB
��
�
� �z1EventbridgeSignerSetter.check_for_global_endpointc C sN | j }|�| j�}|d kr | j}|j||d�}|d kr<| j}d|� d|� d�S )Nr| r{ z.endpoint.events.r� )r} Zget_partition_for_regionr� r� r� r� )r� r� r} r� r� r� rp rp rq r~ q
s �z,EventbridgeSignerSetter._get_global_endpoint)NN)N)
r� r� r� r� r� r� r7 ry rx r~ rp rp rp rq rw -
s
,rw c C s� | dkr dS t | �}|j�d�r*|jdkr.dS |j�d�}|d dkrJdS |dd � }t|�tt|��krndS td
d � |D ��S ) z�Does the URL match the S3 Accelerate endpoint scheme?
Virtual host naming style with bucket names in the netloc part of the URL
are not allowed by this function.
NFr� )�https�httpr� r r� r5 r� c s s | ]}|t kV qd S r� r� r� rp rp rq r� �
s z'is_s3_accelerate_url.<locals>.<genexpr>)r r� r� r� r� r� r� r� )r� Z url_partsr� r� rp rp rq �is_s3_accelerate_url�
s �� r� c @ sr e Zd ZdZej�ej�dddd��Zedfdd�Z d d
� Z
d d � Z d
d� Z dd� Z
dd� Zdd� Zddd�ZdS )�
JSONFileCachez�JSON file cache.
This provides a dict like interface that stores JSON serializable
objects.
The objects are serialized to JSON and stored in a file. These
values can be retrieved at a later time.
�~z.awsZbotor3 Nc C s || _ |d kr| j}|| _d S r� )� _working_dir�_default_dumps�_dumps)r� Z working_dirZ
dumps_funcrp rp rq r� �
s zJSONFileCache.__init__c C s t j|| jd�S )N)rS )r �dumpsr' )r� r� rp rp rq r� �
s z JSONFileCache._default_dumpsc C s | � |�}tj�|�S r� )�_convert_cache_keyr� r� �isfile)r� r� �
actual_keyrp rp rq � __contains__�
s
zJSONFileCache.__contains__c
C s\ | � |�}z,t|��}t�|�W 5 Q R � W S Q R X W n ttfk
rV t|��Y nX dS )z Retrieve value from a cache key.N)r� rp r �loadrR r. �KeyError)r� r� r� rU rp rp rq � __getitem__�
s
"zJSONFileCache.__getitem__c C s@ | � |�}zt|�}|�� W n tk
r: t|��Y nX d S r� )r� r �unlink�FileNotFoundErrorr� )r� r� r� Zkey_pathrp rp rq � __delitem__�
s
zJSONFileCache.__delitem__c C s� | � |�}z| �|�}W n& ttfk
r> td|� ���Y nX tj�| j�sZt�| j� t� t�
|tj tj B d�d��}|�
� |�|� W 5 Q R X d S )Nz3Value cannot be cached, must be JSON serializable: i� �w)r� r� rr r. r� r� �isdirr� �makedirs�fdopenrp �O_WRONLY�O_CREAT�truncate�write)r� r� r� Zfull_keyZ file_contentrU rp rp rq � __setitem__�
s
�
�zJSONFileCache.__setitem__c C s t j�| j|d �}|S )Nz.json)r� r� r� r� )r� r� � full_pathrp rp rq r� �
s z JSONFileCache._convert_cache_keyFc C s$ t |t�r |r|�� S |�d�S |S r+ r, r. rp rp rq r' �
s
z"JSONFileCache._serialize_if_needed)F)r� r� r� r� r� r� �
expanduserr� Z CACHE_DIRr� r� r� r� r� r� r� r' rp rp rp rq r� �
s r� c C s | d kr dS | � d�S )NFz--x-s3)r� r rp rp rq �is_s3express_bucket�
s r� ra zapp-meshzdirectory-service-datazglobal-acceleratorziot-events-dataz
iot-eventsz iot-wirelesszkinesis-analytics-v2z
lex-models-v2zlex-runtime-v2zpinpoint-sms-voicer zservice-catalog-appregistry)8r: r; Zappmeshr< r= r> r? r@ rA rB rC rD rF rE rG rH rI zds-datarJ rK rL rM rN rP rQ ZglobalacceleratorrR rS ziotevents-dataZ ioteventsZ iotwirelessrT Zkinesisanalyticsv2rU rV z lexv2-modelsrW z
lexv2-runtimerX rY r[ rZ r\ r] z sms-voicer^ r_ r` Z s3controlrb rc rd re zservicecatalog-appregistryrf rg )T)F)N)F)N)N)T)T)rO )�rZ r� r �
email.messagerO r� r� rL �loggingr� r7 r� rG rD r~ r� r{ � ipaddressr �pathlibr �urllib.requestr r Zdateutil.parserrs Z dateutil.tzr Zurllib3.exceptionsr r� Zbotocore.awsrequestZbotocore.httpsessionZbotocore.compatr r
r r r
r r r r r r r r r r r r r r r r Zbotocore.exceptionsr r r r! r" r# r$ r% r& r' r( r) r* r+ r, r- r. r/ r0 r1 r2 r3 r4 � getLoggerr� r� r r� r� rv Z
SAFE_CHARSr� r� r� r� Z
EVENT_ALIASESr� ra rr rx r� r� r� r� r� r� r� r� r� � Exceptionr� r� r� r r? rH rK rO rp rW rQ rd r_ rm rv rz r} r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r r r r r r0 rF rz r. r� rc r� r� r� r r( r, r� rE rN rU r\ rX rY r` rb re rd rc rm rq rw r� r� r� ZSERVICE_NAME_ALIASESZ.CLIENT_NAME_TO_HYPHENIZED_SERVICE_ID_OVERRIDESrp rp rp rq �<module>
s @d
��H�
D B& & 0- !d
�
�
@! ")0 I 3 U W Mw
!S!E
�