a
lj @ sT d Z ddlZddlZddlZddlZddlmZmZmZ ddl m
Z
m Z ddl m
Z
ddlmZ ddlmZ ddlmZ dd lmZ dd
lmZ dd lmZmZmZ dd l m Z m Z m Z e e!Z"e ee# d
ddZ$e ee%ee& dddZ'e%e%dddZ(e%e%e%dddZ)e ee%dddZ*eee d d d Z+G d d d Z,G d!d" d"Z-dS )#z)Download files with progress indicators.
N)IterableOptionalTuple)CONTENT_CHUNK_SIZEResponse)DownloadProgressProvider)NetworkConnectionError)PyPI)Link)
is_from_cache)
PipSession)HEADERSraise_for_statusresponse_chunks) format_sizeredact_auth_from_urlsplitext)respreturnc
C s0 zt | jd W S tttfy* Y d S 0 d S )Nzcontent-length)intheaders
ValueErrorKeyError TypeError)r r B/usr/lib/python3.9/site-packages/pip/_internal/network/download.py_get_http_response_size s r )r link progress_barr c C s t | }|jtjkr |j}n|j}t|}|r>d|t|}t | rTt
d| n t
d| t
t
jkrtd}n*t | rd}n |sd}n|dkrd}nd}t| t}|s|S t||d|S )Nz{} ({})zUsing cached %szDownloading %sFTi@ )max)r netlocr Zfile_storage_domainZshow_urlZurl_without_fragmentr formatr r loggerinfoZgetEffectiveLevelloggingINFOr r r )r r r Z total_lengthurlZ
logged_urlZ
show_progresschunksr r r _prepare_download s.
r( )filenamer c C s t j| S )zJ
Sanitize the "filename" value from a Content-Disposition header.
)ospathbasename)r) r r r sanitize_content_filenameG s r- )content_dispositiondefault_filenamer c C s, t | \}}|d}|r$t|}|p*|S )z
Parse the "filename" value from a Content-Disposition header, and
return the default filename if the result is empty.
r) )cgiZ parse_headergetr- )r. r/ Z_typeparamsr) r r r parse_content_dispositionN s
r3 )r r r c C s |j }| jd}|r t||}t|d }|sPt| jdd}|rP||7 }|s~|j| jkr~tj | jd }|r~||7 }|S )zoGet an ideal filename from the given HTTP response, falling back to
the link filename if not provided.
zcontent-disposition z content-type )
r) r r1 r3 r mimetypesZguess_extensionr& r* r+ )r r r) r. extr r r _get_http_response_filename\ s
r8 )sessionr r c C s. |j ddd }| j|tdd}t| |S )N#r4 r T)r stream)r& splitr1 r
r )r9 r Z
target_urlr r r r _http_get_downloadq s r= c @ s8 e Zd ZeeddddZeeeeef dddZdS )
DownloaderNr9 r r c C s || _ || _d S N_session
_progress_barselfr9 r r r r __init__y s zDownloader.__init__)r locationr c
C s zt | j|}W n8 tyH } z td|jj| W Y d}~n
d}~0 0 t||}tj
||}t ||| j }t
|d$}|D ]} || qW d n1 s0 Y |jdd}
||
fS )z.Download the file given by link into location. HTTP error %s while getting %sNwb Content-Typer5 r= rB r r" ZcriticalZresponseZ status_coder8 r* r+ joinr( rC openwriter r1 ) rE r rG r er) filepathr' content_filechunk content_typer r r __call__ s
*zDownloader.__call__) __name__
__module__ __qualname__r strrF r
r rT r r r r r> x s
r> c @ sH e Zd ZeeddddZee eeeeeeef f dddZ dS )BatchDownloaderNr? c C s || _ || _d S r@ rA rD r r r rF s zBatchDownloader.__init__)linksrG r c c s |D ]}zt | j|}W n8 tyP } z td|jj| W Y d}~n
d}~0 0 t||}tj
||}t ||| j }t
|d$} |D ]}
| |
qW d n1 s0 Y |jdd} ||| ffV qdS )z0Download the files given by links into location.rH NrI rJ r5 rK ) rE rZ rG r r rO r) rP r' rQ rR rS r r r rT s$
*zBatchDownloader.__call__)
rU rV rW r rX rF r r
r rT r r r r rY s rY ).__doc__r0 r$ r6 r* typingr r r Zpip._vendor.requests.modelsr r Z pip._internal.cli.progress_barsr Zpip._internal.exceptionsr Zpip._internal.models.indexr Zpip._internal.models.linkr
Zpip._internal.network.cacher Z pip._internal.network.sessionr Zpip._internal.network.utilsr
r r Zpip._internal.utils.miscr r r Z getLoggerrU r" r r rX bytesr( r- r3 r8 r= r> rY r r r r s6
)