T d Z ddlmZmZmZmZ ddlmZmZm Z m
Z
m Z m Z m
Z
mZ ddlmZmZmZ ddlZddlZddlZddlZddlmZ ddlmZ dd l m Z m Z m Z dd
l m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1 dd l2m3Z3m4Z4 ddl5Z5ddl6Z6ddl7Z7ddl8Z8ddl9Z9ddl:Z:ddl;Z;ddlZ>dd lmZ erdd
l?m@Z@ ndd
lAm@Z@ ddlBZBddlBmCZC dZDn
# eE$ r dZDY nw xY wg dZFe:jG dd ZHdaIde9jJ fdZKd ZLg ZMdidZNd ZOer e8jP de8jQ ZRn e8jP d ZRd ZS G d deT ZU G d d eT ZVd ZW G d d eT ZX G d d!eX ZY G d" d#eX ZZ G d$ d%eX Z[d& Z\ G d' d(eX Z] G d) d*eT Z^ G d+ d,e^ Z_ G d- d.eT Z` G d/ d0e`eX Za G d1 d2e`eX Zbe6jc Zd G d3 d4eT Ze G d5 d6eXee Zf G d7 d8eXee Zg G d9 d:eX Zh G d; d d?eh ZkeFl d? G d@ dAeX Zm G dB dCeX ZndD ZodE Zp G dF dGeX ZqdH Zr G dI dJeX Zs G dK dLes ZtdMZue6jv dNk r ddOlwmxZxmyZy ndP ZxdQ Zyi Zz G dR dSeT Z{ G dT dUe{ Z|da}dV Z~dadW ZdadX ZdadY Z G dZ d[eT Zd\ Zd] Zd^ Ze:j d_k rdd`lmZmZ da Zdb Zdc Zdd ZdS e6jv dNk rde Zdf Zdg Zdh ZdS eZeZdS )ja
Ported using Python-Future from the Python 3.3 standard library.
An extensible library for opening URLs using a variety of protocols
The simplest way to use this module is to call the urlopen function,
which accepts a string containing a URL or a Request object (described
below). It opens the URL and returns the results as file-like
object; the returned object has some extra methods described below.
The OpenerDirector manages a collection of Handler objects that do
all the actual work. Each Handler implements a particular protocol or
option. The OpenerDirector is a composite object that invokes the
Handlers needed to open the requested URL. For example, the
HTTPHandler performs HTTP GET and POST requests and deals with
non-error returns. The HTTPRedirectHandler automatically deals with
HTTP 301, 302, 303 and 307 redirect errors, and the HTTPDigestAuthHandler
deals with digest authentication.
urlopen(url, data=None) -- Basic usage is the same as original
urllib. pass the url and optionally data to post to an HTTP URL, and
get a file-like object back. One difference is that you can also pass
a Request instance instead of URL. Raises a URLError (subclass of
IOError); for HTTP errors, raises an HTTPError, which can also be
treated as a valid response.
build_opener -- Function that creates a new OpenerDirector instance.
Will install the default handlers. Accepts one or more Handlers as
arguments, either instances or Handler classes that it will
instantiate. If one of the argument is a subclass of the default
handler, the argument will be installed instead of the default.
install_opener -- Installs a new opener as the default opener.
objects of interest:
OpenerDirector -- Sets up the User Agent as the Python-urllib client and manages
the Handler classes, while dealing with requests and responses.
Request -- An object that encapsulates the state of a request. The
state can be as simple as the URL. It can also include extra HTTP
headers, e.g. a User-Agent.
BaseHandler --
internals:
BaseHandler and parent
_call_chain conventions
Example usage:
import urllib.request
# set up authentication info
authinfo = urllib.request.HTTPBasicAuthHandler()
authinfo.add_password(realm='PDQ Application',
uri='https://mahler:8092/site-updates.py',
user='klem',
passwd='geheim$parole')
proxy_support = urllib.request.ProxyHandler({"http" : "http://ahad-haam:3128"})
# build a new opener that adds authentication and caching FTP handlers
opener = urllib.request.build_opener(proxy_support, authinfo,
urllib.request.CacheFTPHandler)
# install it
urllib.request.install_opener(opener)
f = urllib.request.urlopen('http://www.python.org/')
)absolute_importdivisionprint_functionunicode_literals)bytesdictfilterinputintmapopenstr)PY2PY3raise_with_tracebackN)email)client )URLError HTTPErrorContentTooShortError)urlparseurlspliturljoinunwrapquoteunquote splittype splithost splitport splituser splitpasswd splitattr
splitquery
splitvaluesplittagto_bytes
urlunparse)
addinfourl addclosehook)r )Iterable)
SSLContextTF) RequestOpenerDirector BaseHandlerHTTPDefaultErrorHandlerHTTPRedirectHandlerHTTPCookieProcessor ProxyHandlerHTTPPasswordMgr HTTPPasswordMgrWithDefaultRealmAbstractBasicAuthHandlerHTTPBasicAuthHandlerProxyBasicAuthHandlerAbstractDigestAuthHandlerHTTPDigestAuthHandlerProxyDigestAuthHandler HTTPHandler FileHandler
FTPHandlerCacheFTPHandlerUnknownHandlerHTTPErrorProcessorurlopeninstall_opener build_opener pathname2url url2pathname
getproxies urlretrieve
urlcleanup URLopenerFancyURLopener c D d|v r |d }|d= nd}d|v r |d }|d= nd }d|v r |d }|d= nd }|s|s|rt st d t j t j }|xj t j z c_ t j |_ |s|r| || n|
t |d }t | } n t t xa
} nt } | | || S )N cadefaultFcapathcafilezSSL support not availableTcontextcheck_hostname) _have_ssl
ValueErrorsslr, PROTOCOL_SSLv23options OP_NO_SSLv2
CERT_REQUIRED verify_modeload_verify_locationsset_default_verify_paths HTTPSHandlerrD _openerr
)
urldatatimeout _3to2kwargsrN rO rP rR
https_handleropeners
q/builddir/build/BUILD/cloudlinux-venv-1.0.10/venv/lib/python3.11/site-packages/future/backports/urllib/request.pyrB rB sU k!!{;/G9[YdMeMe); X)>KPXDYDY&; X)>KPXDYDY&
9 : 899 9.!4553?* ! / /V / ) )&& 9 9 9 9 , , . . .$WTJJJ
m,, '>>)&& ;;sD' * ** c
| a d S N)r_ )re s rf rC rC s GGGrg c L t | \ }}t j t | | 5 }| }|dk r/|s-t
j | |fcddd S |rt |d }n6t j
d }|j }t
| |5 ||f} d}
d} d} d}
d |v rt |d
} |r
||
|
| | |
}|sn<| t! | z
} | | |
d z
}
|r
||
|
| T ddd n # 1 swxY w Y ddd n # 1 swxY w Y | dk r| | k rt% d
| | fz | | S )aW
Retrieve a URL into a temporary location on disk.
Requires a URL argument. If a filename is passed, it is used as
the temporary file location. The reporthook argument should be
a callable that accepts a block number, a read size, and the
total file size of the URL target. The data argument should be
valid URL encoded data.
If a filename is passed and the URL points to a local resource,
the result is a copy from local file to new file.
Returns a tuple containing the path to the newly created
data file as well as the resulting HTTPMessage object.
fileNwbF)delete r content-lengthContent-LengthTr 1retrieval incomplete: got only %i out of %i bytes)r
contextlibclosingrB infoospathnormpathr
tempfileNamedTemporaryFilename_url_tempfilesappendr readlenwriter )r` filename
reporthookra url_typerw fpheaderstfpresultbssizer~ blocknumblocks rf rH rH s s^^NHd GC . . / / $32'')) v h 7##D))72
$3 $3 $3 $3 $3 $3 $3 $3 ,x&&CC-U;;;CxH ! !( + + +
3 3 w&FBDDH 7**7#3455
/
8R...
3 E
" % A
3 JxT222
3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3!$3 $3 $3 $3 $3 $3 $3 $3 $3 $3 $3 $3 $3 $3 $3L qyyTD[[" ?Tl
"$ $ $ Ms= =E8?A E8
B
E! E8!E% %E8(E% )E88E<?E<c t D ]'} t j | # t $ r Y $w xY wt d d = t rd ad S d S ri )r| rv unlinkEnvironmentErrorr_ ) temp_files rf rI rI sr # Ii D qqq s
--z:\d+$c | j }t | d }|dk r| dd }t d|d }| S )zReturn request-host, as defined by RFC 2965.
Variation from RFC: returned value is lowercased, for convenient
comparison.
r Host)full_urlr
get_header _cut_port_resublower)requestr` hosts rf request_hostr sa
C C== D rzz!!&"-- Ba ( (D ::<<rg c e Zd Zdi dddfdZd Zd Zd Zd Zd Zd Z d
Z
d Z d Z d
Z
d Zd Zd Zd Zd Zd ZddZd ZdS )r- NFc | t | | _ t | j \ | _ | _ || _ i | _ d | _ | D ]\ }}| || i | _ |t | }|| _ || _ || _
| d S ri )r r r& fragmentra r _tunnel_hostitems
add_headerunredirected_hdrsr origin_req_host unverifiablemethod_parse) selfr` ra r r r r keyvalues rf __init__zRequest.__init__ s s
'/
'>'>$
t} !--// ( (JC OOC ' ' ' '!# " *4 0 0O . (
rg c t | j \ | _ }| j t d| j z t | \ | _ | _ | j rt | j | _ d S d S )Nzunknown url type: %r)r r typerU r r selectorr )r rests rf r zRequest._parse. sr #DM22 4 9 3dm CDD D#,T?? 4= 9 + **DIII + +rg c 4 | j | j S | j dS dS )z3Return a string indicating the HTTP request method.NPOSTGET)r ra r s rf
get_methodzRequest.get_method6 s$ ; ";
Y
"65rg c @ | j r| j d| j S | j S )N#)r r r s rf get_full_urlzRequest.get_full_url? s) = ! "mmmT]]; ;= rg c P d}t j |t d || _ d S )Nz&Request.add_data method is deprecated.r
stacklevelwarningswarnDeprecationWarningra )r ra msgs rf add_datazRequest.add_dataG s* 6
c-!<<<< rg c P d}t j |t d | j d uS )Nz&Request.has_data method is deprecated.r r r r r s rf has_datazRequest.has_dataL s, 6
c-!<<<<y$$rg c L d}t j |t d | j S )Nz&Request.get_data method is deprecated.r r r r s rf get_datazRequest.get_dataQ ' 6
c-!<<<<yrg c L d}t j |t d | j S )Nz&Request.get_type method is deprecated.r r )r r r r r s rf get_typezRequest.get_typeV r rg c L d}t j |t d | j S )Nz&Request.get_host method is deprecated.r r )r r r r r s rf get_hostzRequest.get_host[ r rg c L d}t j |t d | j S )Nz*Request.get_selector method is deprecated.r r )r r r r r s rf get_selectorzRequest.get_selector` s' :
c-!<<<<} rg c L d}t j |t d | j S )Nz-Request.is_unverifiable method is deprecated.r r )r r r r r s rf is_unverifiablezRequest.is_unverifiablee s( =
c-!<<<< rg c L d}t j |t d | j S )Nz1Request.get_origin_req_host method is deprecated.r r )r r r r r s rf get_origin_req_hostzRequest.get_origin_req_hostj s( A
c-!<<<<##rg c x | j dk r| j s
| j | _ n|| _ | j | _ || _ d S )Nhttps)r r r r r )r r r s rf set_proxyzRequest.set_proxyq s? 9 (9 $ D DI MDM rg c " | j | j k S ri )r r r s rf has_proxyzRequest.has_proxyy s }
--rg c > || j | < d S ri )r
capitalizer r vals rf r zRequest.add_header| s ), S^^%%&&&rg c > || j | < d S ri )r r r s rf add_unredirected_headerz Request.add_unredirected_header s 36 s~~ / /000rg c & || j v p|| j v S ri )r r )r header_names rf
has_headerzRequest.has_header s! t|+ 6t 55 7rg c j | j || j || S ri )r getr )r r defaults rf r zRequest.get_header s5 | " & &{G < <> > >rg c | j }| | j t | S ri )r copyupdater listr )r hdrss rf header_itemszRequest.header_items s@ %**,, DL!!!DJJLL!!!rg ri )__name__
__module__ __qualname__r r r r r r r r r r r r r r r r r r r rg rf r- r- sH !%r!%E &+ + + ! ! !
% % %
! ! !
$ $ $ . . .- - -7 7 77 7 7> > > >
" " " " "rg r- c J e Zd Zd Zd Zd Zd Zdej fdZ d dZ
d Z dS )
r. c t dt z }d|fg| _ g | _ i | _ i | _ i | _ i | _ d S )NPython-urllib/%sz
User-agent) __version__
addheadershandlers handle_open handle_errorprocess_responseprocess_request)r client_versions rf r zOpenerDirector.__init__ sH +k9 (.9:
" ! rg c L t |d s t dt | z d}t | D ].}|dv r| d }|d | }||dz d }| d ro| d |z dz }||dz d } t
| }n# t $ r Y nw xY w| j |i } | | j |< n1|dk r
|}| j
} n!|d k r
|}| j } n|d
k r
|}| j } n|
|g }
|
rt j |
| n|
| d }0|r1t j | j | | | d S d S ) N
add_parentz%expected BaseHandler instance, got %rF)redirect_requestdo_open
proxy_open_r errorr
responser T)hasattr TypeErrorr dirfind
startswithr rU r r r r r
setdefaultbisectinsortr} r r ) r handleraddedmethiprotocol conditionjkindlookupr s rf add_handlerzOpenerDirector.add_handler s w -- + C MM * + +
+ LL # # DDDD #ABQBxH QqSTT
I##G,,
NN3''!+a/AaCDDz t99DD! D *..x<<.4!(++f$$ )j(( .i'' - ((r22H
)
h0000(((EE % M$- 1 1 1 t $ $ $ $ $ % %s 3C
CCc d S ri r r s rf closezOpenerDirector.close rg c r | |d }|D ] }t || } || }||c S d S )Nr )r getattr) r chainr meth_nameargsr r funcr s rf _call_chainzOpenerDirector._call_chain s^ 99T2&& G7I..DT4[F!
" rg Nc t |t r| }t |t rt || }n |}|||_ ||_ |j }|dz }| j |g D ] }t || } || } | || } |dz }| j |g D ] }t || } ||| } | S )z
Accept a URL or a Request object
Python-Future: if the URL is passed as a byte-string, decode it first.
N_request _response)
isinstancer decoder r- ra rb r r r r _openr )
r fullurlra rb reqr r processorr r s
rf r
zOpenerDirector.open s gu % % ' nn&&G gs # # '4((CCC 8 Z' -11(B?? I9i00D$s))CC::c4(( [( .228R@@ + +I9i00DtC**HHrg c | | j dd| }|r|S |j }| | j ||dz | }|r|S | | j dd| S )Nr default_openr unknown unknown_open)r r r )r r ra r r s rf r zOpenerDirector._open s !!$"2I"0#7 7 M8!!$"2Hh")?*+.0 0 M 0) .5 5 5rg c |dv r | j d }|d }d|z }d}|}n| j }|dz }d}|||f|z } | j | }|r|S |r|dd f|z } | j | S d S )
Nhttpr r( z
http_error_%sr _errorr r http_error_default)r r )r protor r r http_err orig_argsr s rf r zOpenerDirector.error
s % % %$V,DGE'%/IH II$D (IHeY'$.!!4( M +)%9:YFD#4#T* * + +rg ri ) r r r r r r r socket_GLOBAL_DEFAULT_TIMEOUTr
r r r rg rf r. r. s " " "-% -% -%^
"&v/M D
5
5
5
5 + + + + +rg r. c d }t }t t t t t
t t t g}t t d r| t t }|D ]]}| D ]X} || r&t || r| | 3t! || r| | Y^|D ]}| | |D ] }| | | D ],} || r
| }| | -|S )a* Create an opener object from a list of handlers.
The opener will use several default handlers, including support
for HTTP, FTP and when applicable HTTPS.
If any of the handlers passed as arguments are subclasses of the
default handlers, the default handlers will not be used.
c L t | t pt | d S )N __bases__)r r r )objs rf isclassz build_opener..isclass/ s! #t$$A[(A(AArg HTTPSConnection)r. r3 r@ r< r0 r1 r> r= rA r http_clientr} r^ set
issubclassaddr remover )r r5 re default_classesskipklasscheckhs rf rD rD & s B B B
F#^[.0C!;0BDO { -.. - |,,, 55D Ewu~~
eU++ $HHUOOOE5))
& & u%%%% $ $5577####
71:: A1 Mrg c $ e Zd ZdZd Zd Zd ZdS )r/ c || _ d S ri )parent)r rD s rf r zBaseHandler.add_parentO s
rg c d S ri r r s rf r zBaseHandler.closeR r rg c F t |d sdS | j |j k S )N
handler_orderT)r rG )r others rf __lt__zBaseHandler.__lt__V s, uo.. 4!E$777rg N)r r r rG r r rI r rg rf r/ r/ L sF M
8 8 8 8 8rg r/ c e Zd ZdZdZd ZeZdS )rA z Process HTTP error responses.i c |j |j | }}}d|cxk rdk s!n | j d||||| }|S )N , r( )coder ru rD r )r r r rN r r s rf
http_responsez HTTPErrorProcessor.http_responsec sg "- x}}4c t!!!!c!!!!{((4d< z7HTTPRedirectHandler.redirect_request.. sI ? ?TQ WWYYo = = a& = = = =? ?rg T)r r r ) r r r replacer r r r- r )
r r r rN r r newurlm
newheadersra s
@rf r z$HTTPRedirectHandler.redirect_request| s
NN ---!2F2F&&1;;CL$WbAA A U++< ? ? ? ?S[->->-@-@ ? ? ? ? ?
v )'*':$(* * * *rg c , d|v r |d }nd|v r |d }nd S t | }|j dvrt |||d|d|| |j st | }d|d< t | }t
|j | }| |||||| }|d S t |d rf|j
x} |_
| |d | j k st | | j k r t |j || j |z || ni x} x|_
|_
| |d d
z | |< | | | j ||j S ) Nlocationurir( r ftpr z - Redirection to url 'z' is not allowed/r)
redirect_dictr r rb )r schemer rw r r( r r r r rm r max_repeatsr max_redirectionsinf_msgr~ r rD r
rb )
r r r rN r r rd urlpartsnewvisiteds
rf http_error_302z"HTTPRedirectHandler.http_error_302 s Z(FF
g
U^FF F F##
?"> > >ADfffM
} H~~H HQKH%% v..
##CT3HH ; F 3 ( ( A*-*; ;Gc' FA&&$*:::G 555 d $ s 2GRA A A 6 ?A @G @c'#*;!++fa0014
{ S[ 999rg zoThe HTTP server returned a redirect error that would lead to an infinite loop.
The last 30x error message was:
N) r r r rp rq r rv http_error_301http_error_303http_error_307rr r rg rf r1 r1 t sV K * * *D5: 5: 5:n 8FENE^n2GGGrg r1 c Z t | \ }}| d sd}| }nO| d st d| z | dd }|dk rd}|d| }t | \ }}|t | \ }}ndx}}||||fS )a3 Return (scheme, user, password, host/port) given a URL or an authority.
If a URL is supplied, it must have an authority (host:port) component.
According to RFC 3986, having an authority component means the URL must
have two slashes after the scheme:
>>> _parse_proxy('file:/ftp.example.com/')
Traceback (most recent call last):
ValueError: proxy URL with no authority: 'file:/ftp.example.com/'
The first three items of the returned tuple may be None.
Examples of authority parsing:
>>> _parse_proxy('proxy.example.com')
(None, None, None, 'proxy.example.com')
>>> _parse_proxy('proxy.example.com:3128')
(None, None, None, 'proxy.example.com:3128')
The authority component may optionally include userinfo (assumed to be
username:password):
>>> _parse_proxy('joe:password@proxy.example.com')
(None, 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('joe:password@proxy.example.com:3128')
(None, 'joe', 'password', 'proxy.example.com:3128')
Same examples, but with URLs instead:
>>> _parse_proxy('http://proxy.example.com/')
('http', None, None, 'proxy.example.com')
>>> _parse_proxy('http://proxy.example.com:3128/')
('http', None, None, 'proxy.example.com:3128')
>>> _parse_proxy('http://joe:password@proxy.example.com/')
('http', 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('http://joe:password@proxy.example.com:3128')
('http', 'joe', 'password', 'proxy.example.com:3128')
Everything after the authority is ignored:
>>> _parse_proxy('ftp://joe:password@proxy.example.com/rubbish:3128')
('ftp', 'joe', 'password', 'proxy.example.com')
Test for no trailing '/' case:
>>> _parse_proxy('http://joe:password@proxy.example.com')
('http', 'joe', 'password', 'proxy.example.com')
rl N//z proxy URL with no authority: %rr) ro )r r rU r r! r" ) proxyro r_scheme authorityenduserinfohostportuserpasswords rf _parse_proxyr s d !''FH s # #
$ ""4(( H > FGG G mmC## "99C QsUO "9--Hh$X..hh x 48 ++rg c e Zd ZdZddZd ZdS )r3 d Nc |t }t |d s
J d || _ | D ]#\ }}t | d|z ||| j fd $d S )Nkeysproxies must be a mappingz%s_openc || || S ri r )rr| r r s rf z'ProxyHandler.__init__../ s Qt,, rg )rG r proxiesr setattrr )r r r r` s rf r zProxyHandler.__init__( s ? llGw''DD)DDD' . .ID# D)d*$'d - - -
.
.
.
. . .rg c |j }t | \ }}}}||}|j rt |j rd S |ru|rst | dt | } t j | d }
| dd|
z t | }|
|| ||k s|dk rd S | j ||j
S )N:asciiProxy-authorizationBasic r rn )r r r proxy_bypassr base64 b64encodeencoder r r rD r
rb ) r r r| r orig_type
proxy_typer r r user_passcredss rf r zProxyHandler.proxy_open2 s H /;E/B/B,
D(H "J 8 SX.. 4 DH D#*4====#*8#4#4#46I$Y%5%5%7%788??HHE NN0(U2B C C C8$$
h
+++
" "i7&:&:4 ;##C#== =rg ri )r r r rG r r r rg rf r3 r3 $ s< M. . . .> > > > >rg r3 c . e Zd Zd Zd Zd ZddZd ZdS ) r4 c i | _ d S ri )passwdr s rf r zHTTPPasswordMgr.__init__P s
rg c t |t r|g}| j vr
i j |< dD ]0t fd|D }||f j | |< 1d S )NTFc < g | ]} | S r )
reduce_uri)r^ u default_portr s rf
z0HTTPPasswordMgr.add_password..[ s' ???a L11???rg )r r r tuple)r realmri r r reduced_urir s ` @rf add_passwordz HTTPPasswordMgr.add_passwordS s c3 %C # #!#DK ' = =L ?????3???A AK/3VnDK { + + = =rg c | j |i }dD ]U}| || }| D ](\ }}|D ] }| || r|c c c S !)VdS )Nr NN)r r r r is_suburi) r r authuridomainsr reduced_authuriurisauthinfori s rf find_user_passwordz"HTTPPasswordMgr.find_user_password^ s +//%,, ' ( (L "oog| D DO")--//
(
(h ( (C~~c?;; ( '((
( zrg Tc t | }|d r|d }|d }|d pd}nd}|}d}t | \ }}|r%|#|!ddd | } | d || fz }||fS )
z@Accept authority or URI and extract only the authority and path.r r r) rl NP i r' z%s:%d)r r r )
r ri r partsro r~ rw r portdports
rf r zHTTPPasswordMgr.reduce_urih s
8 1XF aI8?sDD FID y))
d 4DLV-? ! s6{{
#tUm 3 $ rg c ||k rdS |d |d k rdS t j |d |d f }t | t |d k rdS dS )zcCheck if test is below base in a URI tree
Both args must be URIs in reduced form.
Tr Fr ) posixpath commonprefixr )r basetestcommons rf r zHTTPPasswordMgr.is_suburi sl
4<<4 7d1g 5'a$q'(:;; v;;#d1g,, & &4urg N)T)r r r r r r r r r rg rf r4 r4 N sd = = = . rg r4 c e Zd Zd ZdS )r5 c t | || \ }}|||fS t | d | S ri )r4 r )r r r r r s rf r z2HTTPPasswordMgrWithDefaultRealm.find_user_password sL (;;D% ! 11$gFFFrg N)r r r r r rg rf r5 r5 s( G G G G Grg r5 c T e Zd Z ej dej ZddZd Zd Z d Z
dS )r6 z1(?:.*,)*[ ]*([^ ]+)[ ]+realm=(["']?)([^"']*)\2Nc d |t }|| _ | j j | _ d| _ d S Nr )r4 r r retried)r password_mgrs rf r z!AbstractBasicAuthHandler.__init__ s2 *,,L" K 4 rg c d| _ d S r r r s rf reset_retry_countz*AbstractBasicAuthHandler.reset_retry_count
rg c | |d }| j dk r%t | dd|d | xj dz
c_ |r| d }| dk rt
d|z t j | }|r~|
\ }}}|dvrt j d t d
| dk r1| ||| } | r| j dk rd| _ | S d S d S d S ) N zbasic auth failedr r basiczDAbstractBasicAuthHandler does not support the following scheme: '%s')"'z Basic Auth Realm was unquotedr) )r r r r splitr rU r6 rxsearchgroupsr r UserWarningretry_http_basic_authrN )
r authreqr r r ro mor r r s
rf http_error_auth_reqedz.AbstractBasicAuthHandler.http_error_auth_reqed sn ++gt,, >b
> !TT22&Cf .szz|| < < C CG L LLD{t /66$>>t ' '(8$ ? ? ?;##C#== =4rg ri ) r r r recompileIr r r r r r rg rf r6 r6 su
124$
8
8B ( ( (@
rg r6 c e Zd ZdZd ZdS )r7
Authorizationc l |j }| d||| }| |S )Nwww-authenticate)r r r )r r r rN r r r` r s rf http_error_401z#HTTPBasicAuthHandler.http_error_401 s? l--.@*-sG= = rg N)r r r r r r rg rf r7 r7 s( !K rg r7 c e Zd ZdZd ZdS )r8 r c l |j }| d||| }| |S Nproxy-authenticater r r )r r r rN r r r~ r s rf http_error_407z$ProxyBasicAuthHandler.http_error_407 sC
H --.B*3S'C C rg N)r r r r r r rg rf r8 r8 s( 'K rg r8 c @ e Zd Zd
dZd Zd Zd Zd Zd Zd Z d Z
dS ) r9 Nc |t }|| _ | j j | _ d| _ d| _ d | _ d S r )r4 r r r nonce_count
last_nonce)r r s rf r z"AbstractDigestAuthHandler.__init__ s@ >$&&F K 4 rg c d| _ d S r r r s rf r z+AbstractDigestAuthHandler.reset_retry_count r rg c | |d }| j dk rt |j dd|d | xj dz
c_ |rr| d }| dk r| || S | dk rt d|z d S d S ) Nr r zdigest auth failedr r digestr zEAbstractDigestAuthHandler does not support the following scheme: '%s')r r r r r r retry_http_digest_authrU )r r r r r r ro s rf r z/AbstractDigestAuthHandler.http_error_auth_reqed s ++k400 > >
#'$$uuuclll")''+ - Of, ,D - Of, ,D "Y.. I DH HD s AA
A"!A"c < |dk rd n |dk rd fd}|fS )Nr
c t t j | d S Nr )r md5r r xs rf r z?AbstractDigestAuthHandler.get_algorithm_impls..~ s( '+ahhw&7&788BBDD rg SHAc t t j | d S r )r r r r r s rf r z?AbstractDigestAuthHandler.get_algorithm_impls.. s( ',qxx'8'899CCEE rg c $ | d| S )Nr r )r dr s rf r z?AbstractDigestAuthHandler.get_algorithm_impls.. s !!qqq!! ,-- rg r )r r r r s @rf r z-AbstractDigestAuthHandler.get_algorithm_impls{ sB DDAA
%
EEA
-
-
-
-"u rg c d S ri r )r ra r s rf r z+AbstractDigestAuthHandler.get_entity_digest s trg ri ) r r r r r r r r r r r r rg rf r9 r9 s I I I(
: : :x rg r9 c e Zd ZdZdZdZd ZdS )r: zAn authentication protocol defined by RFC 2069
Digest authentication improves on basic authentication because it
does not transmit passwords in the clear.
r c t |j d }| d||| }| |S )Nr r )r r r r r r r rN r r r retrys rf r z$HTTPDigestAuthHandler.http_error_401 sL %%a(**+=+/g? ? rg N)r r r rP r rG r r rg rf r: r: s9 "KM rg r: c e Zd ZdZdZd ZdS )r; Proxy-Authorizationr' c l |j }| d||| }| |S r r r) s rf r z%ProxyDigestAuthHandler.http_error_407 s? x**+?+/g? ? rg N)r r r r rG r r rg rf r; r; s- 'KM rg r; c ( e Zd ZddZd Zd Zd ZdS )AbstractHTTPHandlerr c || _ d S ri _debuglevel)r
debuglevels rf r z AbstractHTTPHandler.__init__ s %rg c || _ d S ri r1 )r levels rf set_http_debuglevelz'AbstractHTTPHandler.set_http_debuglevel s rg c |j }|st d |j 0|j }t |t rd}t | | d s| dd | d sd } t r2t |t j rt | |j z }n&t | }t | |j z }| dd|z nG# t
$ r: t |t r"t dt | d| Y nw xY w|}| r)t# |j \ }} t' | \ }}
| d s| d | | j j D ]D\ } } | } | | s| | | E|S )
N
no host givenzLPOST data should be bytes or an iterable of bytes. It cannot be of type str.z Content-type!application/x-www-form-urlencodedzContent-lengthz%dz=Content-Length should be specified for iterable data of type r\ r )r r ra r r r r r r arrayr itemsize
memoryviewr+ rU r r r r r rD r r )
r r r ra r r mvsel_hostro selsel_pathr{ r s
rf do_request_z AbstractHTTPHandler.do_request_ sL | ,?++ + < # + +FH = = = ;1 = =KD%??$$D%%d++
=//e<<<s A D
AE
Ec |
|j }|st d ||fd|j i|}t |j
t
fd|j D d
d< t d
D
|j r2i }d}|
v r
| ||<
|= | |j | |
| |j |j
| }|j r |j d |_ n:# t" j $ r(} | t | d } ~ ww xY w| |_ |j |_ |S )
zReturn an HTTPResponse object for the request, using http_class.
http_class must implement the HTTPConnection API from http.client.
r8 rb c 3 . K | ]\ }}|v ||fV d S ri r )r^ r_ r` r s rf rb z.AbstractHTTPHandler.do_open.. sA 1 1tq! / / F / / / / 1 1rg r
Connectionc 3 H K | ] \ }}| |fV d S ri )title)r^ r{ r s rf rb z.AbstractHTTPHandler.do_open.. s3 LLytS
c*LLLLLLrg r, r N)r r rb r r r r r r
set_tunnelr r r ra getresponsesockr r/ r r r` reasonr ) r
http_classr http_conn_argsr r@ tunnel_headersproxy_auth_hdrr errr s @rf r zAbstractHTTPHandler.do_open s
x ,?++ +
Jt C CS[ CN C Cs,--t 1 1 1 1s{/@/@/B/B 1 1 1 1 1 2 2 2 !( LLGMMOOLLLLL C N 2N ((18 1H~. N+
LL)>L B B B
IIcnn&& ch H H H
A v
|
GGIII3-- "" s -4E F,#FFNr )r r r r r6 rA r r rg rf r/ r/ sV & & & &! ! !1 1 1f< < < < <rg r/ c " e Zd Zd Zej ZdS )r< c B | t j | S ri )r r7 HTTPConnectionr r s rf http_openzHTTPHandler.http_open$ s ||K 6<< 2 2 2 2
L L L ,7
rg r^ c * e Zd ZddZd Zd ZeZeZdS )r2 Nc X dd l mc mc m} || }|| _ d S r ) future.backports.http.cookiejar backportsr( cookiejar CookieJar)r rc http_cookiejars rf r z HTTPCookieProcessor.__init__; sH @@@@@@@@@@@@ &0022I"rg c : | j | |S ri )rc add_cookie_header)r r s rf rW z HTTPCookieProcessor.http_requestA s ((111rg c < | j || |S ri )rc extract_cookies)r r r s rf rO z!HTTPCookieProcessor.http_responseE s &&x999rg ri )r r r r rW rO r^ rQ r rg rf r2 r2 : sL # # # # !M"NNNrg r2 c e Zd Zd ZdS )r@ c 4 |j }t d|z )Nzunknown url type: %s)r r )r r r s rf r% zUnknownHandler.unknown_openM s x-4555rg N)r r r r% r rg rf r@ r@ L s# 6 6 6 6 6rg r@ c i }| D ]B}| dd \ }}|d dk r|d dk r
|dd }|||< C|S )z>Parse list of key=value strings where keys are not duplicated.=r r r ro )r )lparsedeltr_ r` s rf r r Q sc
F yya 1 Q43;;1R5C<<!B$Aq Mrg c g }d}dx}}| D ]P}|r||z
}d} |r|dk rd}|dk rd}||z
}%|dk r| | d}C|dk rd}||z
}Q|r| | d |D S )ap Parse lists as described by RFC 2068 Section 2.
In particular, parse comma-separated lists where the elements of
the list may include quoted-strings. A quoted-string could
contain a comma. A non-quoted string could have quotes in the
middle. Neither commas nor quotes count if they are escaped.
Only double-quotes count, not single-quotes.
r F\Tr ,c 6 g | ]}| S r strip)r^ parts rf r z#parse_http_list.. s ) ) )TDJJLL ) ) )rg )r} )r resrw escaper curs rf r r [ s
C
DFU CKDF d{{ CKD #:: JJt D #::E
4 ) )S ) ) ))rg c $ e Zd Zd ZdZd Zd ZdS )r= c |j }|d d dk rL|dd dk r>|j r7|j dk r,|j | urt d d S | | S )Nr) r{ rL rl localhost-file:// scheme is supported only on localhost)r r get_namesr open_local_file)r r r` s rf file_openzFileHandler.file_open s l rr7d??s1Q3x3CHK''8t~~ / /// NOOO 0/ '',, ,rg Nc X t j t t j d d t j t j d z t _ n4# t j $ r" t j d ft _ Y nw xY wt j S )Nr} r) )r= namesr r/ gethostbyname_ex gethostnamegaierror
gethostbynamer s rf r zFileHandler.get_names s $
I$)+K88;+F,>,@,@AA!DE%F %F !! ?
I
I
I%+%9+%F%F$H !!!
I s A A, ,.B B c p dd l mc mc m} dd l}|j }|j }t | } t j | }|j
}| |j d } |
| d }
t j d|
pd|| fz } |rt | \ }} |r%| sRt! | | v r/|r d|z |z }
nd|z }
t% t' |d | |
S n!# t( $ r}t+ | d }~ww xY wt+ d ) Nr Tusegmtz6Content-type: %s
Content-length: %d
Last-modified: %s
text/plainfile://rbzfile not on local host) future.backports.email.utilsrb r utils mimetypesr r rF rv statst_size
formatdatest_mtime
guess_typemessage_from_stringr _safe_gethostbynamer r) r
OSErrorr )r r email_utilsr r r localfilestatsr modifiedmtyper r origurlexps rf r zFileHandler.open_local_file s ::::::::::::x< ** GI&&E=D"--enT-JJH ((2215E/K&,h789 9G
- &t__
d
K
K 1$ 7 74>>;K;K K K 3 '$ . 9GG '( 2G!$y$"7"7'JJJ 3-- /000s CD
D&D!!D&)r r r r r r r r rg rf r= r= sH - - -
E! ! !1 1 1 1 1rg r= c X t j | S # t j $ r Y d S w xY wri )r/ r r r s rf r r s< #D))) ? tts ))c e Zd Zd Zd ZdS )r> c dd l }dd l}|j }|st d t | \ }}||j }nt
| }t | \ }}|rt | \ }}nd }t | }|pd}|pd} t j | }n&# t j $ r}t | d }~ww xY wt |j \ } }
| d } t! t# t | } | d d | d } } | r| d s
| dd } | ||||| |j }
| rdpd}|
D ]D}t) | \ }}| d k r|d
v r| }E|
| | \ }}d}| |j d }|r|d |z z
}||dk r|d |z z
}t5 j | }t9 |||j S # |j $ r,}t d
|z }t= | Y d }~d S d }~ww xY w)Nr ftp error: no host givenr rl ro r r Dr aAr r r$ r zContent-type: %s
zContent-length: %d
ftp error: %r) ftplibr r r r FTP_PORTr r! r" r r/ r r r# r r r r connect_ftprb r% r upperretrfiler r r r r)
all_errorsr )r r r r r r r r r rw attrsdirsrk fwr attrr r retrlenr r r excs rf ftp_openzFTPHandler.ftp_open s
x 7566 6 t__
d <?DDt99D t__
d &t,,LD&&Ft}}zr 2 '--DD| 3-- -- ezz#C&&''#2#YRd Q 8D &!!$dD#+NNB r> s3 3& 3& 3&j, , , , ,rg r> c 2 e Zd Zd Zd Zd Zd Zd Zd ZdS )r? c L i | _ i | _ d| _ d| _ d| _ d S )Nr < r )cacherb soonestdelay max_connsr s rf r zCacheFTPHandler.__init__ s)
rg c || _ d S ri )r )r ts rf
setTimeoutzCacheFTPHandler.setTimeout s
rg c || _ d S ri )r )r re s rf setMaxConnszCacheFTPHandler.setMaxConns s
rg c P |||d | |f}|| j v r$t j | j z | j |< n?t |||||| | j |< t j | j z | j |< | | j | S )Nrl )joinr r r rb r check_cache)r r r r r r rb r s rf r zCacheFTPHandler.connect_ftp
s D$7 $* $ dj 8DL (vtT)-w 8 8DJsO $ dj 8DL z# rg c t j }| j |k rat | j D ]:\ }}||k r/| j | | j |= | j |= ;t t | j | _ t | j | j
k rt | j D ]"\ }}|| j k r| j |= | j |= n#t t | j | _ d S d S ri ) r r r rb r r r minvaluesr r )r r r_ r` s rf r zCacheFTPHandler.check_cache s8 IKK <1 T\ / / 1 122
(
(1q55JqM'')))
1
Q4 3 3 5 56677 tz??dn , , T\ / / 1 122
1 $$
1
QE % tDL$7$7$9$9 : :;;DLLL
- ,rg c | j D ]}| | j | j d S ri )r r r clearrb )r conns rf clear_cachezCacheFTPHandler.clear_cache) s\ J%%'' D JJLLLL
rg N) r r r r r r r r r r rg rf r? r? sn < < <( rg r? rV nt)rF rE c t | S )zOS-specific conversion from a relative URL of the 'file' scheme
to a file system path; not recommended for general use.)r pathnames rf rF rF 8 s x rg c t | S )zOS-specific conversion from a file system path to a relative URL
of the 'file' scheme; not recommended for general use.)r r s rf rE rE = s X rg c e Zd ZdZdZdez ZddZd Zd Z d Z
d Z dd Z dd
Z
dd Zdd Zd
ZddZddZd Zerd ZddZd Zd Zd ZddZdS )rJ a, Class to open URLs.
This is a class rather than just a subroutine because we may need
more than one set of global protocol-specific options.
Note -- this is a base class for those who don't want the
automatic handling of errors type 302 (relocated) and 401
(authorization needed).Nr c dd| j j iz }t j |t d |t }t
|d s
J d || _ | d | _ | d | _
d | j fg| _ g | _
t j | _ d | _ t$ | _ d S )
NzW%(class)s style of invoking requests is deprecated. Use newer urlopen functions/methodsclassrL r r r key_file cert_filez
User-Agent) __class__r r r r rG r r r r r versionr _URLopener__tempfilesrv r _URLopener__unlink tempcacheftpcache)r r x509r s rf r zURLopener.__init__W s 47>@W6XY
c-!<<<< ? llGw''DD)DDD' ,,
+.. ($,78
!
rg c . | d S ri )r r s rf __del__zURLopener.__del__q s
rg c . | d S ri )cleanupr s rf r zURLopener.closet s rg c | j r:| j D ](} | | # t $ r Y %w xY w| j d d = | j r| j d S d S ri )r r r r r )r rk s rf r zURLopener.cleanupw s $ (
MM$'''' D # > # N " " " " " # #s (
55c : | j | dS )zdAdd a header to be used by the HTTP interface only
e.g. u.addheader('Accept', 'sound/basic')N)r r} )r r s rf addheaderzURLopener.addheader s
t$$$$$rg c B t t | }t |d }| j r:|| j v r1| j | \ }}t |d }t ||| S t
| \ }}|sd}|| j v r6| j | }t
| \ }} t | \ }
} |
|f}nd}d|z } || _ |
dd } t | | s/|r| ||| S |
|| S | t | | | S t | | || S # t $ r t j $ r(}
t% t' d |
Y d}
~
dS d}
~
ww xY w)
z6Use URLopener().open(file) instead of open(file, 'r').z%/:=&?~#+!$,;'@()*[]|safer rk Nopen_-r z socket error)r r' r r r
r) r r r r rc r open_unknown_proxy open_unknownr r r/ r r IOError)r r ra r r r urltyper` r| proxyhostr r r{ r s rf r
zURLopener.open s '**++&=>>> > 4g 7 7 $w 7 Hgh%%B b'733 3 )) G dl " "L)E!*5!1!1 GY &y 1 1ND(/CCE ||C%%tT"" 8
8..ugtDDD(($777 ?|*wtT**3///*wtT**3555 | ? ? ? !=!= > > > > > > > > > ?s (E E F 6 FF c H t | \ }}t dd| )/Overridable interface to open unknown URL type. url errorzunknown url typer r )r r ra r r` s rf r zURLopener.open_unknown s& g&& ck#5t<< 'cT^ 3 3>#& & s^^
d T TV^^
))$//wwyy
#IdOOA$677==
YYsD
!
!& ggiiG
*8T** )#
)$*" 5 5
*4:2 6 6
g )$*" 5 5
g))$//2!1!1&!9!9X ''111iD))
!7*>-*0DN3' #w.. w'7 899D 3 JxT2227 GGBKKE CJJ&DIIe$$$ MH! 7"
8R6667 HHJJJJBHHJJJJ 199&C, &( (
(
s9 A B8 8
C C &C J& BI7 "J& 7J
J& &J<c 2 d}d}t |t r8t | \ }}|r!t | \ }}t | }|}n|\ }}t | \ }}t | \ } }
|
}d}| dk rd}nBt |
\ }}
|rt | \ }}|r | d||
}t | r|}|st dd |rIt | }t j
| d } nd} |rIt | }t j
| d } nd} || }
i }| rd| z |d< | rd| z |d < |r||d
< d |d < | j
D ]
\ }}|||< | d
|d< |
d||| n|
d|| |
}n"# t j $ r t% d w xY wd|j cxk rdk r"n n t) ||j d|z |j S | ||j |j |j |j | S )a Make an HTTP connection using connection_class.
This is an internal method that should be called from
open_http() or open_https().
Arguments:
- connection_factory should take a host name and return an
HTTPConnection instance.
- url is the url to retrieval or a host, relative-path pair.
- data is payload for a POST request or None.
Nr( ://z
http errorr8 r zBasic %sr, r r r rD r9 z Content-Typer r rG z$http protocol error: bad status linerL rM http:)r r r r! r r r r r r r r r r r rI r7
BadStatusLiner statusr) r
http_errorr rK )r connection_factoryr` ra user_passwd proxy_passwdr r realhostr r
proxy_authr http_connr headerr r s rf _open_generic_httpz URLopener._open_generic_http s2 c3 $ &s^^ND(
%$-dOO! T t}}HH ND(!*4 L$ %h / /MGTC K}}&(( !*4 $ @,5h,?,?)K G.5ggxx FH )) $#DA7< AAA "<00L ),*=*=*?*?@@GGPPJJ J !+..K#K$6$6$8$899@@IIDDD&&t,, E-7*-DG) * :(2T(9GO $ ' &GFO
!( !_ $ $MFE #GFOO &IGN # fhg > > > > eXw ? ? ? C ,,..HH( C C CABB B C (/ ' ' ' 'C ' ' ' ' ' h gm &o/ /
/ ??X[ (,F F
Fs H H4c D | t j || S )zUse HTTP protocol.)r
r7 rT r r` ra s rf open_httpzURLopener.open_httpX s &&{'A3MMMrg c d|z }t | | r6t | | }| |||||| } n ||||||| } | r| S | ||||| S )zHandle http errors.
Derived class can override this, or provide specific handlers
named http_error_DDD where DDD is the 3-digit error code.z
http_error_%d)r r r+ )
r r` r errcodeerrmsgr ra r{ r r s
rf r zURLopener.http_error\ s ( 4 % T4((F| R&'BB R&'4HH $f}&&sBIIIrg c P | t ||||d )z>Default error handler: close the connection and raise IOError.N)r r r r` r r r r s rf r+ z URLopener.http_error_defaultl s%
Wfgt<<??? t__
d t__
d D 1 1 vvft}}tzr"" 2&&#D)) MMM?DDt99D oo et}}zz##2#YRd 0Q0QRR .Q.3aD$. t} + +]''))
88
a(A
a(GGIII A$-'' tVT4>>
c"
$
)
) ( . . e::<<6)) ::: ;;==D M# . 7 7d C CMR ((# 66q9EG
8/%77"w!||1G;;/88G b'6C<88 8{{ A A A .3*>!?!? @ @ @ @ @ @ @ @ @ As C7K L LL c
t |t st d | dd \ }}n # t $ r t dd w xY w|sd}| d }|dk r$d ||d
vr||dz d
}|d
| }nd }g }| d t j d
t j
t j z | d|z |dk r;t j |
d d }nt | }| dt! | z | d | | d | }t% j | }t) j | }t- ||| S )zUse "data" URL.zEdata error: proxy support for data protocol currently not implementedrs r z
data errorz bad data URLztext/plain;charset=US-ASCII;r rm Nr zDate: %sz%a, %d %b %Y %H:%M:%S GMTzContent-type: %sr r zlatin-1zContent-Length: %d
)r r r r rU r rfindr} r strftimegmtimer decodebytesr r r r r r r ioStringIOr) ) r r` ra r semiencodingr r fs rf open_datazURLopener.open_data s #s## dbcc c 8 99S!,,LT44 8 8 8,77 7 8 10Dzz# 199DK//DFGG}H;DDH
:dm,G,0K ,D,D F F F G G G
%,--- x %dkk'&:&:;;BB9MMDD4==D
'#d))3444
2
4iinn+C00 K !Wc***s A Ari NNN)r r r rP r r r r r r r r r
r r r r
r r r+ rT r r r r r& r3 r rg rf rJ rJ J s K ;.G! ! ! !4 # # # % % % "? "? "? "?H= = = =
I I I I > > > >DZF ZF ZFxN N N NJ J J J = = =
N E E E
N N N N- - - > > >@8A 8A 8At'+ '+ '+ '+ '+ '+rg rJ c e Zd ZdZd Zd ZddZd ZddZddZ dd Z
dd Z dd Z dd
Z
ddZddZddZddZd ZdS )rK z?Derived class with handlers for errors we can handle (perhaps).c Z t j | g|R i | i | _ d| _ d| _ d S )Nr rV )rJ r
auth_cachetriesmaxtries)r r kwargss rf r zFancyURLopener.__init__ s< 41$111&111
rg c , t ||d|z | S )z3Default error handling -- don't raise an exception.r )r) r s rf r+ z!FancyURLopener.http_error_default s "gw}g>>>rg Nc | xj dz
c_ | j rE| j | j k r5t | d r| j }n| j }d| _ |||dd| S | |||||| }d| _ |S )z%Error 302 -- relocated (temporarily).r http_error_500r rB z)Internal Server Error: Redirect Recursion)r8 r9 r r= r+ redirect_internal) r r` r r r r ra r r s rf rv z FancyURLopener.http_error_302 s
a
= NTZ4= 8 8t -..
/*.DJ4RCWN N
N''R&'(,. .
rg c $ d|v r |d }nd|v r |d }nd S | t | j dz |z | }t | }|j dvrt |||d|z z || | | S )Nrh ri r rj z( Redirection to url '%s' is not allowed.)r r r r ro r r
) r r` r r r r ra rd rs s rf r> z FancyURLopener.redirect_internal% s Z(FF
g
U^FF F
S 3.77F## ?"> > >FG " F O P #R) )
)
yy rg c 6 | |||||| S )z*Error 301 -- also relocated (permanently).rv r r` r r r r ra s rf rw z FancyURLopener.http_error_301A ""3GVWdKKKrg c 6 | |||||| S )z;Error 303 -- also relocated (essentially identical to 302).rA rB s rf rx z FancyURLopener.http_error_303E rC rg c l || |||||| S | ||||| S )z1Error 307 -- relocated, but turn POST into error.)rv r+ rB s rf ry z FancyURLopener.http_error_307I sA <&&sB$OO O**3GVWMM Mrg Fc * d|vr t | ||||| |d }t j d| } | s t | ||||| | \ }
} |
dk r t | ||||| |s t | ||||| d| j z dz } | t | | || S t | | || | S )z_Error 401 -- authentication required.
This function supports Basic authentication only.r ![ ]*([^ ]+)[ ]+realm="([^"]*)"r retry_ _basic_authrJ r+ r matchr r r r
r r` r r r r ra r* stuffrK ro r r{ s
rf r z FancyURLopener.http_error_401P sN W , , ( (sB)0&'
C
C
C*+?GG C ( (sB)0&'
C
C
C
<<>>W $ $ ( (sB)0&'
C
C
C ( (sB
$)#m3 <%74%%c511 1%74%%c5$77 7rg c * d|vr t | ||||| |d }t j d| } | s t | ||||| | \ }
} |
dk r t | ||||| |s t | ||||| d| j z dz } | t | | || S t | | || | S )zeError 407 -- proxy authentication required.
This function supports Basic authentication only.r rG r retry_proxy_rI rJ rL s
rf r z FancyURLopener.http_error_407i sN w . . ( (sB)0&'
C
C
C,-?GG C ( (sB)0&'
C
C
C
<<>>W $ $ ( (sB)0&'
C
C
C ( (sB
)M9 <%74%%c511 1%74%%c5$77 7rg c t | \ }}d|z |z }| j d }t | \ }} t | \ } }
| d dz } | | d } | | || \ } }
| s|
sd S t | d dt |
d d| } d| z |
z | j d< || | S | || S )Nhttp://r( @r r r r r r r r get_user_passwdr r
r r` r ra r r rd r| r r
proxyselectorr r r s rf retry_proxy_http_basic_authz*FancyURLopener.retry_proxy_http_basic_auth s "3 hT!H, V$ &u - -#,Y#7#7 = NN3 ! # abbM ++Iua@@ f,,"'2"6"6"6"6"6"'R"8"8"8"8"8))E (9 4} D V <99V$$ $99VT** *rg c t | \ }}d|z |z }| j d }t | \ }} t | \ } }
| d dz } | | d } | | || \ } }
| s|
sd S t | d dt |
d d| } d| z |
z | j d< || | S | || S )Nhttps://r rR r r r r rS rU s rf retry_proxy_https_basic_authz+FancyURLopener.retry_proxy_https_basic_auth s "3 hd"X- W% &u - -#,Y#7#7 = NN3 ! # abbM ++Iua@@ f,,"'2"6"6"6"6"6"'R"8"8"8"8"8))E *Y 6 F W <99V$$ $99VT** *rg c d t | \ }}| d dz }||d }| ||| \ }}|s|sd S t |d dt |d d|}d|z |z } || | S | | | S )NrR r r r r rQ r r rT r r
r r` r ra r r r r r rd s
rf r z$FancyURLopener.retry_http_basic_auth s "3 h IIcNNQ ABBx++D%;; f,, "4b 1 1 1 1 1 "6 3 3 3 3 3TT;T!H, <99V$$ $99VT** *rg c d t | \ }}| d dz }||d }| ||| \ }}|s|sd S t |d dt |d d|}d|z |z } || | S | | | S )NrR r r r r rY r\ r] s
rf retry_https_basic_authz%FancyURLopener.retry_https_basic_auth s "3 h IIcNNQ ABBx++D%;; f,, "4b 1 1 1 1 1 "6 3 3 3 3 3TT;d"X- <99V$$ $99VT** *rg r c |dz | z }|| j v r|r | j |= n
| j | S | || \ }}|s|r ||f| j |< ||fS )NrR )r r7 prompt_user_passwd)r r r r r r r s rf rT z FancyURLopener.get_user_passwd s ckDJJLL( $/ ! !
,OC((s++..tU;; f @6@4.4?3/V|rg c ddl } t d|d|d }| d|d|d|d }||fS # t $ r t Y dS w xY w) z#Override this in a GUI environment!r NzEnter username for z at z: zEnter password for z in r )getpassr
KeyboardInterruptprint)r r r rc r r s rf ra z!FancyURLopener.prompt_user_passwd s 5EEE444HIID ___uuuddd&$ % %F< GGG :: s 8? AAri )NFrQ )r r r rP r r+ rv r> rw rx ry r r rW rZ r r_ rT ra r rg rf rK rK sR II ? ? ? ! ! !8L L L LL L L LN N N N FJ8 8 8 82 FJ8 8 8 82+ + + +$+ + + +$ + + + + + + + +
rg rK c F t t j d a t S )z8Return the IP address of the magic hostname 'localhost'.Nr} )
_localhostr/ r r rg rf r} r} s )+66
rg c
t v t t j t j d a n<# t j $ r* t t j d d a Y nw xY wt S )z,Return the IP addresses of the current host.Nr) r} ) _thishostr r/ r r r r rg rf r r s G f 5f6H6J6J K KA NOOII G G G f 5k B B1 EFFIII G s 8A 6A;:A;c 4 t ddl} | j a t S )z1Return the set of errors raised by the FTP class.Nr )
_ftperrorsr r )r s rf r% r% s!
&
rg c F t t j d a t S )z%Return an empty email Message object.Nr )
_noheadersr r r rg rf noheadersrn s .r22
rg c B e Zd ZdZ d dZd Zd Zd Zd Zd Z d
Z
dS ) r z;Class used by open_ftp() for cache of open FTP connections.NTc || _ || _ || _ || _ || _ || _ d| _ || _ | d S r ) r r r r r rb refcount keepaliveinit)r r r r r r rb r s rf r zftpwrapper.__init__ sK
# rg c V dd l }d| _ | | _ | j | j | j | j | j | j | j
d | j }| j
| d S )Nr rl )r busyFTPrk connectr r rb loginr r r r cwd)r r _targets rf rs zftpwrapper.init s
::<< DIt|<<< ty$+...((49%% W rg c l dd l }| |dv rd}d}nd|z }d} | j | n># |j $ r1 | | j | Y nw xY wd }|rw|su d|z }| j | \ }}nQ# |j $ rD}t | d d dk r t t d |z Y d }~nd }~ww xY w|s| j d |r| j } | j | n-# |j $ r }t d |z }
||
_
|
d }~ww xY w | j | n # | j | w xY wd
|z }nd }| j | \ }}d| _ t | d | j } | xj dz
c_ | | |fS )
Nr )r$ r zTYPE Ar zTYPE zRETR rL 550r zLIST LISTr )r endtransferrk voidcmdr rs ntransfercmd
error_permr r r pwdry __cause__ru r* makefile
file_closerq r ) r rk r r cmdisdirr r rK r r ftpobjs rf r zftpwrapper.retrfile s
: XsquudNcAE " H S ! ! ! ! " " " IIKKK H S ! ! ! ! ! " M M
M n $ 5 5c : :
gg$
M
M
Mv;;rr?e++(/F2J)K)KLLL
M 7 H X & & &
hllnn
&" T****!, " " " ''? @ @(.
! " + HLL%%%%DHLL%%%% n H 1 1# 6 6MD' dmmD 1 14?CC
sS A 8B ?B
"B- -
C;7:C66C;7E F
E< E77E<<F F7c d| _ d S r )ru r s rf r~ zftpwrapper.endtransferK s
rg c V d| _ | j dk r| d S d S )NFr )rr rq
real_closer s rf r zftpwrapper.closeN s4 =A OO rg c | | xj dz c_ | j dk r | j s| d S d S d S )Nr r )r~ rq rr r r s rf r zftpwrapper.file_closeS s\
=A dn OO rg c | | j d S # t $ r Y d S w xY wri )r~ rk r r% r s rf r zftpwrapper.real_closeY sW HNN {{ DD s 1 AA)NT) r r r rP r rs r r~ r r r r rg rf r r s EE?C
.! .! .!`
rg r c i } t j D ]6\ }}| }|r|dd dk r
|| |dd < 7| S )a Return a dictionary of scheme -> proxy server URL mappings.
Scan the environment for variables named _proxy;
this seems to be the standard convention. If you need a
different way, you can pass a proxies dictionary to the
[Fancy]URLopener constructor.
iN_proxy)rv environr r )r r{ r s rf getproxies_environmentr a si Gz'')) ' ' ezz|| 'T"##Y(**!&GD"I Nrg c ` t j dd p t j dd }|dk rdS t | \ }}d | d D }|D ]1}|r-| | s| | r dS 2dS ) zTest if proxies should not be used for a particular host.
Checks the environment for a variable named no_proxy, which should
be a list of DNS suffixes separated by commas, or '*' for all hosts.
no_proxyr NO_PROXY*r c 6 g | ]}| S r ru )r^ r| s rf r z,proxy_bypass_environment..~ s DDDuU[[]]DDDrg rs r )rv r r r r endswith)r r hostonlyr
no_proxy_listr{ s rf proxy_bypass_environmentr q s z~~j"--O
B1O1OH3q t__NHdDDs0C0CDDDM X&&t,,
d0C0C 11 1rg c p ddl m } t | \ }}d }d| vr
|d rdS d}| dd D ]}|st j d
| }||6 t j | } || }n# t
j $ r Y Pw xY w || d } | d }
|
/d
| d d d z z }
nt |
d d }
d|
z
}
||
z | |
z k r dS || | r dS dS )aj
Return True iff this host shouldn't be accessed using a proxy
This function uses the MacOSX framework SystemConfiguration
to fetch the proxy information.
proxy_settings come from _scproxy._get_proxy_settings or get mocked ie:
{ 'exclude_simple': bool,
'exceptions': ['foo.bar', '*.bar.com', '127.0.0.1', '10.1', '10.0/16']
}
r )fnmatchc | d }t t t | }t | dk r|g dz d d }|d dz |d dz z |d d z z |d
z S ) N.rU )r r r r r r r r) r rL )r r r r r )ipAddrr s rf ip2numz,_proxy_bypass_macosx_sysconf..ip2num s S!!Se__%% u::??\\\)2A2.EaB58r>2eAh!mDuQxOOrg r exclude_simpleTN
exceptionsr z(\d+(?:\.\d+)*)(/\d+)?r r) r F) r r r r rK r/ r r groupcountr ) r proxy_settingsr r r r hostIPr re r masks rf _proxy_bypass_macosx_sysconfr s t__NHdP P P $ * + 4
F ##L"55 h H. 6 6 =~ # 1( ; ;F #VF^^FF | H 6!''!**%%D771::D|AGGAJJ , ,S 1 1A 5648}}9D$DDL11tt 2 WT5
!
! 44 5s ! BBBdarwin)_get_proxy_settings _get_proxiesc > t }t | | S ri )r r )r r s rf proxy_bypass_macosx_sysconfr s ,..+D.AAArg c t S )zReturn a dictionary of scheme -> proxy server URL mappings.
This function uses the MacOSX framework SystemConfiguration
to fetch the proxy information.
)r r rg rf getproxies_macosx_sysconfr s ~~ rg c Z t rt | S t | S ri )r r r r s rf r r s, ! # # 5+D11 1.t44 4rg c : t p
t S ri )r r r rg rf rG rG s %''F+D+F+FFrg c j i } ddl }n# t $ r | cY S w xY w | |j d }| |d d }|rt | |d d }d|v rS| d D ]<}| dd \ }}t j d | s|d
|}|| |< =n,|dd d k r|| d
< nd|z | d
< d|z | d< d|z | d< | n # t t t f$ r Y nw xY w| S )zxReturn a dictionary of scheme -> proxy server URL mappings.
Win32 uses the registry to store proxies.
r N;Software\Microsoft\Windows\CurrentVersion\Internet Settings ProxyEnable ProxyServerrm r( r z ^([^/:]+)://r r r r( z http://%sz
https://%sr zftp://%srk )
winreg ImportErrorOpenKeyHKEY_CURRENT_USER QueryValueExr r r rK Close WindowsErrorrU r )r r internetSettings proxyEnable proxyServerpr addresss rf getproxies_registryr s MMMM NNN %~~f.FN P P --.>/<> >>?AK
B !&"5"56F7D#F #FFG#I J J +%% ( . .s 3 3 4 4,-GGCOO)' !x @ @ F3;88WW&EG,3)) 4 #2A2'11*5*5 *C+7++E()3k)A " " $ $ $ $ j)4
D
s C9D D0/D0c : t p
t S zReturn a dictionary of scheme -> proxy server URL mappings.
Returns settings gathered from the environment, if specified,
or the registry.
)r r r rg rf rG rG
s &''@+>+@+@@rg c dd l }n# t $ r Y dS w xY w | |j d }| |d d }t | |d d }n# t $ r Y dS w xY w|r|sdS t | \ }}|g} t j | }||k r|
| n# t j $ r Y nw xY w t j | }||k r|
| n# t j $ r Y nw xY w|
d }|D ]z} | dk rd|vr dS | dd } | d
d } | d d } | D ]&}
t j | |
t j r dS '{dS )
Nr r r
ProxyOverrider( zr r z\.r z.*?)r r r r r r r r r/ r r} r getfqdnr rc r rK r ) r r r r
proxyOverriderawHostr addrfqdnr r s rf proxy_bypass_registryr
s_ MMMM 11 %~~f.FN P P --.>/<> >>?AK 3 34D5D!F !FFG!I J JMM 11 - 1!$
y '00Dw D!!!| D >'**Dw D!!!| D
&++C00
! Dy g%% 11<<U++D<<U++D<<T**D
8D#rt,, 111
qsB
A A: :
BB'/C C)(C)-/D D/.D/c Z t rt | S t | S r )r r r r s rf r r H
s. " # # /+D11 1(.. .rg r4 )rP
__future__r r r r future.builtinsr r r r
r r r
r future.utilsr r r r r r r: future.backportsr future.backports.httpr r7 r r r r parser r r r r r r r r r! r" r# r$ r% r& r' r( r r) r* r. rv r r r/ sysr ry rs r collectionsr+ collections.abcrV r, rT r __all__r r r_ r0 rB rC r| rH rI r ASCIIr r objectr- r. rD r/ rA r0 r1 r r3 r4 r5 r6 r7 r8 urandomr r9 r: r; r/ r< r r^ r} r2 r@ r r r= r r> r? r$ r{
nturl2pathrF rE r rJ rK rg r} ri r rk r% rm rn r r r r platform_scproxyr r r r r rG r r r rg rf r s
F Fl S R R R R R R R R R R R K K K K K K K K K K K K K K K K K K K K 7 7 7 7 7 7 7 7 7 7
" " " " " " 7 7 7 7 7 7 < < < < < < < < < <G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G G / . . . . . . .
)$$$$$$$((((((JJJ II III
" k"1"o
F$B + + + +4 = = = =~
( 2:h11LL 2:h''L "w" w" w" w" w"f w" w" w"rN+ N+ N+ N+ N+V N+ N+ N+h$ $ $L8 8 8 8 8& 8 8 8&# # # # # # # #"; ; ; ; ;k ; ; ;e2 e2 e2 e2 e2+ e2 e2 e2PF, F, F,P(> (> (> (> (>; (> (> (>T= = = = =f = = =@G G G G Go G G GB B B B Bv B B BJ 3[
4k
" z J J J J J J J JZ K)B $
[*C
w w w w w+ w w wt3 3 3 3 3% 3 3 3 7;)** # 8 8 8 8 8* 8 8 8 NN>"""# # # # #+ # # #$6 6 6 6 6[ 6 6 6
)* )* )*V21 21 21 21 21+ 21 21 21h 8, 8, 8, 8, 8, 8, 8, 8,t3 3 3 3 3 j 3 3 3 p 7d??555555555! ! !
{+ {+ {+ {+ {+ {+ {+ {+|
O O O O O Y O O O h
[ [ [ [ [ [ [ [|
.9 9 9x <8::::::::B B B 5 5 5 G G G G G W__+ + +ZA A A0 0 0d
/
/
/
/
/ (J+LLLs ?
C CC