c C s~ t jj|}|| jkrzt jj| rz| jj| t jj|\}}| j| tj d| | j
sht j | | j rz| j
j| d S )Nz Creating %s)rc rd r r r r r r r r r mkdirr r )r rd r r r- r- r. r ; s
zFileOperator.ensure_dirc C s t || }tjd|| | js|s0| j||rX|s:d }n |j|sHt|t|d }i }|rvtt drvt j
j |d< t j |||df| | j
| |S )NzByte-compiling %s to %sPycInvalidationModeinvalidation_modeT)r r r r r rT rf rg r|
py_compiler CHECKED_HASHcompiler ) r rd optimizeforcerr hashed_invalidationdpathdiagpathcompile_kwargsr- r- r. byte_compileG s
zFileOperator.byte_compilec C s t jj|rt jj|r`t jj| r`tjd| | jsBtj | | j
r|| j kr| j j | nPt jj|rrd}nd}tjd|| | jst j | | j
r|| j
kr| j
j | d S )Nz Removing directory tree at %slinkfilezRemoving %s %s)rc rd r r r r debugr r r r r r r )r rd r, r- r- r. ensure_removedX s"
zFileOperator.ensure_removedc C sH d}x>|sBt jj|r&t j|t j}P t jj|}||kr)rN rr rp r )r r- r- r. __repr__ s
zExportEntry.__repr__c C sD t |tsd}n0| j|jko>| j|jko>| j|jko>| j|jk}|S )NF)r r6 rN rr rp r )r otherr( r- r- r. __eq__ s
zExportEntry.__eq__N)
r r r r r r r7 r9 r __hash__r- r- r- r. r6 s
r6 z(?P(\w|[-.+])+)
\s*=\s*(?P(\w+)([:\.]\w+)*)
\s*(\[\s*(?P[\w-]+(=\w+)?(,\s*\w+(=\w+)?)*)\s*\])?
c
C s t j| }|s0d }d| ks"d| krtd| n|j }|d }|d }|jd}|dkrf|d }}n"|dkrztd| |jd\}}|d } | d krd| ksd| krtd| g } nd
d | jd D } t|||| }|S )
Nr@ rA zInvalid specification '%s'rN callable:r r r c S s g | ] }|j qS r- )rS )rK r r- r- r. rM s z$get_export_entry..rB )ENTRY_REsearchr groupdictcountr r6 )
specificationr' r( r rN rd colonsrr rp r r- r- r. r s2
r c C s | dkr d} t jdkr.dt jkr.t jjd}n t jjd}t jj|rft j|t j}|st j
d| n| j dd\}} d|kr.|}n|jdd\}}|rJt|}|rVt|}||| fS )NrC r r< )rsplitr r )rX usernamepasswordrr r- r- r. parse_credentials$ s rV c C s t jd} t j| | S )N )rc umask)r( r- r- r. get_process_umask3 s
rY c C s> d}d }x$t | D ]\}}t|tsd}P qW |d k s:t|S )NTF) enumerater r rf )seqr( r] r, r- r- r. is_string_sequence8 s
r\ z3([a-z0-9_]+([.-][a-z_][a-z0-9_]*)*)-([a-z0-9_.+-]+)z
-py(\d\.?\d?)c C s d}d}t | jdd} tj| }|r@|jd}| d|j } |rt| t|d krtjtj |d | }|r|j
}| d| | |d d |f}|dkrt j| }|r|jd|jd|f}|S )zw
Extract name, version, python version from a filename (no extension)
Return name, version, pyver or None
N -r z\br ) r r! PYTHON_VERSIONr> r startrg rer escaper PROJECT_NAME_AND_VERSION)filename project_namer( pyverr' nr- r- r. split_filenameG s"
rh z-(?P[\w .-]+)\s*\(\s*(?P[^\s)]+)\)$c C s: t j| }|std| |j }|d j j |d fS )z
A utility method used to get name and version from a string.
From e.g. a Provides-Dist value.
:param p: A value in a form 'foo (1.0)'
:return: The name and version as a tuple.
z$Ill-formed name/version string: '%s'rN ver)NAME_VERSION_REr r r? rS r )r r' r r- r- r. parse_name_and_versionc s
rk c C s t }t | pg } t |pg }d| kr8| jd ||O }x| D ]x}|dkrV|j| q>|jdr|dd }||krtjd| ||kr|j| q>||krtjd| |j| q>W |S )N*r^ r zundeclared extra: %s)r r r rT r rJ ) requested availabler( runwantedr- r- r.
get_extrasr s&
rq c C s i }yNt | }|j }|jd}|jds8tjd| ntjd|}tj |}W n0 t
k
r } ztj d| | W Y d d }~X nX |S )Nz Content-Typezapplication/jsonz(Unexpected response for JSON request: %szutf-8z&Failed to get external data for %s: %s) r r getrT r r r r r r r exception)rQ r( respheadersctreaderer- r- r. _get_external_data s
ry z'https://www.red-dove.com/pypi/projects/c C s* d| d j | f }tt|}t|}|S )Nz%s/%s/project.jsonr )upperr
_external_data_base_urlry )rN rQ r( r- r- r. get_project_data s
r| c C s( d| d j | |f }tt|}t|S )Nz%s/%s/package-%s.jsonr )rz r
r{ ry )rN versionrQ r- r- r. get_package_data s
r~ c @ s( e Zd ZdZdd Zdd Zdd ZdS ) Cachez
A class implementing a cache for resources that need to live in the file system
e.g. shared libraries. This class was moved from resources to here because it
could be used by other modules, e.g. the wheel module.
c C sP t jj|st j| t j|jd@ dkr6tjd| t jjt jj || _
dS )zu
Initialise an instance.
:param base: The base directory where the cache should be located.
? r z Directory '%s' is not privateN) rc rd r rK r r r rJ r normpathro )r ro r- r- r. r s
zCache.__init__c C s t |S )zN
Converts a resource prefix to a directory name in the cache.
)rP )r rr r- r- r.
prefix_to_dir s zCache.prefix_to_dirc C s g }xt j| jD ]r}t jj| j|}y>t jj|s@t jj|rLt j| nt jj|rbt j
| W q t k
r |j | Y qX qW |S )z"
Clear the cache.
)
rc r( ro rd r$ r r r r r r r r" )r not_removedfnr- r- r. clear s z Cache.clearN)r r r __doc__r r r r- r- r- r. r s r c @ s: e Zd ZdZdd ZdddZdd Zd d
Zd d Zd
S )
EventMixinz1
A very simple publish/subscribe system.
c C s
i | _ d S )N) _subscribers)r r- r- r. r s zEventMixin.__init__Tc C sD | j }||kr t|g||< n"|| }|r6|j| n
|j| dS )a`
Add a subscriber for an event.
:param event: The name of an event.
:param subscriber: The subscriber to be added (and called when the
event is published).
:param append: Whether to append or prepend the subscriber to an
existing subscriber list for the event.
N)r r r"
appendleft)r event
subscriberr" subssqr- r- r. r s
zEventMixin.addc C s, | j }||krtd| || j| dS )z
Remove a subscriber for an event.
:param event: The name of an event.
:param subscriber: The subscriber to be removed.
zNo subscribers: %rN)r r r )r r r r r- r- r. r s zEventMixin.removec C s t | jj|f S )z
Return an iterator for the subscribers for an event.
:param event: The event to return subscribers for.
)iterr rr )r r r- r- r. get_subscribers s zEventMixin.get_subscribersc O sp g }xT| j |D ]F}y||f||}W n" tk
rJ tjd d}Y nX |j| qW tjd|||| |S )a^
Publish a event and return a list of values returned by its
subscribers.
:param event: The event to publish.
:param args: The positional arguments to pass to the event's
subscribers.
:param kwargs: The keyword arguments to pass to the event's
subscribers.
z"Exception during event publicationNz/publish %s: args = %s, kwargs = %s, result = %s)r r r rs r" r )r r argskwargsr( r r r- r- r. publish s
zEventMixin.publishN)T) r r r r r r r r r r- r- r- r. r s
r c @ s^ e Zd Zdd Zdd ZdddZdd Zd
d Zd d
Zdd Z e
dd Z e
dd Z dS ) Sequencerc C s i | _ i | _t | _d S )N)_preds_succsr _nodes)r r- r- r. r " s zSequencer.__init__c C s | j j| d S )N)r r )r noder- r- r. add_node' s zSequencer.add_nodeFc C s || j kr| j j| |rx&t| jj|f D ]}| j|| q.W x&t| jj|f D ]}| j|| qVW x&t| jj D ]\}}|sz| j|= qzW x&t| jj D ]\}}|s| j|= qW d S )N)r r r r rr r r& r )r r edgesr r, r rH r- r- r. remove_node* s
zSequencer.remove_nodec C s< ||ks t | jj|t j| | jj|t j| d S )N)rf r
setdefaultr r r )r predsuccr- r- r. r : s z
Sequencer.addc C s ||ks t y| j| }| j| }W n tk
rD td| Y nX y|j| |j| W n$ tk
r td||f Y nX d S )Nz %r not a successor of anythingz%r not a successor of %r)rf r r KeyErrorr r )r r r predssuccsr- r- r. r ? s
zSequencer.removec C s || j kp || jkp || jkS )N)r r r )r stepr- r- r. is_stepL s zSequencer.is_stepc C s | j |std| g }g }t }|j| xd|r|jd}||krd||kr|j| |j| q0|j| |j| | jj|f }|j | q0W t
|S )Nz Unknown: %rr ) r r r r" rj r r r rr extendreversed)r finalr( todoseenr r r- r- r. get_stepsP s"
zSequencer.get_stepsc sV dgg i i g | j fddx D ]}|kr:| q:W S )Nr c
s d | < d | < d d7 < j | y | }W n tk
rV g }Y nX xR|D ]J}|kr| t| | | < q^|kr^t| | | < q^W | | krg }x j }|j | || krP qW t|}j | d S )Nr r )r" r minrj tuple)r
successors successorconnected_component component)graphindex
index_counterlowlinksr( stack
strongconnectr- r. r t s.
z3Sequencer.strong_connections..strongconnect)r )r r r- )r r r r r( r r r. strong_connectionsi s "
z Sequencer.strong_connectionsc C sr dg}x8| j D ].}| j | }x |D ]}|jd||f q"W qW x | jD ]}|jd| qHW |jd dj|S )Nz digraph G {z %s -> %s;z %s;}
)r r" r r$ )r r( r r r r r- r- r. dot s
z
Sequencer.dotN)F)
r r r r r r r r r r propertyr r r- r- r- r. r ! s
3r .tar.gz.tar.bz2.tar.zip.tgz.tbz.whlTc
sX fdd}t jj t d }|d kr| jdr>d}nH| jdrRd}d }n4| jdrfd }d
}n | jdrzd}d}n td| z|dkrt| d}|r|j }xD|D ] }|| qW n.tj | |}|r|j
}x|D ] }|| qW |dkr6t j d dk r6x.|j
D ]"} t| jts| jjd| _qW |j W d |rR|j X d S )Nc sT t | ts| jd} tjjtjj | }|j sD| tjkrPt d| d S )Nzutf-8z path outside destination: %r)
r r decoderc rd r r$ rT re r )rd r )dest_dirplenr- r.
check_path s
z unarchive..check_path.zip.whlzip.tar.gz.tgztgzzr:gz.tar.bz2.tbztbzzr:bz2z.tartarro zUnknown format for %rr r zutf-8)r r )r r )r r )rc rd r rg rQ r r namelisttarfiler getnamesr} r
getmembersr rN r r
extractallr )
archive_filenamer formatr r archiver namesrN tarinfor- )r r r. unarchive sH
r c C s t j }t| }t|db}xZtj| D ]L\}}}x@|D ]8}tjj||}||d } tjj| |}
|j||
q8W q(W W dQ R X |S )z*zip a directory tree into a BytesIO objectr N) ioBytesIOrg r rc walkrd r$ r ) directoryr( dlenzfrh r* r
rN fullrelrq r- r- r. zip_dir s
r r KMGTPc @ sr e Zd ZdZdddZdd Zdd Zd
d Zd d
Ze dd Z
e dd Z dd Z e dd Z
e dd ZdS )ProgressUNKNOWNr d c C s< |d ks||kst | | _| _|| _d | _d| _d| _d S )Nr F)rf r curmaxstartedelapseddone)r minvalmaxvalr- r- r. r s zProgress.__init__c C sV | j |kst| jd ks&|| jks&t|| _tj }| jd krF|| _n || j | _d S )N)r rf r r timer r )r curvalnowr- r- r. update s
zProgress.updatec C s |dks t | j| j| d S )Nr )rf r r )r incrr- r- r. increment s zProgress.incrementc C s | j | j | S )N)r r )r r- r- r. r` s zProgress.startc C s | j d k r| j| j d| _d S )NT)r r r )r r- r- r. stop s
z
Progress.stopc C s | j d kr| jS | j S )N)r unknown)r r- r- r. maximum s zProgress.maximumc C sD | j r d}n4| jd kr d}n$d| j| j | j| j }d| }|S )Nz100 %z ?? %g Y@z%3d %%)r r r r )r r( rH r- r- r.
percentage s
zProgress.percentagec C s: |dkr| j d ks | j| jkr$d}ntjdtj|}|S )Nr z??:??:??z%H:%M:%S)r r r r strftimegmtime)r durationr( r- r- r. format_duration* s zProgress.format_durationc C s | j rd}| j}n^d}| jd kr&d}nJ| jdks<| j| jkrBd}n.t| j| j }|| j| j }|d | j }d|| j|f S )NDonezETA r r z%s: %sr )r r r r r floatr )r rr r^ r- r- r. ETA3 s
z Progress.ETAc C sN | j dkrd}n| j| j | j }x tD ]}|dk r6P |d }q(W d||f S )Nr g i g @@z%d %sB/s)r r r UNITS)r r( unitr- r- r. speedF s
zProgress.speedN)r r )r r r r r r r r` r r r r r r r r- r- r- r. r s
r z \{([^}]*)\}z[^/\\,{]\*\*|\*\*[^/\\,}]z^[^{]*\}|\{[^}]*$c C s< t j| rd}t|| tj| r4d}t|| t| S )zAExtended globbing function that supports ** and {opt1,opt2,opt3}.z7invalid glob %r: recursive glob "**" must be used alonez2invalid glob %r: mismatching set marker '{' or '}')_CHECK_RECURSIVE_GLOBr> r _CHECK_MISMATCH_SET_iglob) path_globr r- r- r. r [ s
r c c s t j| d}t|dkrpt|dks,t||\}}}x|jdD ](}x"tdj|||fD ]
}|V q\W qBW nd| krxt| D ]
}|V qW n| jdd\}}|dkrd}|dkrd}n|jd}|jd }xHtj |D ]:\}}} tj
j |}x"ttj
j||D ] }
|
V qW qW d S )
Nr r rB r z**r/ rl rb \) RICH_GLOBr rg rf r r$ std_iglobr% rc r rd r ) r rich_path_globrr r rp itemrd radicaldirr
r r- r- r. r f s*
r ) HTTPSHandlermatch_hostnameCertificateErrorc @ s e Zd ZdZdZdd ZdS )HTTPSConnectionNTc C sZ t j| j| jf| j}t| ddr0|| _| j tt dsp| j
rHt j }nt j }t j
|| j| j|t j| j
d| _nt jt j}tt dr| jt jO _| jr|j| j| j i }| j
rt j |_|j| j
d tt ddr| j|d< |j
|f|| _| j
o| jrVy$t| jj | j tjd | j W n0 t k
rT | jj t j | jj Y nX d S )
N _tunnel_hostF
SSLContext) cert_reqs ssl_versionca_certs OP_NO_SSLv2)cafileHAS_SNIserver_hostnamezHost verified: %s) r create_connectionhostporttimeoutr~ sock_tunnelr| sslr
CERT_REQUIRED CERT_NONE wrap_socketkey_file cert_filePROTOCOL_SSLv23r optionsr load_cert_chain verify_modeload_verify_locations check_domainr getpeercertr r r shutdown SHUT_RDWRr )r r" r contextr r- r- r. connect s@
zHTTPSConnection.connect)r r r r r/ r4 r- r- r- r. r s r c @ s& e Zd Zd ddZdd Zdd ZdS )
r Tc C s t j| || _|| _d S )N)BaseHTTPSHandlerr r r/ )r r r/ r- r- r. r s
zHTTPSHandler.__init__c O s$ t ||}| jr | j|_| j|_|S )a
This is called to create a connection instance. Normally you'd
pass a connection class to do_open, but it doesn't actually check for
a class, and just expects a callable. As long as we behave just as a
constructor would have, we should be OK. If it ever changes so that
we *must* pass a class, we'll create an UnsafeHTTPSConnection class
which just sets check_domain to False in the class definition, and
choose which one to pass to do_open.
)r r r/ )r r r r( r- r- r. _conn_maker s
zHTTPSHandler._conn_makerc C sV y| j | j|S tk
rP } z&dt|jkr>td|j n W Y d d }~X nX d S )Nzcertificate verify failedz*Unable to verify server certificate for %s)do_openr6 r strreasonr r )r rY rx r- r- r.
https_open s zHTTPSHandler.https_openN)T)r r r r r6 r: r- r- r- r. r s
r c @ s e Zd Zdd ZdS )HTTPSOnlyHandlerc C s t d| d S )NzAUnexpected HTTP request on what should be a secure connection: %s)r )r rY r- r- r. http_open s zHTTPSOnlyHandler.http_openN)r r r r< r- r- r- r. r; s r; c @ s e Zd ZdddZdS )HTTPr Nc K s& |dkr d }| j | j||f| d S )Nr )_setup_connection_class)r r r r r- r- r. r s z
HTTP.__init__)r N)r r r r r- r- r- r. r? s r? c @ s e Zd ZdddZdS )HTTPSr Nc K s& |dkr d }| j | j||f| d S )Nr )r@ rA )r r r r r- r- r. r s zHTTPS.__init__)r N)r r r r r- r- r- r. rB s rB c @ s e Zd ZdddZdd ZdS ) Transportr c C s || _ tjj| | d S )N)r! r rC r )r r! use_datetimer- r- r. r s zTransport.__init__c C sb | j |\}}}tdkr(t|| jd}n6| j s>|| jd krT|| _|tj|f| _| jd }|S )Nr= r> )r! r r )r= r> )
get_host_info _ver_infor? r! _connection_extra_headersr HTTPConnection)r r hehx509r( r- r- r. make_connection s
zTransport.make_connectionN)r )r r r r rM r- r- r- r. rC s
rC c @ s e Zd ZdddZdd ZdS )
SafeTransportr c C s || _ tjj| | d S )N)r! r rN r )r r! rD r- r- r. r s zSafeTransport.__init__c C sz | j |\}}}|si }| j|d< tdkr:t|d f|}n<| j sP|| jd krl|| _|tj|d f|f| _| jd }|S )Nr! r= r> r r )r= r> )rE r! rF rB rG rH r r )r r rJ rK r r( r- r- r. rM s
z SafeTransport.make_connectionN)r )r r r r rM r- r- r- r. rN
s
rN c @ s e Zd Zdd ZdS ) ServerProxyc K st |j dd | _}|d k r^t|\}}|jdd}|dkr@t}nt}|||d |d< }|| _tjj | |f| d S )Nr! rD r https)rD transport)
rj r! r rr rN rC rQ r rO r ) r r\ r r! rW r_ rD tclsr^ r- r- r. r s zServerProxy.__init__N)r r r r r- r- r- r. rO s rO c K s6 t jd dk r|d7 }nd|d< d|d< t| |f|S )Nr r br newlinezutf-8r )r} r r )r r r r- r- r. _csv_open4 s
rU c @ s4 e Zd ZedededdZdd Zdd Zd S )
CSVBaserB "r ) delimiter quotecharlineterminatorc C s | S )Nr- )r r- r- r. __enter__F s zCSVBase.__enter__c G s | j j d S )N)r r )r rF r- r- r. __exit__I s zCSVBase.__exit__N)r r r r8 defaultsr[ r\ r- r- r- r. rV ? s
rV c @ s( e Zd Zdd Zdd Zdd ZeZdS ) CSVReaderc K s\ d|kr4|d }t jd dkr,tjd|}|| _nt|d d| _tj| jf| j| _d S )Nr r r zutf-8rd ro ) r} r r r r rU csvrw r] )r r r r- r- r. r N s zCSVReader.__init__c C s | S )Nr- )r r- r- r. __iter__Y s zCSVReader.__iter__c C sJ t | j}tjd dk rFx,t|D ] \}}t|ts"|jd||< q"W |S )Nr r zutf-8)nextrw r} r rZ r r r )r r( r] r r- r- r. ra \ s
zCSVReader.nextN)r r r r r` ra __next__r- r- r- r. r^ M s r^ c @ s e Zd Zdd Zdd ZdS ) CSVWriterc K s$ t |d| _tj| jf| j| _d S )Nr )rU r r_ writerr] )r r r r- r- r. r g s zCSVWriter.__init__c C sR t jd dk rBg }x*|D ]"}t|tr0|jd}|j| qW |}| jj| d S )Nr r zutf-8)r} r r r r r" rd writerow)r rowro r r- r- r. re k s
zCSVWriter.writerowN)r r r r re r- r- r- r. rc f s rc c sH e Zd ZeejZded< d fdd Zdd Zdd Zd
d Z Z
S )
Configurator inc_convertincNc s" t t| j| |ptj | _d S )N)superrg r rc r ro )r configro ) __class__r- r. r ~ s zConfigurator.__init__c
s fdd j d}t|s*j|} j dd } j df }|r\tfdd|D } fdd D }t|}|||}|rx$|j D ]\}} t||| qW |S ) Nc sz t | ttfr*t| fdd| D }nLt | trld| krHj| }qvi }x(| D ]} | | ||< qRW n
j| }|S )Nc s g | ] } |qS r- r- )rK r] )convertr- r. rM s zBConfigurator.configure_custom..convert..z())r r& r typedictconfigure_customrm )or( r )rm r r- r. rm s
z.Configurator.configure_custom..convertz()r/ z[]c s g | ] } |qS r- r- )rK rq )rm r- r. rM s z1Configurator.configure_custom..c s$ g | ] }t |r| | fqS r- )r )rK r )rk rm r- r. rM s )rj r; r5 r ro r setattr)
r rk r propsr r r r( rg rH r- )rk rm r r. rp s
z Configurator.configure_customc C s4 | j | }t|tr0d|kr0| j| | j |< }|S )Nz())rk r ro rp )r r r( r- r- r. __getitem__ s
zConfigurator.__getitem__c C sF t jj|s t jj| j|}tj|ddd}tj|}W dQ R X |S )z*Default converter for the inc:// protocol.ro zutf-8)r N) rc rd isabsr$ ro r r r r )r r r r( r- r- r. rh s
zConfigurator.inc_convert)N) r r r ro r value_convertersr rp rt rh
__classcell__r- r- )rl r. rg y s
rg c @ s* e Zd ZdZd
ddZdd Zdd ZdS ) SubprocessMixinzC
Mixin for running subprocesses and capturing their output
FNc C s || _ || _d S )N)verboseprogress)r ry rz r- r- r. r s zSubprocessMixin.__init__c C sn | j }| j}xT|j }|s P |dk r0||| q|sBtjjd ntjj|jd tjj qW |j dS )z
Read lines from a subprocess' output stream and either pass to a progress
callable (if specified) or write progress information to sys.stderr.
Nr/ zutf-8) rz ry readliner} stderrr r flushr )r r r3 rz ry r, r- r- r. rw s zSubprocessMixin.readerc K s t j|ft jt jd|}tj| j|jdfd}|j tj| j|jdfd}|j |j |j
|j
| j d k r| j dd n| j rt
jjd |S )N)stdoutr| r~ )r r r| zdone.mainzdone.
)
subprocessPopenPIPE threadingThreadrw r~ r` r| waitr$ rz ry r} r )r cmdr r t1t2r- r- r. run_command s
zSubprocessMixin.run_command)FN)r r r r r rw r r- r- r- r. rx s
rx c C s t jdd| j S )z,Normalize a python package name a la PEP 503z[-_.]+r^ )ra subr )rN r- r- r. normalize_name s r )NN)r )N)N)r r r r r r r )NT)r r r r r r )r= r> )r collectionsr
contextlibr_ globr r r r loggingrc r ra r r$ ImportErrorr r} r r r r dummy_threadingr r r compatr r r r r
r r r
r r r r r r r r r r r r r getLoggerr r r r rE rD r5 r< r9 rV r# r> ra ry r r r r r r contextmanagerr r r r r r r r5 r6 VERBOSEr= r rN rP rR rV rY r\ Irc r_ rh rj rk rq ry r{ r| r~ r r r ARCHIVE_EXTENSIONSr r r r r r r r r r5 r r r r; r rF r? rB rC rN rO rU rV r^ rc rg rx r r- r- r- r. s
\
Yy
/
8
)
,H
6]
+)
7.