a
lj @ sZ d Z ddlZddlZddlZddlZddlmZmZmZm Z m
Z
m Z m Z ddl
mZ ddlmZ ddlmZ ddlmZ ddlmZ dd lmZmZmZmZ dd
l m Z m Z dd l m Z dd l!m"Z" dd
l#m$Z$ ddl%m&Z& ddl'm(Z( ddl)m*Z* ddl+m,Z, ddl-m.Z. ddl/m0Z0 ddl1m2Z2 ddl3m4Z4 ddl5m6Z6 ddl7m8Z8 ddl9m:Z: ddl;mZ> g dZ?e0e@ZAe e d e eBeCf f ZDe eBeBeBee eB eDf ZEd3e$e eBeBeBf eFeFd d d ZGG d!d" d"ZHee e4eCee d#d$d%ZIG d&d' d'ZJG d(d) d)ZKG d*d+ d+ZLG d,d- d-ZMeCeCeBd.d/d0ZNeCeCe eC d.d1d2ZOdS )4z!Routines related to PyPI, indexes N) FrozenSetIterableListOptionalSetTupleUnion)
specifiers)Tag)canonicalize_name) _BaseVersion)parse)BestVersionAlreadyInstalledDistributionNotFoundInvalidWheelFilenameUnsupportedWheel)
LinkCollector parse_links)InstallationCandidate)
FormatControl)Link) SearchScope)SelectionPreferences) TargetPython)Wheel)InstallRequirement) getLogger)WHEEL_EXTENSION)Hashes)
indent_log) build_netloc)check_requires_python)SUPPORTED_EXTENSIONS) url_to_path)r BestCandidateResult
PackageFinder F)link version_infoignore_requires_pythonreturnc C s| zt | j|d}W n$ tjy6 td| j| Y nB0 |sxdtt|}|sft d|| j| dS td|| j| dS )aa
Return whether the given Python version is compatible with a link's
"Requires-Python" value.
:param version_info: A 3-tuple of ints representing the Python
major-minor-micro version to check.
:param ignore_requires_python: Whether to ignore the "Requires-Python"
value if the given Python version isn't compatible.
)r( z2Ignoring invalid Requires-Python (%r) for link: %s.z4Link requires a different Python (%s not in: %r): %sFzBIgnoring failed Requires-Python check (%s not in: %r) for link: %sT)
r! Zrequires_pythonr ZInvalidSpecifierloggerdebugjoinmapstrverbose)r' r( r) Z
is_compatibleversionr& r& F/usr/lib/python3.9/site-packages/pip/_internal/index/package_finder.py_check_link_requires_python3 s8
r4 c @ sZ e Zd ZdZedZd
eeee e e
e e
ddddZ e
ee
e e f ddd ZdS )
LinkEvaluatorzD
Responsible for evaluating links for a particular project.
z-py([123]\.?[0-9]?)$N) project_namecanonical_nameformats
target_python allow_yankedr) r* c C s4 |du r d}|| _ || _|| _|| _|| _|| _dS )a
:param project_name: The user supplied package name.
:param canonical_name: The canonical package name.
:param formats: The formats allowed for this package. Should be a set
with 'binary' or 'source' or both in it.
:param target_python: The target Python interpreter to use when
evaluating link compatibility. This is used, for example, to
check wheel compatibility, as well as when checking the Python
version, e.g. the Python version embedded in a link filename
(or egg fragment) and against an HTML link's optional PEP 503
"data-requires-python" attribute.
:param allow_yanked: Whether files marked as yanked (in the sense
of PEP 592) are permitted to be candidates for install.
:param ignore_requires_python: Whether to ignore incompatible
PEP 503 "data-requires-python" values in HTML links. Defaults
to False.
NF)
_allow_yanked_canonical_name_ignore_requires_python_formats_target_pythonr6 )selfr6 r7 r8 r9 r: r) r& r& r3 __init__n s zLinkEvaluator.__init__)r' r* c C s d}|j r(| js(|jpd}dd| fS |jr<|j}|j}n| \}}|sPdS |tvrfdd| fS d| jvr|tkrd | j
}d|fS d |j v r|d
krd S |tkr0zt |j
}W n ty Y d S 0 t|j| jkrd
| j
}d|fS | j }||s*| }d d|}d|fS |j}d| jvrZ|tkrZd| j
}d|fS |slt|| j}|sd| j
}d|fS | j|} | r|d| }| d}
|
| jj krdS t || jj | j d} | sdS t!"d|| d|fS )aG
Determine whether a link is a candidate for installation.
:return: A tuple (is_candidate, result), where `result` is (1) a
version string if `is_candidate` is True, and (2) if
`is_candidate` is False, an optional string to log the reason
the link fails to qualify.
Nz Fzyanked for reason: )Fz
not a filez unsupported archive format: Zbinaryz No binaries permitted for {}Zmacosx10z.zip)Fz macosx10 one)Fzinvalid wheel filenamezwrong project name (not {})z^none of the wheel's tags ({}) are compatible (run pip debug --verbose to show compatible tags), sourcezNo sources permitted for z Missing project version for )FzPython version is incorrect)r( r) )FNzFound link %s, version: %sT)# is_yankedr; Z
yanked_reason egg_fragmentextsplitextr" r> r formatr6 pathr filenamer r namer< r? get_tagsZ supportedZget_formatted_file_tagsr. r2 _extract_version_from_fragment_py_version_researchstartgroup
py_versionr4 Zpy_version_infor= r, r- ) r@ r' r2 reasonZegg_inforG wheelsupported_tagsZ file_tagsmatchrS Zsupports_pythonr& r& r3
evaluate_link sx
zLinkEvaluator.evaluate_link)N)__name__
__module__ __qualname____doc__recompilerO r0 r r boolr rA r r rX r& r& r& r3 r5 b s
%r5 )
candidateshashesr6 r* c
C s |s t dt| | t| S g }g }d}| D ]>}|j}|js@n"|j|drV|d7 }n || q.|| q.|rx|}nt| }t|t| krd} n dt|d dd |D } t d
t| ||j
|t|| | |S ) a
Filter out candidates whose hashes aren't allowed, and return a new
list of candidates.
If at least one candidate has an allowed hash, then all candidates with
either an allowed hash or no hash specified are returned. Otherwise,
the given candidates are returned.
Including the candidates with no hash specified when there is a match
allows a warning to be logged if there is a more preferred candidate
with no hash specified. Returning all candidates in the case of no
matches lets pip report the hash of the candidate that would otherwise
have been installed (e.g. permitting the user to more easily update
their requirements file with the desired hash).
zJGiven no hashes to check %s links for project %r: discarding no candidatesr )ra rD zdiscarding no candidatesz discarding {} non-matches:
{}z
c s s | ]}t |jV qd S N)r0 r' ).0 candidater& r& r3 $ z*filter_unallowed_hashes..zPChecked %s links for project %r against %s hashes (%s matches, %s no digest): %s) r, r- lenlistr' Zhas_hashis_hash_allowedappendrI r. Z digest_count)
r` ra r6 Zmatches_or_no_digestZ non_matchesZ match_countrd r' ZfilteredZdiscard_messager& r& r3 filter_unallowed_hashes sL
rk c @ s$ e Zd ZdZdeeddddZdS )CandidatePreferenceszk
Encapsulates some of the preferences for filtering and sorting
InstallationCandidate objects.
FN)
prefer_binaryallow_all_prereleasesr* c C s || _ || _dS )zR
:param allow_all_prereleases: Whether to allow all pre-releases.
N)rn rm )r@ rm rn r& r& r3 rA < s z CandidatePreferences.__init__)FF)rY rZ r[ r\ r_ rA r& r& r& r3 rl 5 s rl c @ sT e Zd ZdZee ee ee ddddZee dddZ ee dd d
Z
dS ) r$ zA collection of candidates, returned by `PackageFinder.find_best_candidate`.
This class is only intended to be instantiated by CandidateEvaluator's
`compute_best_candidate()` method.
N)r` applicable_candidatesbest_candidater* c C sH t |t |ksJ |du r&|r2J n ||v s2J || _|| _|| _dS )a
:param candidates: A sequence of all available candidates found.
:param applicable_candidates: The applicable candidates.
:param best_candidate: The most preferred candidate found, or None
if no applicable candidates were found.
N)set_applicable_candidates _candidatesrp r@ r` ro rp r& r& r3 rA O s
z BestCandidateResult.__init__r* c C s
t | jS )z Iterate through all candidates.)iterrs r@ r& r& r3 iter_allg s z BestCandidateResult.iter_allc C s
t | jS )z*Iterate through the applicable candidates.)rv rr rw r& r& r3 iter_applicablek s z#BestCandidateResult.iter_applicable) rY rZ r[ r\ r r r rA r rx ry r& r& r& r3 r$ H s r$ c
@ s e Zd ZdZedeee eeee j
ee d dddZ dee
e e j
eeee dddd Ze
e e
e d
d d Zeed
ddZe
e ee d
ddZe
e ed
ddZdS )CandidateEvaluatorzm
Responsible for filtering and sorting candidates for installation based
on what tags are valid.
NF)r6 r9 rm rn specifierra r* c C s: |du rt }|du r t }| }| ||||||dS )a Create a CandidateEvaluator object.
:param target_python: The target Python interpreter to use when
checking compatibility. If None (the default), a TargetPython
object will be constructed from the running Python.
:param specifier: An optional object implementing `filter`
(e.g. `packaging.specifiers.SpecifierSet`) to filter applicable
versions.
:param hashes: An optional collection of allowed hashes.
N)r6 rV r{ rm rn ra )r r Z SpecifierSetrM )clsr6 r9 rm rn r{ ra rV r& r& r3 createw s zCandidateEvaluator.create)r6 rV r{ rm rn ra r* c C s< || _ || _|| _|| _|| _|| _dd t|D | _dS )z
:param supported_tags: The PEP 425 tags supported by the target
Python in order of preference (most preferred first).
c S s i | ]\}}||qS r& r& )rc idxtagr& r& r3
s z/CandidateEvaluator.__init__..N)_allow_all_prereleases_hashes_prefer_binary
_project_name
_specifier_supported_tags enumerate_wheel_tag_preferences)r@ r6 rV r{ rm rn ra r& r& r3 rA s
zCandidateEvaluator.__init__)r` r* c sd | j pd}| j}dd |jdd |D |dD fdd|D }t|| j| jd }t|| jd
S ) zM
Return the applicable candidates from a list of candidates.
Nc S s h | ] }t |qS r& )r0 )rc vr& r& r3 s z?CandidateEvaluator.get_applicable_candidates..c s s | ]}t |jV qd S rb r0 r2 rc cr& r& r3 re rf z?CandidateEvaluator.get_applicable_candidates..)Z prereleasesc s g | ]}t |j v r|qS r& r r Zversionsr& r3
rf z@CandidateEvaluator.get_applicable_candidates..)r` ra r6 key)r r filterrk r r sorted _sort_key)r@ r` Zallow_prereleasesr{ ro Z filtered_applicable_candidatesr& r r3 get_applicable_candidates s
z,CandidateEvaluator.get_applicable_candidates)rd r* c
C s | j }t|}d}d}|j}|jrt|j}z||| j }W n" tyb t d
|jY n0 | j rnd}|j durt
d|j } | }
t|
d |
d f}n| }t|| j} dt|j } | | ||j||fS )a)
Function to pass as the `key` argument to a call to sorted() to sort
InstallationCandidates by preference.
Returns a tuple such that tuples sorting as greater using Python's
default comparison operator are more preferred.
The preference is as follows:
First and foremost, candidates with allowed (matching) hashes are
always preferred over candidates without matching hashes. This is
because e.g. if the only candidate with an allowed hash is yanked,
we still want to use that candidate.
Second, excepting hash considerations, candidates that have been
yanked (in the sense of PEP 592) are always less preferred than
candidates that haven't been yanked. Then:
If not finding wheels, they are sorted by version only.
If finding wheels, then the sort order is by version, then:
1. existing installs
2. wheels ordered via Wheel.support_index_min(self._supported_tags)
3. source archives
If prefer_binary was set, then all wheels are sorted above sources.
Note: it was considered to embed this logic into the Link
comparison operators, but then different sdist links
with the same version, would have to be considered equal
r& r zB{} is not a supported wheel for this platform. It can't be sorted.rD Nz ^(\d+)(.*)$)r rg r' Zis_wheelr rK Zfind_most_preferred_tagr
ValueErrorr rI r build_tagr] rW groupsintri r rE r2 )
r@ rd Z
valid_tagsZ support_numr Zbinary_preferencer' rU ZprirW Zbuild_tag_groupsZhas_allowed_hashZ
yank_valuer& r& r3 r sD
z CandidateEvaluator._sort_keyc C s |sdS t || jd}|S )zy
Return the best candidate per the instance's sort order, or None if
no candidate is acceptable.
Nr )maxr )r@ r` rp r& r& r3 sort_best_candidate s z&CandidateEvaluator.sort_best_candidatec C s" | |}| |}t|||dS )zF
Compute and return a `BestCandidateResult` instance.
)ro rp )r r r$ rt r& r& r3 compute_best_candidate* s
z)CandidateEvaluator.compute_best_candidate)NFFNN)FFN)rY rZ r[ r\ classmethodr0 r r r_ r
BaseSpecifierr r} r r
rA r r CandidateSortingKeyr r r$ r r& r& r& r3 rz p sL ( $F rz c @ s e Zd ZdZd;eeeee ee ee ddddZ
e deee)j* ee+ e.d3d6d7Z/e0eee" d8d9d:Z1dS )?r% zThis finds packages.
This is meant to match easy_install's technique for looking for
packages, by reading pages and looking for appropriate links.
N)link_collectorr9 r: format_controlcandidate_prefsr) r* c C sP |du rt }|p tt t }|| _|| _|| _|| _|| _|| _t | _ dS )a
This constructor is primarily meant to be used by the create() class
method and from tests.
:param format_control: A FormatControl object, used to control
the selection of source packages / binary packages when consulting
the index and links.
:param candidate_prefs: Options to use when creating a
CandidateEvaluator object.
N)
rl r rq r; _candidate_prefsr= _link_collectorr? r
_logged_links)r@ r r9 r: r r r) r& r& r3 rA C s zPackageFinder.__init__)r selection_prefsr9 r* c C s8 |du rt }t|j|jd}| ||||j|j|jdS )af Create a PackageFinder.
:param selection_prefs: The candidate selection preferences, as a
SelectionPreferences object.
:param target_python: The target Python interpreter to use when
checking compatibility. If None (the default), a TargetPython
object will be constructed from the running Python.
N)rm rn )r r r9 r: r r) )r rl rm rn r: r r) )r| r r r9 r r& r& r3 r} j s zPackageFinder.createru c C s | j S rb )r? rw r& r& r3 r9 s zPackageFinder.target_pythonc C s | j jS rb r search_scoperw r& r& r3 r s zPackageFinder.search_scope)r r* c C s || j _d S rb r )r@ r r& r& r3 r s c C s | j jS rb )r
find_linksrw r& r& r3 r s zPackageFinder.find_linksc C s | j jS rb )r
index_urlsrw r& r& r3 r s zPackageFinder.index_urlsc c s | j jjD ]}t| V q
d S rb )r ZsessionZpip_trusted_originsr )r@ host_portr& r& r3
trusted_hosts s zPackageFinder.trusted_hostsc C s | j jS rb r rn rw r& r& r3 rn s z#PackageFinder.allow_all_prereleasesc C s d| j _d S NTr rw r& r& r3 set_allow_all_prereleases s z'PackageFinder.set_allow_all_prereleasesc C s | j jS rb r rm rw r& r& r3 rm s zPackageFinder.prefer_binaryc C s d| j _d S r r rw r& r& r3 set_prefer_binary s z PackageFinder.set_prefer_binary)r6 r* c C s. t |}| j|}t|||| j| j| jdS )N)r6 r7 r8 r9 r: r) )r r Zget_allowed_formatsr5 r? r; r= )r@ r6 r7 r8 r& r& r3 make_link_evaluator s z!PackageFinder.make_link_evaluator)linksr* c C sP g g }}t }|D ]2}||vr|| |jr<|| q|| q|| S )z
Returns elements of links in order, non-egg links first, egg links
second, while eliminating duplicates
)rq addrF rj )r@ r ZeggsZno_eggsseenr' r& r& r3 _sort_links s
zPackageFinder._sort_links)r' rT r* c C s( || j vr$td|| | j | d S )NzSkipping link: %s: %s)r r, r- r )r@ r' rT r& r& r3 _log_skipped_link s
z PackageFinder._log_skipped_link)link_evaluatorr' r* c C s8 | |\}}|s(|r$| j||d dS t|j||dS )z
If the link is a candidate for install, convert it to an
InstallationCandidate and return it. Otherwise, return None.
)rT N)rL r' r2 )rX r r r6 )r@ r r' Z is_candidateresultr& r& r3 get_install_candidate s z#PackageFinder.get_install_candidate)r r r* c C s6 g }| |D ]"}| ||}|dur|| q|S )zU
Convert links that are candidates to InstallationCandidate objects.
N)r r rj )r@ r r r` r' rd r& r& r3 evaluate_links s z PackageFinder.evaluate_links) project_urlr r* c C sh t d| | j|}|d u r$g S tt|}t | j||d}W d n1 sZ0 Y |S )Nz-Fetching project page and analyzing links: %s)r )r, r- r Z
fetch_pagerh r r r )r@ r r Z html_pageZ
page_linksZ
package_linksr& r& r3 process_project_url s $z!PackageFinder.process_project_url)maxsizec C s | |}| jj|tj| j|dd}tjdd |D }t |}tjdd |D }|
|t |dd}t
tjr|rdd |D }t d
d | || S ) a Find all available InstallationCandidate for project_name
This checks index_urls and find_links.
All versions found are returned as an InstallationCandidate list.
See LinkEvaluator.evaluate_link() for details on which files
are accepted.
)r )r6 Zcandidates_from_pagec s s( | ] }|D ]}|d ur
| V q
qd S rb )page_candidatesrc ZsourcesrC r& r& r3 re s z4PackageFinder.find_all_candidates..c s s( | ] }|D ]}|d ur
| V q
qd S rb )Z
file_linksr r& r& r3 re ' s T)reversec S s g | ]}t |jjqS r& )r# r' urlr r& r& r3 r 3 rf z5PackageFinder.find_all_candidates..zLocal files found: %srB )r r Zcollect_sources functoolspartialr itertoolschain
from_iterablerh r r r, Z isEnabledForloggingDEBUGr- r. ) r@ r6 r Zcollected_sourcesZpage_candidates_itr Z
file_links_itZfile_candidatespathsr& r& r3 find_all_candidates s.
z!PackageFinder.find_all_candidates)r6 r{ ra r* c C s" | j }tj|| j|j|j||dS )z*Create a CandidateEvaluator object to use.)r6 r9 rm rn r{ ra )r rz r} r? rm rn )r@ r6 r{ ra r r& r& r3 make_candidate_evaluator9 s z&PackageFinder.make_candidate_evaluatorc C s$ | |}| j|||d}||S )a Find matches for the given project and specifier.
:param specifier: An optional object implementing `filter`
(e.g. `packaging.specifiers.SpecifierSet`) to filter applicable
versions.
:return: A `BestCandidateResult` instance.
)r6 r{ ra )r r r )r@ r6 r{ ra r` Zcandidate_evaluatorr& r& r3 find_best_candidateJ s
z!PackageFinder.find_best_candidate)requpgrader* c C s |j dd}| j|j|j|d}|j}d}|jdur@t|jj}tt t
ddd}|du r|du rt d|||
td |d}|r|du s|j|krd
}|s|dur|rt d | nt d ||j dS |rt d
||| tt d|j|| |S )zTry to find a Link matching req
Expects req, an InstallRequirement and upgrade, a boolean
Returns a InstallationCandidate if found,
Raises DistributionNotFound or BestVersionAlreadyInstalled otherwise
F)Ztrust_internet)r{ ra N) cand_iterr* c S s d tdd | D tdp dS )NrB c S s h | ]}t |jqS r& r r r& r& r3 r ~ rf zKPackageFinder.find_requirement.._format_versions..r Znone)r. r
parse_version)r r& r& r3 _format_versionsv s z8PackageFinder.find_requirement.._format_versionszNCould not find a version that satisfies the requirement %s (from versions: %s)z%No matching distribution found for {}TzLExisting installed version (%s) is most up-to-date and satisfies requirementzUExisting installed version (%s) satisfies requirement (most up-to-date version is %s)z=Installed version (%s) is most up-to-date (past versions: %s)z)Using version %s (newest of versions: %s))ra r rL r{ rp Z satisfied_byr r2 r r r0 r, Zcriticalrx r rI r- ry r ) r@ r r ra Zbest_candidate_resultrp Zinstalled_versionr Zbest_installedr& r& r3 find_requirementa sh
z PackageFinder.find_requirement)NNN)N)NN)NN)2rY rZ r[ r\ r r r_ r r rl rA r r r} propertyr9 r r setterr r0 r r r r rn r rm r r5 r r r r r r r r r lru_cacher r r r rz r r$ r r r r& r& r& r3 r% < s '
0
r% )fragmentr7 r* c C sN t | D ].\}}|dkrqt| d| |kr| S qt| d| dS )a Find the separator's index based on the package's canonical name.
:param fragment: A + filename "fragment" (stem) or
egg fragment.
:param canonical_name: The package's canonical name.
This function is needed since the canonicalized name does not necessarily
have the same length as the egg info's name part. An example::
>>> fragment = 'foo__bar-1.0'
>>> canonical_name = 'foo-bar'
>>> _find_name_version_sep(fragment, canonical_name)
8
-Nz does not match )r r r )r r7 ir r& r& r3 _find_name_version_sep s
r c C s@ zt | |d }W n ty& Y dS 0 | |d }|s+ filename
"fragment" (stem) or egg fragment.
:param fragment: The string to parse. E.g. foo-2.1
:param canonical_name: The canonicalized name of the package this
belongs to.
rD N)r r )r r7 Z
version_startr2 r& r& r3 rN s rN )F)Pr\ r r r r] typingr r r r r r r Zpip._vendor.packagingr Zpip._vendor.packaging.tagsr
Zpip._vendor.packaging.utilsr Z pip._vendor.packaging.versionr r
r Zpip._internal.exceptionsr r r r Z pip._internal.index.collectorr r Z pip._internal.models.candidater Z#pip._internal.models.format_controlr Zpip._internal.models.linkr Z!pip._internal.models.search_scoper Z$pip._internal.models.selection_prefsr Z"pip._internal.models.target_pythonr Zpip._internal.models.wheelr Zpip._internal.reqr Zpip._internal.utils._logr Z pip._internal.utils.filetypesr Zpip._internal.utils.hashesr Zpip._internal.utils.loggingr Zpip._internal.utils.miscr Z pip._internal.utils.packagingr! Z pip._internal.utils.unpackingr" Zpip._internal.utils.urlsr# __all__rY r, r r0 ZBuildTagr r_ r4 r5 rk rl r$ rz r% r rN r& r& r& r3 sn $ / J( M ~