/xn@_ > d dl Z d dlZddlmZ G d de ZdS ) N ) ProbingStatec e Zd ZdZd dZd Zed Zd Zed Z d Z
e d Z e d
Z
e d ZdS )
CharSetProbergffffff?Nc ^ d | _ || _ t j t | _ d S N)_state lang_filterlogging getLogger__name__logger)selfr
s /builddir/build/BUILDROOT/alt-python311-pip-21.3.1-4.el9.x86_64/opt/alt/python311/lib/python3.11/site-packages/pip/_vendor/chardet/charsetprober.py__init__zCharSetProber.__init__' s' & '11 c ( t j | _ d S r )r DETECTINGr r s r resetzCharSetProber.reset, s ", r c d S r r s r charset_namezCharSetProber.charset_name/ s tr c d S r r )r bufs r feedzCharSetProber.feed3 s r c | j S r )r r s r statezCharSetProber.state6 s
{r c dS )Ng r r s r get_confidencez CharSetProber.get_confidence: s sr c 2 t j dd| } | S )Ns ([ -])+ )resub)r s r filter_high_byte_onlyz#CharSetProber.filter_high_byte_only= s f&c22
r c t }t j d| }|D ]Z}| |dd |dd }| s|dk rd}| | [|S )u9
We define three types of bytes:
alphabet: english alphabets [a-zA-Z]
international: international characters [-ÿ]
marker: everything else [^a-zA-Z-ÿ]
The input buffer can be thought to contain a series of words delimited
by markers. This function works to filter all words that contain at
least one international character. All contiguous sequences of markers
are replaced by a single space ascii character.
This filter applies to all scripts which do not use English characters.
s% [a-zA-Z]*[-]+[a-zA-Z]*[^a-zA-Z-]?N r" ) bytearrayr# findallextendisalpha)r filteredwordsword last_chars r filter_international_wordsz(CharSetProber.filter_international_wordsB s ;;
O
'
'D OOD"I & & & RSS I $$&&
!9w+>+> OOI & & & &r c t }d}d}t t | D ]y}| ||dz }|dk rd}n|dk rd}|dk rS| s?||k r4|s2| | || | d |dz }z|s | | |d |S )
a
Returns a copy of ``buf`` that retains only the sequences of English
alphabet and high byte characters that are not between <> characters.
Also retains English alphabet and high byte characters immediately
before occurrences of >.
This filter can be applied to all scripts which contain both English
characters and extended ASCII characters, but is currently only used by
``Latin1Prober``.
Fr r > rC si : n n n n nF n n n n nr