o
0¦iÌR ã @ sÞ d Z ddlZddlZddlmZ dgZe d¡Ze d¡Ze d¡Z e d¡Z
e d ¡Z e d
¡Z e d ¡Z
e d ¡Ze d
¡Ze d¡Ze dej¡Ze dej¡Ze dej¡Ze d ¡Ze d¡ZG dd„ dejƒZdS )z A parser for HTML and XHTML.é N)ÚunescapeÚ
HTMLParserz[&<]z
&[a-zA-Z#]z%&([a-zA-Z][-.a-zA-Z0-9]*)[^a-zA-Z0-9]z)&#(?:[0-9]+|[xX][0-9a-fA-F]+)[^0-9a-fA-F]z <[a-zA-Z]z
z--!?>z-?>z0([a-zA-Z][^\t\n\r\f />]*)(?:[\t\n\r\f ]|/(?!>))*a{
(
(?<=['"\t\n\r\f /])[^\t\n\r\f />][^\t\n\r\f /=>]* # attribute name
)
([\t\n\r\f ]*=[\t\n\r\f ]* # value indicator
('[^']*' # LITA-enclosed value
|"[^"]*" # LIT-enclosed value
|(?!['"])[^>\t\n\r\f ]* # bare value
)
)?
(?:[\t\n\r\f ]|/(?!>))* # possibly followed by a space
a
[a-zA-Z][^\t\n\r\f />]* # tag name
[\t\n\r\f /]* # optional whitespace before attribute name
(?:(?<=['"\t\n\r\f /])[^\t\n\r\f />][^\t\n\r\f /=>]* # attribute name
(?:[\t\n\r\f ]*=[\t\n\r\f ]* # value indicator
(?:'[^']*' # LITA-enclosed value
|"[^"]*" # LIT-enclosed value
|(?!['"])[^>\t\n\r\f ]* # bare value
)
)?
[\t\n\r\f /]* # possibly followed by a space
)*
>?
aF
<[a-zA-Z][^\t\n\r\f />\x00]* # tag name
(?:[\s/]* # optional whitespace before attribute name
(?:(?<=['"\s/])[^\s/>][^\s/=>]* # attribute name
(?:\s*=+\s* # value indicator
(?:'[^']*' # LITA-enclosed value
|"[^"]*" # LIT-enclosed value
|(?!['"])[^>\s]* # bare value
)
\s* # possibly followed by a space
)?(?:\s|/(?!>))*
)*
)?
\s* # trailing whitespace
z#c @ s e Zd ZdZdZdZdddœdd„Zd d
„ Zd d „ Zd
d„ Z dZ
dd„ Z ddœdd„Z dd„ Z
d>dd„Zdd„ Zdd „ Zd>d d „Zd?d d!„Zd"d#„ Zd$d%„ Zd&d'„ Zd(d)„ Zd*d+„ Zd,d-„ Zd.d/„ Zd0d1„ Zd2d3„ Zd4d5„ Z d6d7„ Z d8d9„ Z d:d;„ Z d'.)Ú_HTMLParser__starttag_textr r
r
r Úget_starttag_text s z HTMLParser.get_starttag_text©Ú escapablec C st | ¡ | _|| _| jdkrt d¡| _d S |r*| js*t d| j tjtjB ¡| _d S t d| j tjtjB ¡| _d S )NÚ plaintextz\Zz&|])z])) Úlowerr r ÚreÚcompiler r Ú
IGNORECASEÚASCII)r Úelemr! r
r
r Úset_cdata_mode¡ s
ÿ
ÿzHTMLParser.set_cdata_modec C s t | _d | _d| _d S )NT)r r r r r r
r
r Úclear_cdata_mode s
zHTMLParser.clear_cdata_modec C s
|| _ dS )a Enable or disable support of the CDATA sections.
If enabled, "<[CDATA[" starts a CDATA section which ends with "]]>".
If disabled, "<[CDATA[" starts a bogus comments which ends with ">".
This method is not called by default. Its purpose is to be called
in custom handle_starttag() and handle_endtag() methods, with
value that depends on the adjusted current node.
See https://html.spec.whatwg.org/multipage/parsing.html#markup-declaration-open-state
for details.
N)r )r Úflagr
r
r Ú_set_support_cdata² s
z HTMLParser._set_support_cdatac C s | j }d}t|ƒ}||k rY| jr;| js;| d|¡}|dk r:| dt||d ƒ¡}|dkr8t d¡ ||¡s8n!|}n| j
||¡}|rI| ¡ }n| jrNn |}||k ro| jrf| j rf|
t|||… ƒ¡ n |
|||… ¡ | ||¡}||kr{nÞ|j}|d|ƒrt ||¡r| |¡} n@|d|ƒr›| |¡} n5|d|ƒr¦| |¡} n*|d|ƒr±| |¡} n |d |ƒr¼| |¡} n|d
|k sÄ|rÎ|
d¡ |d
} nn‰| dk r‰|sÙn€t ||¡ràn§|d|ƒr|d |krò|
d¡ n•t ||¡rùnŽ| ||d d … ¡ n‚|d|ƒr0|}d D ]}
| |
|d
¡r"|t|
ƒ8 } nq| ||d
|… ¡ nW|d|ƒrF| jrF| ||d d … ¡ nA|||d … ¡ dkr_| ||d d … ¡ n(|d |ƒrq| ||d d … ¡ n|d|ƒrƒ| ||d d … ¡ nt dƒ‚|} | || ¡}nÅ|d|ƒràt! ||¡}|rÃ| "¡ d d… } | #| ¡ | $¡ } |d| d
ƒs¼| d
} | || ¡}q d||d … v rß|
|||d … ¡ | ||d ¡}ny|d|ƒrQt% ||¡}|r| "d
¡} | &| ¡ | $¡ } |d| d
ƒs | d
} | || ¡}q t' ||¡}|r;|r:| "¡ ||d … kr:| $¡ } | |kr2|} | ||d
¡}n |d
|k rP|
d¡ | ||d
¡}nnJ dƒ‚||k s|r„||k r„| jru| j ru|
t|||… ƒ¡ n |
|||… ¡ | ||¡}||d … | _ d S )Nr ú<ú&é" z [\t\n\r\f ;]úr r; r8 r: r r z rO r# rP rM Úparse_bogus_comment)r rZ r r\ Zgtposr
r
r rK N s4
ÿ
z!HTMLParser.parse_html_declarationc C sp | j }| d|¡s
J dƒ‚t ||d ¡}|s#t ||d ¡}|s#dS |r4| ¡ }| ||d |… ¡ | ¡ S )Nr1 ú"unexpected call to parse_comment()r6 r; ) r rD Ú commentcloserA ÚcommentabruptcloserF rB rM rV )r rZ Úreportr rF r\ r
r
r rI p s zHTMLParser.parse_commentr c C s` | j }|||d … dv sJ dƒ‚| d|d ¡}|dkr dS |r,| ||d |… ¡ |d S )Nr4 )r3 r0 rb r r; r )r r> rM )r rZ re r Úposr
r
r ra s z HTMLParser.parse_bogus_commentc C sd | j }|||d … dksJ dƒ‚t ||d ¡}|s dS | ¡ }| ||d |… ¡ | ¡ }|S )Nr4 r2 z unexpected call to parse_pi()r; )r ÚpicloserA rB rQ rV ©r rZ r rF r\ r
r
r rJ ‹ s zHTMLParser.parse_pic C s d | _ | |¡}|dk r|S | j}|||… | _ g }t ||d ¡}|s(J dƒ‚| ¡ }| d¡ ¡ | _}||k r–t ||¡}|sCnS| ddd¡\} }
} |
sRd } n-| d d… d krd| dd … ksyn | d d… d krw| dd … krn n| dd… } | r…t
| ƒ} | | ¡ | f¡ | ¡ }||k s:|||… ¡ } | d vrÓ|
¡ \}
}d
| j v rÁ|
| j d
¡ }
t| j ƒ| j d
¡ }n|t| j ƒ }| |||… ¡ |S | d ¡rà| ||¡ |S | ||¡ || jv sö| jrò|d ksö|d
krÿ| j|dd |S || jv r | j|dd |S )Nr r z#unexpected call to parse_starttag()r4 r8 ú'r; ú")r ú/>Ú
rk Znoscriptr" Fr T)r Úcheck_for_whole_start_tagr Útagfind_tolerantrF rV rT r# r Úattrfind_tolerantr ÚappendÚstripZgetposÚcountr= r? rC rN Úhandle_startendtagÚhandle_starttagÚCDATA_CONTENT_ELEMENTSr r) ÚRCDATA_CONTENT_ELEMENTS)r rZ Úendposr ÚattrsrF r] ÚtagÚmÚattrnameÚrestZ attrvaluerV ÚlinenoÚoffsetr
r
r rG — sf
&( ó
ÿ
ù
ÿ þzHTMLParser.parse_starttagc C s> | j }t ||d ¡}|sJ ‚| ¡ }||d dkr dS |S )Nr r r; )r Ú locatetagendrF rV rh r
r
r rm Ð s z$HTMLParser.check_for_whole_start_tagc C sà | j }|||d … dksJ dƒ‚| d|d ¡dk r dS t ||¡s8||d |d … dkr3|d S | |¡S t ||d ¡}|sDJ ‚| ¡ }||d dkrRdS t ||d ¡}|s^J ‚| d¡ ¡ }|
|¡ | ¡ |S ) Nr4 r0 z unexpected call to parse_endtagr r r; r8 r ) r r> rL rF ra r rV rn rT r# Ú
handle_endtagr* )r rZ r rF r\ ry r
r
r rH Ú s&
zHTMLParser.parse_endtagc C s | ||¡ | |¡ d S ©N)rt r€ ©r ry rx r
r
r rs ø s z HTMLParser.handle_startendtagc C ó d S r r
r‚ r
r
r rt ý ó zHTMLParser.handle_starttagc C rƒ r r
)r ry r
r
r r€ r„ zHTMLParser.handle_endtagc C rƒ r r
©r r_ r
r
r rU r„ zHTMLParser.handle_charrefc C rƒ r r
r… r
r
r rX r„ zHTMLParser.handle_entityrefc C rƒ r r
r r
r
r rC
r„ zHTMLParser.handle_datac C rƒ r r
r r
r
r rM r„ zHTMLParser.handle_commentc C rƒ r r
)r Zdeclr
r
r rP r„ zHTMLParser.handle_declc C rƒ r r
r r
r
r rQ r„ zHTMLParser.handle_pic C rƒ r r
r r
r
r rO r„ zHTMLParser.unknown_decl)T)r )!Ú__name__Ú
__module__Ú __qualname__Ú__doc__ru rv r r r r r r r) r* r, r rK rI ra rJ rG rm rH rs rt r€ rU rX rC rM rP rQ rO r
r
r
r r Z s@
"
9
)r‰ r$ r Zhtmlr Ú__all__r% r rY rW rS rE rL rg rc rd rn ÚVERBOSEro r Zlocatestarttagend_tolerantZ endendtagZ
endtagfindr r r
r
r
r Ú s6
õ
óò