1L d Z ddlmZ ddlZddlmZ ddlmZ dZn
# e $ r dZY nw xY wg dZ
G d d
e Z G d d Z G d
d Z
dS )z@Lexical analysis of formal languages (i.e. code) using Pygments. )ApplicationErrorN)get_lexer_by_name)_get_ttype_classTF)tokentext c e Zd ZdS )
LexerErrorN)__name__
__module__ __qualname__ |/builddir/build/BUILD/imunify360-venv-2.6.2/opt/imunify360/venv/lib/python3.11/site-packages/docutils/utils/code_analyzer.pyr
r
s Dr r
c & e Zd ZdZddZd Zd ZdS )Lexera Parse `code` lines and yield "classified" tokens.
Arguments
code -- string of source code to parse,
language -- formal language the code is written in,
tokennames -- either 'long', 'short', or 'none' (see below).
Merge subsequent tokens of the same token-type.
Iterating over an instance yields the tokens as ``(tokentype, value)``
tuples. The value of `tokennames` configures the naming of the tokentype:
'long': downcased full token type name,
'short': short name defined by pygments.token.STANDARD_TYPES
(= class argument used in pygments html output),
'none': skip lexical analysis.
shortc
|| _ || _ || _ d| _ |dv s|dk rdS t st d t
| j | _ dS # t j j $ r t d|z w xY w)zE
Set up a lexical analyzer for `code` in `language`.
N)r r nonez0Cannot analyze code. Pygments package not found.z6Cannot analyze code. No Pygments lexer found for "%s".)
codelanguage
tokennameslexer
with_pygmentsr
r pygmentsutil
ClassNotFound)selfr r r s r __init__zLexer.__init__/ s
$
| # #zV';'; F < ; < <
< M*4=99DJJJ}* M M M ACK L M M
M Ms A 'Bc # K t | }t | \ }}|D ]\ }}||u r||z
}||fV ||}}| d r
|dd }|r||fV dS dS )zrMerge subsequent tokens of same token-type.
Also strip the final newline (added by pygments).
N)iternextendswith)r tokenslasttypelastvalttypevalues r mergez Lexer.mergeJ s
f "6ll7 " 5 5LE5 5 ''''',e7 D ! ! # crclG $G# # # # # # $ $r c # j K | j
g | j fV dS t j | j | j }| | D ]g\ }}| j dk r5t
| d }nt | g}d |D }||fV hdS )z7Parse self.code and yield "classified" tokens.
Nlong.c $ g | ]
}|t v |S r )unstyled_tokens).0clss r
z"Lexer.__iter__..h s" LLLsO1K1Ks1K1K1Kr )
r r r lexr+ r strlowersplitr )r r& tokentyper* classess r __iter__zLexer.__iter__\ s : di- F di44 $
6 2 2 ! ! Iu&(( i....0066s;;+I667LLgLLLG5.
! !r N)r )r r r
__doc__r r+ r: r r r r r sT &M M M M6$ $ $$
!
!
!
!
!r r c e Zd ZdZd Zd ZdS ) NumberLinesaq Insert linenumber-tokens at the start of every code line.
Arguments
tokens -- iterable of ``(classes, value)`` tuples
startline -- first line number
endline -- last line number
Iterating over an instance yields the tokens with a
``(['ln'], '')`` token added for every code line.
Multi-line tokens are split.c j || _ || _ dt t | z | _ d S )Nz%%%dd )r& startlinelenr5 fmt_str)r r& r? endlines r r zNumberLines.__init__y s. " #c'll"3"33 r c # K | j }dg| j |z fV | j D ]P\ }}| d }|d d D ] }||dz fV |dz
}dg| j |z fV ||d fV Qd S )Nlnr! r" )r? rA r& r7 )r linenor) r* lineslines r r: zNumberLines.__iter__ s fdlV+++++ K # #LE5KK%%E crc
4
4TD[((((! fdlV 333333r" " " " "
# #r N)r r r
r; r r: r r r r= r= l s<
$
$4 4 4 # # # # #r r= )r; docutilsr r pygments.lexersr pygments.formatters.htmlr r ImportErrorr0 r
r r= r r r rM s
G F % % % % % %OOO111111999999MM MMM ! N! N! N! N! N! N! N! N!b # # # # # # # # # #s ''