Q(My d Z dZddlZddlmZ dZe Zd Zd Zd Z d Z
d
Z d Z e
e xZ
xZZ e
e xZZ e eej xZZ e d xZxZZ e d
xZxZZ e d Zd Z d Z d Z d Z d Z d Z!d Z"d Z# e" Z$ e# Z%d Z&d Z'd Z(d Z)d Z*d Z+ e(ej, e%e xZ-xZ.Z/ e(ej, e$e xZ0Z1 e)ej, e$eej xZ2Z3 e*ej4 d Z5 e*ej6 d Z7 e*ej4 d Z8 e*ej6 d Z9 e+ej4 d! Z: e+ej6 d" Z;d# Zd& Z?d' Z@d( ZAd) ZBdS )*a Code for encoding protocol message primitives.
Contains the logic for encoding every logical protocol field type
into one of the 5 physical wire types.
This code is designed to push the Python interpreter's performance to the
limits.
The basic idea is that at startup time, for every field (i.e. every
FieldDescriptor) we construct two functions: a "sizer" and an "encoder". The
sizer takes a value of this field's type and computes its byte size. The
encoder takes a writer function and a value. It encodes the value into byte
strings and invokes the writer function to write those strings. Typically the
writer function is the write() method of a BytesIO.
We try to do as much work as possible when constructing the writer and the
sizer rather than when calling them. In particular:
* We copy any needed global functions to local variables, so that we do not need
to do costly global table lookups at runtime.
* Similarly, we try to do any attribute lookups at startup time if possible.
* Every field's tag is encoded to bytes at startup, since it can't change at
runtime.
* Whatever component of the field size we can compute at startup, we do.
* We *avoid* sharing code if doing so would make the code slower and not sharing
does not burden us too much. For example, encoders for repeated fields do
not just call the encoders for singular fields in a loop because this would
add an extra function call overhead for every loop iteration; instead, we
manually inline the single-value encoder into the loop.
* If a Python function lacks a return statement, Python actually generates
instructions to pop the result of the last statement off the stack, push
None onto the stack, and then return that. If we really don't care what
value is returned, then we can save two instructions by returning the
result of the last statement. It looks funny but it helps.
* We assume that type and bounds checking has happened at a higher level.
z kenton@google.com (Kenton Varda) N) wire_formatg c | dk rdS | dk rdS | dk rdS | dk rdS | d k rd
S | d k rd S | d
k rdS | dk rdS | dk rdS dS )z#Compute the size of a varint value. ?
values /builddir/build/BUILD/imunify360-venv-2.6.2/opt/imunify360/venv/lib64/python3.11/site-packages/google/protobuf/internal/encoder.py _VarintSizer P s
d]]11
f__QQ
hqq
i
k!!
mAA
o aa
qq
c | dk rdS | dk rdS | dk rdS | dk rdS | d k rd
S | d k rd S | d
k rdS | dk rdS | dk rdS | dk rdS dS )z*Compute the size of a signed varint value.r r r r r r r r
r r r
r r r r r r r r r r r s r _SignedVarintSizer ^ s
QYYrr
d]]11
f__QQ
hqq
i
k!!
mAA
o aa
qq
r c F t t j | d S )zQReturns the number of bytes required to serialize a tag with this field
number.r )r r PackTag) field_numbers r _TagSizer# m s
[( q99 : ::r c fd}|S )zA sizer which uses the function compute_value_size to compute the size of
each value. Typically compute_value_size is _VarintSize.c n t | |rt fd}|S |rfd}|S fd}|S )Nc P d}| D ]}| | z
}| | z z S Nr r )r resultelementcompute_value_sizelocal_VarintSizetag_sizes r PackedFieldSizez<_SimpleSizer..SpecificSizer..PackedFieldSize sK 0 0G
&&w//
/&&((0008;;r c R t | z }| D ]}| | z
}|S Nlen)r r( r) r* r, s r RepeatedFieldSizez>_SimpleSizer..SpecificSizer..RepeatedFieldSize s? CJJ& 0 0G
&&w//
/&&
r c | z S r/ r )r r* r, s r FieldSizez6_SimpleSizer..SpecificSizer..FieldSize s ,,U3333r r# r ) r" is_repeated is_packedr- r2 r4 r+ r, r* s @@r
SpecificSizerz#_SimpleSizer..SpecificSizer s %%H $< < < < < < <
4 4 4 4 4 4
r r )r* r8 s ` r _SimpleSizerr9 | s$ ,
r c fd}|S )zLike SimpleSizer, but modify_value is invoked on each value before it is
passed to compute_value_size. modify_value is typically ZigZagEncode.c t t | |rt fd}|S |r fd}|S fd}|S )Nc b d}| D ]}| | z
}| | z z S r' r )r r( r) r* r+ modify_valuer, s r r- z>_ModifiedSizer..SpecificSizer..PackedFieldSize sU > >G
&&||G'<'<==
=&&((0008;;r c d t | z }| D ]}| | z
}|S r/ r0 )r r( r) r* r= r, s r r2 z@_ModifiedSizer..SpecificSizer..RepeatedFieldSize sI CJJ& > >G
&&||G'<'<==
=&&
r c 2 | z S r/ r )r r* r= r, s r r4 z8_ModifiedSizer..SpecificSizer..FieldSize s$ ,,\\%-@-@AAAAr r5 )
r" r6 r7 r- r2 r4 r+ r, r* r= s
@@r r8 z%_ModifiedSizer..SpecificSizer s %%H $< < < < < < < <
B B B B B B B
r r )r* r= r8 s `` r _ModifiedSizerr@ s* ,
r c fd}|S )zWLike _SimpleSizer except for a fixed-size field. The input is the size
of one value.c t | |rt
fd}|S |r
z fd}|S
z fd}|S )Nc J t | z }| | z z S r/ r0 )r r( r+ r,
value_sizes r r- z;_FixedSizer..SpecificSizer..PackedFieldSize s/ Uj(((0008;;r c ( t | z S r/ r0 )r element_sizes r r2 z=_FixedSizer..SpecificSizer..RepeatedFieldSize s 5zzL((r c S r/ r )r
field_sizes r r4 z5_FixedSizer..SpecificSizer..FieldSize s r r5 ) r" r6 r7 r- r2 r4 rF rH r+ r, rD s @@@@r r8 z"_FixedSizer..SpecificSizer s %%H $< < < < < < < (*l) ) ) ) )
(j
r r )rD r8 s ` r _FixedSizerrI s$ &
r r r r c r t | t t |rJ |r fd}|S fd}|S )z#Returns a sizer for a string field.c t | z }| D ]1} | d }| | |z z
}2|S Nzutf-8)r1 encoder r( r) lr+ local_lenr, s r r2 z&StringSizer..RepeatedFieldSize s_ #e**$f * *' IgnnW-- . .""1%%))
mr c b | d } | z |z S rL rM r rO r+ rP r, s r r4 z StringSizer..FieldSize s:
)ELL))
*
*a
((++
+a
//r r# r r1 r" r6 r7 r2 r4 r+ rP r, s @@@r StringSizerrV l
#
#( )
0 0 0 0 0 0 0 r c r t | t t |rJ |r fd}|S fd}|S )z"Returns a sizer for a bytes field.c n t | z }| D ] } | }| | |z z
} |S r/ r0 rN s r r2 z%BytesSizer..RepeatedFieldSize sS #e**$f * *' Ig ""1%%))
mr c < | } | z |z S r/ r rS s r r4 z BytesSizer..FieldSize
s.
)E
a
((++
+a
//r rT rU s @@@r
BytesSizerr[ rW r c P t | dz |rJ |rfd}|S fd}|S )z"Returns a sizer for a group field.r c d t | z }| D ]}|| z
}|S r/ r1 ByteSize)r r( r) r, s r r2 z%GroupSizer..RepeatedFieldSize s? #e**$f % %''""$$$
mr c 2 | z S r/ r_ )r r, s r r4 z GroupSizer..FieldSize s
((
((r )r# )r" r6 r7 r2 r4 r, s @r
GroupSizerrb sj l
#
#a
'(
) ) ) ) ) r c ^ t | t |rJ |rfd}|S fd}|S )z$Returns a sizer for a message field.c t | z }| D ]'}| }| | |z z
}(|S r/ r^ )r r( r) rO r+ r, s r r2 z'MessageSizer..RepeatedFieldSize) sU #e**$f * *' ""1%%))
mr c N | } | z |z S r/ ra )r rO r+ r, s r r4 z MessageSizer..FieldSize1 s.
..
a
((++
+a
//r r5 )r" r6 r7 r2 r4 r+ r, s @@r MessageSizerrf " sx l
#
#(
0 0 0 0 0 0 r c t d dz t d z t | z t d z t fd}|S )zReturns a sizer for extensions of MessageSet.
The message set message looks like this:
message MessageSet {
repeated group Item = 1 {
required int32 type_id = 2;
required string message = 3;
}
}
r r r
c N | } | z |z S r/ ra )r rO r+ static_sizes r r4 z&MessageSetItemSizer..FieldSizeJ s.
A ))!,, ,q 00r r5 )r" r4 r+ ri s @@r MessageSetItemSizerrj ; sg !q 8A;;.\1J1JJ! + 1 1 1 1 1 1
r c T | j t | j dd fd}|S )z Returns a sizer for a map field.Fc d}| D ]E}| | } || }| | z
}r| F|S )Nr keyr )_concrete_classr_ ) map_valuetotalrn r entry_msgis_message_map
message_sizer message_types r r4 zMapSizer..FieldSize] sl
E
ne ..3e.DDi }}Y'''e
Lr )ru rf number)field_descriptorrs r4 rt ru s ` @@r MapSizerrx U sO
"., / 6uEE-
r c F t j d j dfd } | S )zBReturn an encoder for a basic varint value (does not include tag).>BNc |dz }|dz }|r# | d|z |dz }|dz }|# | | S )Nr r r writer unused_deterministicbitslocal_int2bytes r EncodeVarintz$_VarintEncoder..EncodeVarintw ss 4.EncodeSignedVarint s qyy e 4.SpecificEncoder..EncodePackedField s
i . .G
$$W--
-$$5$
666 6 6G
,ug}
5
5
5
5 6 6r c B |D ]} | | || d S r/ r )r~ r r r) r r s r EncodeRepeatedFieldzD_SimpleEncoder..SpecificEncoder..EncodeRepeatedField sC 6 6G
%
,ug}
5
5
5
5 6 6r c 4 | | || S r/ r )r~ r r r r s r EncodeFieldz<_SimpleEncoder..SpecificEncoder..EncodeField s'
i|E5-888r r r WIRETYPE_LENGTH_DELIMITEDr ) r" r6 r7 r r r r r r* r r s @@r SpecificEncoderz'_SimpleEncoder..SpecificEncoder s <)NOOi(6 6 6 6 6 6 6 6 <33i6 6 6 6 6 6 ! <33i9 9 9 9 9 9 r r )r r r* r s ``` r _SimpleEncoderr s0 6
r c fd}|S )zLike SimpleEncoder but additionally invokes modify_value on every value
before passing it to encode_value. Usually modify_value is ZigZagEncode.c |r,t | t j t
fd}|S |rt |
fd}|S t |
fd}|S )Nc | d}|D ]}| | z
} | || |D ]} | | | d S r' r )
r~ r r r r) r* r r r= r s
r r zD_ModifiedEncoder..SpecificEncoder..EncodePackedField s
i < .SpecificEncoder..EncodeRepeatedField sQ D DG
%
,ull7 3 3]
C
C
C
C D Dr c F | | | | S r/ r )r~ r r r r= r s r r z>_ModifiedEncoder..SpecificEncoder..EncodeField s1
i|E<<#6#6
FFFr r ) r" r6 r7 r r r r r r* r r= r s @@r r z)_ModifiedEncoder..SpecificEncoder s <)NOOi(D D D D D D D D D <33iD D D D D D D ! <33iG G G G G G G r r )r r r* r= r s ```` r _ModifiedEncoderr s6 6
r c B t j fd}|S )zReturn a constructor for an encoder for a fixed-width field.
Args:
wire_type: The field's wire type, for encoding tags.
format: The format string to pass to struct.pack().
c t j |r,t | t j t
fd}|S |rt | d fd }|S t | d fd }|S )Nc | | t | z | |D ]} | | d S r/ r0 ) r~ r r r) formatr local_struct_packr rD s r r zF_StructPackEncoder..SpecificEncoder..EncodePackedField sm
i5#e**z"9=III 4 4G
%!!&'22
3
3
3
3 4 4r c R |D ]"} | | | #d S r/ r )r~ r r r) r r r s r r zH_StructPackEncoder..SpecificEncoder..EncodeRepeatedField sM 4 4G
%
%!!&'22
3
3
3
3 4 4r c D | | | S r/ r )r~ r r r r r s r r z@_StructPackEncoder..SpecificEncoder..EncodeField s1
iu&&vu55666r r/ r r r r r r ) r" r6 r7 r r r r r r r rD r s @@@r r z+_StructPackEncoder..SpecificEncoder s <)NOOi(4 4 4 4 4 4 4 4 4
<33i4 4 4 4 4 4 4 4 ! <33i7 7 7 7 7 7 7 7 r )r calcsize)r r r rD s `` @r _StructPackEncoderr sA v&&* 2
r c t j dk rd n dk rd nt dz fd}|S )aq Return a constructor for an encoder for float fields.
This is like StructPackEncoder, but catches errors that may be due to
passing non-finite floating-point values to struct.pack, and makes a
second attempt to encode those values.
Args:
wire_type: The field's wire type, for encoding tags.
format: The format string to pass to struct.pack().
r c |t k r
| d d S |t k r
| d d S ||k r
| d d S )Ns s s _POS_INF_NEG_INFr~ r s r EncodeNonFiniteOrRaisez5_FloatingPointEncoder..EncodeNonFiniteOrRaise- si (
!""""" H
!""""" E>>
!"""""
r r c |t k r
| d d S |t k r
| d d S ||k r
| d d S )Ns s s r r s r r z5_FloatingPointEncoder..EncodeNonFiniteOrRaise8 si (
122222 H
122222 E>>
122222
r zGCan't encode floating-point values that are %d bytes long (only 4 or 8)c t j |r-t | t j t
fd}|S |rt | d
fd }|S t | d
fd }|S )Nc | | t | z | |D ]4} | | # t $ r | | Y 1w xY wd S r/ )r1 SystemError)
r~ r r r) r r r r r rD s
r r zI_FloatingPointEncoder..SpecificEncoder..EncodePackedFieldJ s
i5#e**z"9=III 3 3G 3 E##FG44 5 5 5 5 3 3 3 " "5' 2 2 2 2 2 3 3 3s AA A c |D ]?} | | | $# t $ r | | Y .SpecificEncoder..EncodeRepeatedFieldW s 3 3G
%
3 E##FG44 5 5 5 5 3 3 3 " "5' 2 2 2 2 2 3 3 3s (A Ac | | | d S # t $ r | | Y d S w xY wr/ r )r~ r r r r r r s r r zC_FloatingPointEncoder..SpecificEncoder..EncodeFielda ss
i /
%!!&%00
1
1
1
1
1 / / /
.
.
.
.
.
. /s % ??r/ r )
r" r6 r7 r r r r r r r r rD r s
@@@r r z._FloatingPointEncoder..SpecificEncoderE s <)NOOi( 3 3 3 3 3 3 3 3 3 3 <33i3 3 3 3 3 3 3 3 3 ! <33i/ / / / / / / / / r )r r
ValueError)r r r r rD s `` @@r _FloatingPointEncoderr s v&&*1__ Q 35?@ A A A" " " " " " " "H
r z.EncodePackedField su eIE
M::: '
%
%
r Nc Z |D ]&} | |r | | 'd S r/ r )r~ r r r) r r r s r r z(BoolEncoder..EncodeRepeatedField sZ '
i
%
%
r c J | |r | S | S r/ r )r~ r r r r r s r r z BoolEncoder..EncodeField s; eI uY
U:
r r/ )r r r r WIRETYPE_VARINT)
r" r6 r7 r r r r r r r s
@@@@r BoolEncoderr s *) {'LMMI& {'BCCI {'BCCI
r c t | t j t t |rJ |r fd}|S fd}|S )z&Returns an encoder for a string field.c |D ]C}| d } | | | | | | Dd S rL rR )r~ r r r) encodedr rP tags r r z*StringEncoder..EncodeRepeatedField sh '..))
c
5))G"4"4mDDD
g r c | d } | | | | | | S rL rR )r~ r r r r rP r s r r z"StringEncoder..EncodeField sN W%%g eCjjj ' 2 2MBBB
U7^^r r r r r r1 r" r6 r7 r r r rP r s @@@r
StringEncoderr s { DEE#$)
r c t | t j t t |rJ |r fd}|S fd}|S )z%Returns an encoder for a bytes field.c j |D ].} | | | | | | /d S r/ r )r~ r r r) r rP r s r r z)BytesEncoder..EncodeRepeatedField sW '
c
5))G"4"4mDDD
g r c \ | | | | | | S r/ r )r~ r r r rP r s r r z!BytesEncoder..EncodeField s= eCjjj % 0 0-@@@
U5\\r r r s @@@r BytesEncoderr s { DEE#$)
r c t | t j t | t j |rJ |rfd}|S fd}|S )z%Returns an encoder for a group field.c j |D ].} | | | | | /d S r/ _InternalSerialize)r~ r r r) end_tag start_tags r r z)GroupEncoder..EncodeRepeatedField sQ '
i""5-888
g r c \ | | | | | S r/ r )r~ r r r r s r r z!GroupEncoder..EncodeField s7 eI um444
U7^^r )r r WIRETYPE_START_GROUPWIRETYPE_END_GROUP)r" r6 r7 r r r r s @@r GroupEncoderr s |[%EFF) \;#A B B'
r c t t | t j t |rJ |rfd}|S fd}|S )z'Returns an encoder for a message field.c |D ]B} | | | | | | | Cd S r/ r_ r )r~ r r r) r r s r r z+MessageEncoder..EncodeRepeatedField sc 9 9'
c
5'"2"2"4"4mDDD""5-88889 9r c | | | | | | | S r/ r )r~ r r r r s r r z#MessageEncoder..EncodeField sE eCjjj 0 0-@@@
%
%e]
;
;;r r )r" r6 r7 r r r r s @@r MessageEncoderr s} { DEE#$
9 9 9 9 9 9
< < < < < < r c 8 d t dt j t dt j t | t dt j g t dt j t fd}|S )zEncoder for extensions of MessageSet.
The message set message looks like this:
message MessageSet {
repeated group Item = 1 {
required int32 type_id = 2;
required string message = 3;
}
}
r r r r
c | | | | | | | | S r/ r )r~ r r end_bytesr start_bytess r r z*MessageSetItemEncoder..EncodeField sX E+uenn . .
>>> UM222 5 r ) r r r r r r r r r )r" r r r r s @@@r MessageSetItemEncoderr s q+233q+-..< q+788 : ; ;+
q+899)$
r c P | j t | j dd fd}|S )zEncoder for extensions of MessageSet.
Maps always have a wire format like this:
message MapEntry {
key_type key = 1;
value_type value = 2;
}
repeated MapEntry map = N;
Fc |r!t | n|}|D ],} ||| } | || -d S )Nrm )sortedkeysro )r~ r r
value_keysrn rr encode_messageru s r r z MapEncoder..EncodeField7 sn )6A
%%%EJ 6 6 ..3eCj.IIinUI}55556 6r )ru r rv )rw r r ru s @@r
MapEncoderr ( sI ".,!"2"95%HH.6 6 6 6 6 6
r )C__doc__
__author__r google.protobuf.internalr r r r r r# r9 r@ rI
Int32Sizer
Int64Sizer EnumSizer UInt32Sizer UInt64Sizer ZigZagEncode SInt32Sizer SInt64Sizer Fixed32Sizer
SFixed32Sizer
FloatSizer Fixed64Sizer
SFixed64Sizer DoubleSizer BoolSizerrV r[ rb rf rj rx r r r _EncodeSignedVarintr r r r r r r Int32Encoder Int64Encoder EnumEncoder
UInt32Encoder
UInt64Encoder
SInt32Encoder
SInt64EncoderWIRETYPE_FIXED32Fixed32EncoderWIRETYPE_FIXED64Fixed64EncoderSFixed32EncoderSFixed64Encoder FloatEncoder
DoubleEncoderr r r r r r r r r r r s >" "H 0
0 0 0 0 0 0
9 ; ; ; : : B '3l3D&E&E E
EZ) (L 5 5 5 k *N{/ 1 1 1 k .9[^^ ; ;}z-8[^^ ; ;}{ KNN , , $ 2 4 : " (
**,, K K K& & &R D# # #LJ J Jd -;N !46G-I -I I I|k !/ != != =
!1 0 ! !
%$[%A4HH$$[%A4HH$$[%A4HH$$[%A4HH'' (DdKK '' (DdKK
" " "J 0 , * 2 @ r