>{Se H d dl Z d dlZd dlmZ d dlmZ G d d ZdS ) N)db)
MessageToSendc e Zd ZdZddZddZdefdZdefd Z de
fd
Z e de
fd Z
e de
fd Zdd
efdZdeeeef ddfdZdefdZdS )PersistentMessagesQueuea
The queue to store messages sent to the server if it is unavailable.
- stores more recent data; if a limit is exceeded,
older messages are deleted.
- no duplicate messages are sent
NOTE: it is worth remembering that when writing a large number of messages,
the amount of memory used may increase by the size of the sqlite
cache (this may not be immediately obvious).
https://www.sqlite.org/pragma.html#pragma_cache_size
Nc L || _ || _ g | _ |pt | _ d S N)
_buffer_limit_storage_limit_bufferr _model)self buffer_limit
storage_limitmodels a/opt/imunify360/venv/lib/python3.11/site-packages/defence360agent/internals/persistent_message.py__init__z PersistentMessagesQueue.__init__ s) ) + ,} returnc | j rt j 5 | j | j | j | j z
}|dk r| j | g | _ d d d d S # 1 swxY w Y d S d S Nr )r
r atomicr insert_many storage_sizer
delete_old)r need_to_removes r push_buffer_to_storagez.PersistentMessagesQueue.push_buffer_to_storage s < "
"
" '' 555!%!2T5H!H!A%%K**>::: !
"
"
"
"
"
"
"
"
"
"
"
"
"
"
"
"
"
" " "s AA>>BBc g }t j 5 |t | j | j j | j j z
}| j d d d n # 1 swxY w Y || j
z
}g | _
t | S r
) r r listr select timestampmessagetuplesdeleteexecuter
sorted)r itemss r pop_allz PersistentMessagesQueue.pop_all' s
Y[[ + + T ""K)4;+> &((
E
K ( ( * * *
+ + + + + + + + + + + + + + + e}} s A=B B#&B#c 2 | dk S r )qsizer s r emptyz PersistentMessagesQueue.empty4 s zz||q r c : | j t | j z S r
)r lenr
r, s r r+ z PersistentMessagesQueue.qsize7 s 3t|#4#444r c * t | j S r
)r/ r
r, s r buffer_sizez#PersistentMessagesQueue.buffer_size: s 4< r c X | j S r
)r r! countr, s r r z$PersistentMessagesQueue.storage_size> s" {!!##))+++r r# c |t j }| j ||f | j | j k r| d S d S r
)timer
appendr1 r r )r r# r" s r putzPersistentMessagesQueue.putB s_ I Y 0111 t 1 1 1 ' ' ) ) ) ) ) 2 1r messagesc | j | | j | j k r| d S d S r
)r
extendr1 r r )r r8 s r put_manyz PersistentMessagesQueue.put_manyI sI H%%% t 1 1 1 ' ' ) ) ) ) ) 2 1r c d | j sq| j dk rf| j | j }| xj d | D z
c_ | j | | j r | j d \ }}|S t j )Nr )limitc " g | ] }|d d
S ) N ).0items r
z/PersistentMessagesQueue.get..S s A A A$T!""X A A Ar )
r
r r
get_oldestr r$ delete_inpopqueueEmpty)r r( _r# s r getzPersistentMessagesQueue.getN s | ) 1Q 6 6K**1C*DDE LL A A%,,.. A A A ALL K ! !% ( ( ( < ))!,,JAwNkmmr )r r N)r Nr
)__name__
__module__ __qualname____doc__r r r r) boolr- intr+ propertyr1 r bytesr7 tuplefloatr; rJ r@ r r r r sP
- - - -
"
"
"
" !t ! ! ! !5s 5 5 5 5 !S ! ! ! X! ,c , , , X,* *5 * * * **eE5L&9!: *t * * * *
U r r )rG r5 defence360agent.model.instancer &defence360agent.model.messages_to_sendr r r@ r r rW sw - - - - - - @ @ @ @ @ @Q Q Q Q Q Q Q Q Q Q r