fj-] d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
mZmZmZ ddl mZmZmZmZ ddlmZ ddlZddlmZ ddlmZ dd l m Z dd
l m Z m!Z!m"Z" dd l#m$Z$m%Z% dd l&m'Z' dd
l(m)Z)m*Z*m+Z+ ddl,m-Z- ddl.m/Z/ ddl0m1Z1m2Z2 e j3 r
ddl4m5Z5m6Z6m7Z7 e G d d Z8 ej9 e: Z; G d d Z'>kz~k$ v /&.1ABBB =Gy logginginfosi_pid_flush_mongodb_countersr oskillOSErrorwarning)rM siginfos r) _wait_for_sigusr2zAgent._wait_for_sigusr2o s $fn%566 9:A. J J J
$$&&& RSSS U GGNFN 3 3 3 3 3 U U U O S T T T T T T Us 1$B B98B9c t j t j t j h | n$# t
$ r t
j d Y nw xY w;)z
Setup SIGUSR2 handler that starts in-memory
storage flush when received.
When flushed, send SIGUSR2 back to the process that send signal.
Tz4Unable to process signal, see traceback for details.)r; r< r= r> r\ ExceptionrS exception)rM s r) _setup_signal_handlerzAgent._setup_signal_handler} s} v /&.1ABBB Z
Z&&((((
Z
Z
Z!"XYYYYY
Z Zs A A#"A#c ||gn
t }|D ]}t d| | | \ }}n%# t $ r t j d| Y Xw xY wt | 5 }| |j d d d n # 1 swxY w Y |j
dk r | ||j | ||j |j
d S )Nz7Updating task requests counters in mongo for task_id=%sz Unable to get client and task %snext_request_idtime)r loggerrT get_cached_or_loadr rS rZ r update_with_local_datarc
tracing_by
update_counts
request_count
tracing_count)rM task_idtasks_to_flush apiclientr" storages r) rV z Agent._flush_mongodb_counters s{ &-&9'|~~% 7 7G KKQSZ [ [ [
"&"9"9'"B"B 44
BGLLL
$G,,
U++G">">D % % ' ' '
" , ! .0 0 0 3? ! 0
" ,%,,,&*kkmm#
G'$++ 7"L2 2 2 2 z ' ' 'LL "` a a a $$&&&&&'
$QJE !,%,,, sZ E%5 E
C10E
1=D1.E
0D11E
E%
E E%E E%%E),E)c D | || \ |d< |d< dS )zj
Calculate throttling values and update given data
with resulting throttling stat
hitting_limitsthrottled_timeN)rE )rM datat_key cpu_values r) add_limit_faultszAgent.add_limit_faults s5
:>9L9L 9: : 6
%5 6 6 6r( php_pid cpu_usage
caller_uidc t d||| | j || | j dS )z
Called when php request starts and sends us welcome
request meaning that request started on the php side.
z=Received request init trigger from php=%s uid=%s cpu_usage=%sN)re rT rE saveflush)rM r r r s r) _handle_request_initzAgent._handle_request_init sZ SZ 4 4 4
)444 !!#####r( request_datac 2 | d | ||| t dt j | d | d | || d S )Nr z&[%s] Processing trace for task %s (%s)tracing_task_idurl)getr re rT r nameprocess_request_data)rM r r r r s r) _handle_request_endzAgent._handle_request_end s , - - 5 ! !, C C C <"$$) $$%677 $$U++ - - -
!!,
;;;;;r( i @ g @r r c J t | \ }}}n?# t $ r2 t d | Y dS w xY w| j 5 | j |d | j k r=t d| | ddd dS | j |xx dz
cc< ddd n # 1 swxY w Y | |||| | j 5 | j |xx dz cc< | j | dk r| j |= ddd dS # 1 swxY w Y dS # | j 5 | j |xx dz cc< | j | dk r| j |= ddd w # 1 swxY w Y w xY w)a
Handle incoming connection
:param connection: socket object usable to
send and receive data on the connection
:param workers_pool: pool where we can place
tasks for the futher processing
z1Failed to extract credentials, closing connectionNr z6Too many concurrent connections from uid=%s, rejectingr )
r rY re rZ r rJ rI r r: _process_connection)rM r r _pid_uid_gids r) r z Agent.handle_incoming_connection s ,Z 8 8 D$ NNN O O O FF
' - -$((q11T5QQQ WY]^^^ """ - - - - - - - -
!$ ' ' '1 , ' ' ' - - - - - - - - - - - - - - - 4 $ $Z tT J J J+
4
4%d+++q0+++(.!33 -d3
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4+
4
4%d+++q0+++(.!33 -d3
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4sj 8AA AC >C C#&C#+E
/EE
E
F"/F
F"F F" F F"r r c ` t | }| | j | d } | | }n# t
j $ r\}t dt | dt j i Y d }~| d S d }~wt t j f$ r4 t d|| Y | d S w xY w | n# | w xY w | | | j ||| d S | | j |||| d S # t( j $ r t d Y d S w xY w)
Nignore)errorszJSON decode failed: %st_nameextraz5Connection read timed out or failed for pid=%s uid=%s)r r r )r r r r zRequest %s was rejected because our workers thread pool is full of tasks. Increase queuemaxsize or max_threads in configuration.)r
settimeout
_READ_TIMEOUTmakefile
read_inputjsonJSONDecodeErrorre r strr r r rY sockettimeoutrZ r r r r r ) rM r r r r current_cpufileobj
input_dataes r) r zAgent._process_connection0 s1 6d;; d 0111!+!4!4H!4!E!E
11JJ# LL1 !!ffX~7G7G7L,M
O
O
O FFF
( NNR
'
'
'
J e ! ##D$=t.9d $ L L L L L ##D$# t $ r1}t t d t | z d}~ww xY w| | j
| S )z<
Initialize MongoDB client for current task
z9Cannot resolve tracing_task_id: no match found in storage)idall_idsr Nz"Cannot resolve tracing_task_id: %s)r4 r ) r r decodeKeyErrorr _keys RuntimeErrorr rA r6 )rM r task_storagereal_idr s r) instantiate_mongo_clientz Agent.instantiate_mongo_client^ so
N 011
@\@ *< 8 ? ? A AGG @ @ @#UVV%1*6*;*;*=*= ? ?@ @ @ @@
@
@
@
@
@
@
@
@
@
@
@
@
@
@
@ N N NA B C Cc!ff LMM M N &&7> ' @ @ @sN B
B3B>A11B5 B
BB
B B
C,CCc t d| j | j | }||j |j fS | | }| }t d||| | j 5 | j | }||j |j fcddd S t | j | j
k rit t | j }t
dt | j | | j | t || | j |< ddd n # 1 swxY w Y ||fS )z
Returns a client and task from cache of API data or
initialize client and GET task from MongoDB and add to cache
zCached API data: %sNz,Adding new container in cache: %s --> %s, %sz9api_data_cache at capacity (%d), evicting oldest entry %s)r! r" )re r rD r r! r" r get_taskrB r _MAX_CACHE_ENTRIESnextiterrT popr )rM r cached_datarn _t
oldest_keys r) rf zAgent.get_cached_or_loads s
*D,?@@@ )--l;; " %{'77 711,??
!
! C&I 7 7 7
% J J -11,??K&");+;; J J J J J J J J 4&''4+BBB !$t':";"; < <
W 3 4 4jB B B#''
3330@ FH1J 1J 1JD - J J J J J J J J J J J J J J J "} s *E:B E::E>E>c t t 5 }d | D }ddd n # 1 swxY w Y n+# t $ r t d Y dS w xY wt
| j D ]c}| j 5 || j v r9||vr5t d| | j
| ddd n # 1 swxY w Y ddS )z
Cleanup an API data im-memory cache dict in order not store
inactive (stopped, already completed) tasks there
c 6 g | ]}| S r' )r ).0ks r)
z0Agent.cleanup_api_data_cache.. s H H Hq
H H Hr( Nz,Unable to cleanup cache, storage unavailablez!Cleaning up inactive container %s) r r r r re rZ listrD rB rT r )rM r active_tasks_tasks r) rv z Agent.cleanup_api_data_cache s
011
I\ H HL4E4E4G4G H H H
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I NN>
@
@
@ FF
$-224455 3 3E)
3
3D ///E 4M4MKK CUKKK'++E222
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3 3 3sF A
A A
AA
A A
$A54A5'AC66C: =C: c |d }|t j | s t d| dS t j t t | | }t j | s t d|| dS |
| \ }}t d|j t |d |j 5 }| |j |j dk r(t d ddd dS | || }t d
| | t d | | n# t* $ r Y nw xY w|xj d z
c_ | |j ddd n # 1 swxY w Y |j r| |j |j d
k r"|j dk r| | dS dS dS )aK
Increment request ID in /usr/share/alt-php-xray/requests/{tracing_task_id} file
Substitute request_id and tracing_task_id in request_data.
Send request_data to ClickHouse
:param request_data: original request data
:param caller_uid: UID of the connecting process (from SO_PEERCRED)
r Nz*Rejecting request with invalid task id: %szSRejecting request from uid=%s for task %s: no matching task file in per-UID storagezProcessing task: %s)r rb r z*Tracing count is 0, nothing should be donezSending to ClickHousezSending to SmartAdvicer rd )r matchre rZ rW pathjoinr r isfilerf rT rl r is_manualrg rc rk update_request_datar? r@ r rV fake_idrh
complete_task) rM r r r owner_task_filer r" ro updated_request_datas r) r zAgent.process_request_data s $$56 !"( 66
K +- - - gll"C
OO\ C CO7>>/22
? . . . )),774 )4<888
-> ?&*n6 6 6 Q9@ ' '8O ' P P P!Q&& HIII Q Q Q Q Q Q Q Q $(#;#;L<@$B $B
KK/ 0 0 0 1 2 2 2
4555##$89999
# #q ( # # ' '8O ' P P P1 Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q4 > 7 ( ( 6 6 6 ?f $ $);q)@)@ t $ $ $ $ $ % $)@)@s> AH AH /GH
GH G.H HHr r" c |j dz |d< |j |d< |d D ]C}|j dz |d< |j |d< |d dk r | |d |d< Dt d| d | d t d | |S )
z
Substitute request_id and tracing_task_id
:param data: original input
:param task: a Task instance
:return: updated input
r
request_idr r type mysql_queryqueryz5Input updated: tracing_task_id = %s & request_id = %szFull updated input %s)rj rl hide_symbolsre rT r r )rM r r" items r) r zAgent.update_request_data s " /! 3\"&,
L A AD!%!3a!7D &*lD" #F|},, $ 1 1$w- @ @W
K "344dhh|6L6L N N N ,d333 r( r! zAPIClient instancerj rk c 4 | || dS )z:
Update task counters in mongodb instance
)rk rj N)update_counts_only)rM r! rj rk s r) ri zAgent.update_counts s0 !!
0= " ? ? ? ? ?r( r c t d|j t j d | |j dS )z_
Stop and complete request_qty task
:param _task: tracing task to stop
zTask %s should be completedr N)re rT rl rd rr _run_complete_task_cmd)rM r s r) r zAgent.complete_task sM
1 ( ( (
1
##EM22222r( c t j ddd| j d|gdt j d S # t j t j f$ r'}t d|| Y d }~d S d }~ww xY w)Nzcloudlinux-xray-managerstopz --system_idz--tracing_task_idx )r stderrz Failed to complete task %s: %s)
subprocess check_outputr6 PIPETimeoutExpiredCalledProcessErrorre r )rM rl r s r) r z Agent._run_complete_task_cmd s G #)6 t{#W% :?
4
4
4
4
4
4
):+HI G G G LL97A F F F F F F F F F Gs ,0 A2 A--A2r c \ d }t j d }t j ||| S )zA
Sanitize data in single quotes from MySQL query
c | d }| d }d }t j d|| d }| | |p| S )zL
Works with whole string in single or double quotes
quotetruncc b | d rdS | d rdS dS )zE
Works with characters inside quotes
digit0symbolxN)group)inner_ms r)
inner_replz8Agent.hide_symbols..replacer..inner_repl$ s@ ==)) 3 ]]8,, 3 r( z.((?P\d)|(?P[^0-9_:;\-/',. \\]))in_quote)r resub)mqtr
sanitizeds r) replacerz$Agent.hide_symbols..replacer sz A A
P )177:+>+>@ @I ,,AF,, ,r( zH(?P['"])(?P.*?)((?\.{3})))r compiler
)r r patterns r) r zAgent.hide_symbols s7
- - -2 * lmmvgx555r( )N)FN)r} N).r# r$ r% __doc__rs rt ru r psutil cpu_countrP r\ r` rV ry r boolr rH r r r rC r r r r r r io
TextIOBaser r r r r r rf rv r r ri r r staticmethodr r' r( r) r+ r+ @ s ! "2!1!3!3a!7 -V - / /! 3 .f . 0 02 5)-
"5 "5 "5 "5J U U U Z Z Z 7 7 7 743 3 3. */%)) ) M) "&) c]) /3) ) ) ) V :> $ $C $C $)1# $ $ $ $ <3 <3 <*. <B? ? ? ? 34 3D 3 3 3 3G G G 6# 6# 6 6 6 \ 6 6 6r( r+ )=r rF r r rS rW r r r; r r rd typing threadingr r r r r r r dataclassesr
r executorr xrayr
r xray.apiclientr xray.internal.constantsr r r xray.internal.exceptionsr r rE r xray.internal.local_countersr r r xray.internal.typesr xray.internal.user_plugin_utilsr xray.internal.utilsr r
TYPE_CHECKINGxray.apiclient.api_clientr r r r getLoggerr# re r+ r' r( r) r+ s
2 2 2 2 2 2 2 2 2 2 - - - - - - - - - - - - ! ! ! ! ! !
+ + + + + + % % % % % % \ \ \ \ \ \ \ \ \ \ < < < < < < < < ) ) ) ) ) )
% $ $ $ $ $ 9 9 9 9 9 9
8 $ $w6 w6 w6 w6 w6 w6 w6 w6 w6 w6r(