= "+Z d Z ddlZddlZddlZddlZddlmZ ddlmZm Z m
Z
m Z ddl m
Z
mZ ddlmZmZ ddlmZ ddlmZ dd lmZ dd
lmZ dd lmZm Z dd l m Z m Z dd
l m!Z! ej" e# Z$ej% & ej% j' z rdZ(ndZ(ej) * dej+ Z,ej) * dd Z-ej) * dd Z. e/ej) * dd Z0dZ1dZ2dZ3dZ4dZ5 G d d e6 Z7 G d d e7 Z8 G d d!e8 Z9 G d" d#e8 Z: G d$ d%e8 Z; G d& d'e8 Z< G d( d)ej= Z>d* Z? d?d+e@e>z fd,ZAe4fd+e@e>z fd-ZBd.ejC d/eDd0eEeFejC f fd1ZGd2 ZHe4dfd+e@e>z fd3ZIe4dd4d+e@e>z fd5ZJe G d6 d7 ZKe4e5fd8ejL d9e
e@ d0e e e@ df fd:ZM ejN e6ejO ejP ; d8ejL dZSdS )@u
This program is free software: you can redistribute it and/or modify it under
the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License,
or (at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program. If not, see .
Copyright © 2019 Cloud Linux Software Inc.
This software is also available under ImunifyAV commercial license,
see
N) dataclass)AnyAsyncGeneratorIterableList)quote_from_bytesurljoin)Requesturlopen)utils)
inactivity)Core)Malware)
LicenseCLN LicenseError)IAIDTokenErrorIndependentAgentIDAPI) MalwareTunez /opt/alt/curlssl/usr/bin/curlz /opt/alt/curlssl11/usr/bin/curlI360_MRS_API_BASE_URLI360_MRS_ENDPOINT_UPLOADz
api/v1/uploadI360_MRS_ENDPOINT_CHECKzapi/v1/check-known-hashes IMUNIFY360_POST_FILE_TIMEOUTi false_negativefalse_positiveunknowni c e Zd ZdZdS )
UploadFailurezBase for upload failuresN__name__
__module__ __qualname____doc__ [/opt/imunify360/venv/lib/python3.11/site-packages/imav/malwarelib/utils/malware_response.pyr r A s """"r% r c e Zd ZdZdS )ClientUploadErrorz!A client error during file uploadNr r$ r% r& r( r( E s ++++r% r( c e Zd ZdZdS )ConnectionErrorz%A connection error during file uploadNr r$ r% r& r* r* I s ////r% r* c e Zd ZdZdS ) TimeoutErrorz A timeout during file uploadNr r$ r% r& r, r, M s &&&&r% r, c e Zd ZdZdS )FileTooLargeErrorz File is too large to be uploadedNr r$ r% r& r. r. Q s ****r% r. c $ e Zd Z fdZd Z xZS )UploadFileResponseErrorc V t || _ d S N)super__init__response)selfr5 __class__s r& r4 z UploadFileResponseError.__init__V s$
r% c d| j S )Nzfailed with response: )r5 r6 s r& __str__z UploadFileResponseError.__str__Z s 7
777r% )r r! r" r4 r:
__classcell__)r7 s @r& r0 r0 U sG ! ! ! ! !8 8 8 8 8 8 8r% r0 c X e Zd ZdZd dededz fdZed Zd Zd Z d Z
d
Z dS ) MalwareHitPathzm
Wrapper that is used to send a file whose original contents may be located
in a different path.
N content_path real_pathc " || _ || _ d S r2 )
_content_path
_real_path)r6 r> r? s r& r4 zMalwareHitPath.__init__d s )#r% c | j S r2 )rA r9 s r& r> zMalwareHitPath.content_pathh s !!r% c t |t r | j |j k o| j |j k S | j |k S r2 )
isinstancer= rA rB )r6 others r& __eq__zMalwareHitPath.__eq__l sI e^ , , "e&99 8Ou'77
!U**r% c , | j | j S | j S r2 )rB r> r9 s r& r: zMalwareHitPath.__str__t s ? &? " r% c * | S r2 r: r9 s r& __repr__zMalwareHitPath.__repr__y ||~~ r% c * | S r2 rJ r9 s r&
__fspath__zMalwareHitPath.__fspath__| rL r% r2 ) r r! r" r# strr4 propertyr> rG r: rK rN r$ r% r& r= r= ^ s
$ $S $S4Z $ $ $ $ " " X"+ + +! ! !
r% r= c t j } | d | d | d | d | d | d d}d | D }|S ) Nidlimitstatustoken_expire_utctoken_created_utcsign)zI360-Idz
I360-Limitz I360-StatuszI360-Token-Expire-UtczI360-Token-Created-Utcz I360-Signc 4 i | ]\ }}|t | S r$ )rO ).0keyvalues r&
z%_token_to_headers.. s$ AAA:3sCJJAAAr% )r get_tokenitems)tokenheaderss r& _token_to_headersra sm " "E;Gn X!&'9!:"'(;"<6]
G BA AAAG Nr% filec v K |i }d | D }| }t | t r| j }t t j | d d }t j t g|z dt | d g|duz z ddt j |
d d
d d |fz d
dd| d gz }t j | d{V \ }} }
|dk rz|dk rt d |dk rt | d } d | | | |
} |dk rt! | t | | S )a
Post *file* as multipart/form-data to *url* with given HTTP *headers*.
Return server response as bytes (http body).
Raise TimeoutError on timeout.
Raise ConnectionError if failed to connect to host.
Raise ClientUploadError on error.
Nc n g | ]2\ }}d | d | d fz 3S )s -H%s: %sasciizlatin-1)encode)rY headerr[ s r&
z _post_file.. sN FE v}}W--u||I/F/FGG r% )safere s
--max-times --forms file=@"%s";filename="%s" \s \\ "s \"s --fails --silents --show-errorr zUpload timed out c x t | t rt | dd S t | S )N )rE bytesrepr)r[ s r&
_safe_textz _post_file.._safe_text s5 eU++ - ;;qt,,E{{"r% z#Failed to post file to {url}: {err})urlerr )r^ rE r= r> r osfsencoderf _CURLrO replacer runr, r( formatr* )
rb ru r` timeout headers_argsr> quoted_full_pathcmdrcoutrv rt safe_msgs
r&
_post_filer s $]]__ L L$'' )( ' D(9(9CCCJJ
U
#g,,--g66
77$;N
O P
' L))((v&&
JJw
, 3 ''''''LBS Qww
88 122 2
2XX#D)) )
#
#
#
>EE JsOO JsOO F H Qww%h///'111 Jr% c K t j st d t | t r| j n| }t j | }|t j
k r.t d | |t j
t t t }i t! d|i}t# | ||t$ d{V }t' j | }t, d| | | d dk rt3 | |S ) z
Upload a file to Malware Response Service.
:param file: path to file
:param upload_reason: one of 'unknown', 'false_positive', 'false_negative'
:return: dict representing json response
:raises LicenseError:
zCFile uploading to Malware Responce Serivce requires a valid licensez@File {} is {} bytes, files larger than {} bytes are not allowed.I360-Upload-Reasonr~ NzUploaded file %r to the Malware Response Service with reason: %s. More info: https://blog.imunify360.com/malware-protection-powered-by-imunify-cloudavrT ok)r is_validr rE r= r> rx pathgetsizeConfigMAX_MRS_UPLOAD_FILEr. r} r
_API_BASE_URL_ENDPOINT_UPLOADra r _POST_FILE_TIMEOUTjsonloadsdecodeloggerinfogetr0 )rb
upload_reasonr> file_sizeru r`
response_bodyresults r& upload_filer s
'
(n = =G4 --I6---
%vi!;
-!1
2
2C
m G % c7$6 M Z
,,..
/
/F
KK U
zz(t##%f--- Mr% futurer~ returnc K t j | } t j || d{V d|fS # t j $ r7 t d | d d|fcY S w xY w)a)
Wait for the future to complete for the specified timeout.
Returns (timed_out, shielded_future) where:
- timed_out: True if timeout occurred, False if future completed
- shielded_future: The shielded future that can be awaited later
Does not cancel the future on timeout.
NFz3Upload task timed out. Will continue in background.c B t j | t j d S )Nz+Background upload task failed after timeout)r log_future_errorsr warning)futs r& z¬ify_after_timeout.. s /= r% T)asyncioshieldwait_forr, r r add_done_callback)r r~ shieldeds r& notify_after_timeoutr s ~f%%H x111111111h LMMM""
X~ s 7 AA=<A=c l K t d| | t j d t | t r| j n| }t j
| s=t d| t j d dS g d}t | dz }|}t |d D ]\ }}t d||| | t j | d{V t j
| s=t d | t j d dS t# | d
| d{V }|s=t d | t j d dS |r t d
| | t j d dS # t j d w xY w)z9Helper coroutine to run the retry loop in the background.zQInitial upload failed for %s, reason: %s. Starting retry mechanism in background.zmrs-background-uploadz?File %s no longer exists. Cancelling background upload retries.N)g ?g @ ( d )startzBBackground retry attempt %d/%d for file %s. Retrying in %s secondsz?File %s was deleted during retry. Cancelling background upload.F) raise_errorsr z,Background upload for %s succeeded on retry.zBBackground upload for %s failed after all retries. Final error: %s)r r r
trackr rE r= r> rx r existsr stoplen enumerater sleep _try_uploaderror) rb r
initial_errorr> delays max_triesr ipauses r& _run_retries_in_backgroundr s
NN 233367 ",D.!A!A KD t w~~l++ KK
V 566666S 100KK!O !&222 HAu NN
-&& & & & & & & & 7>>,//
& 566666# &5
E
BD 566666
LL
566666
56666s AH 9B!H ;6H H !H3c K t | t r| j n| }t j | st
d| d t j d t | d|| d{V }n# t j $ r w xY w t j
d n$# t j
d w xY wt |t rt d| d t j d t | d|| d{V }n# t j $ r w xY w t j
d n$# t j
d w xY w|sdS t |t" r|t |t$ r t d
| |t |t t f rFt j }| t+ | || t# d |r|dS ) a
:param file: File to upload
:param upload_reason: Reason for upload
:param notify_timeout: Time in seconds after which to notify as pending but continue upload
:raises LicenseError,
ClientUploadError,
ConnectionError,
FileTooLargeError,
zFile z does not exist.z
mrs-uploadF)r r notify_timeoutNzConnection error for z , retrying.zmrs-upload-retryz#File %s is too big. Will not retry.z2Initial connection failed. Retrying in background.)rE r= r> rx r r r( r
r r r r CancelledErrorr r* r r r, r. get_event_loop create_taskr )rb r r r> r loops r& upload_with_retriesr c s (n = =G4 7>>, ' ' H F F F FGGG<(((
,! ')
!
l++++
l++++% ))
6@t@@@AAA 1222
6% " + - EE %
! !"4 5 5 5 5J ! !"4 5 5 5 5 t% && %*++ >
%'' &t]E B B
@
4s< 3B
C
B C !C#9E F E$$F !F))r r c K |_t j t | | }t || d{V \ }}|rt d }d|_ |S | d{V nt | | d{V nK# t t t t f$ r+}t
d| | |r |cY d}~S d}~ww xY wdS )a; Return error instead of raising it unless *raise_errors* is true.
:param notify_timeout: If set, returns TimeoutError after this many seconds but continues upload
:raises LicenseError:
:raises ClientUploadError,
TimeoutError,
ConnectionError,
FileTooLargeError: if raise_errors is True
N)r Upload notification timeout)r z#Failed to upload file %s. Error: %s) r r r r r, argsr( r* r. r debug) rb r r r upload_task timed_outr r es r& r r s0 %!-D
>>> K )=^) ) # # # # # # Ix
$%BCC =
NNNNNNNN d-@@@ @ @ @ @ @ @ @ :D!DDD 4s$ AA= A= = C C :C Cc $ e Zd ZU eed< eed< dS )HitInforb hashN)r r! r" rO __annotations__r$ r% r& r r s"
III
IIIIIr% r r hashesc K t | }t j r!t d |W V d S t j d {V }n3# t $ r&}t d| Y d }~d S d }~ww xY wt t t }||dd}t j
|| }t j dt j 5 |D ]} d| i}
t j dt! | d t j 5 t# | t% |t' j |
|d
d {V } | d W V n2# t, $ r%}t d
| Y d }~nd }~ww xY wd d d n # 1 swxY w Y d d d d S # 1 swxY w Y d S )Nz0NO_CHECK_KNOWN_HASHES is enabled, skipping checkz Failed to acquire IAID token: %szapplication/json)zX-Authr z Content-TypezCheck known hashes)logr zCheck z hashesPOST)datar` methodunknown_hashesz Failed to check known hashes: %s)listr NO_CHECK_KNOWN_HASHESr r r r] r r r r _ENDPOINT_CHECKr split_for_chunktimeitr r _do_requestr
r dumpsrf Exception) r r r
chunk_sizer_ r ru r` chunkschunkrequestr s r& check_known_hashesr s &\\F ( GHHH +577777777 91=== -
1
1C +* G
"6:
6
6F * < < < J J J JE 'G :s5zz : : : LLL
J
J J#. !%G!4!4!;!;!=!=$+#) $ $ F !!1222222 J J JNN#EqIIIIIIIIJ
J
J
J
J
J
J
J
J
J
J
J
J
J
J
J JJ J J J J J J J J J J J J J J J J Jsy A
B
$BB
":G
F3 AE54F35
F$ ?F F3 F$ $F3' G
3F7 7G
:F7 ;G
GG)on_errorr~ r c J K | d t | d {V S r2 )run_in_executor_do_request_sync)r r s r& r r sG %% r% c t d| j t | t j 5 }|j dk rGt d|j t d |j t j |
cd d d S # 1 swxY w Y d S )Nz
Requesting %sr r z HTTP response status code is %szstatus code is {})r r full_urlr r DEFAULT_SOCKET_TIMEOUTrT r r r} r r readr )r r5 s r& r r s
KK!1222 $"= > > > 4( ?c ! ! NNr s * ! ! ! ! ! ! 6 6 6 6 6 6 6 6 6 6 6 6 2 2 2 2 2 2 2 2 + + + + + + + + ! ! ! ! ! ! * * * * * * 1 1 1 1 1 1 > > > > > > F F F F F F F F . - - - - - 8 $ $ 5#6#== . +EE -E
68IJJ
:>>"