tq< d dl Z d dlZd dlZd dlZd dlmZmZ d dlmZ d dl m
Z
d dl m Z d dl
mZmZ d dlmZ d dlmZ d d lmZmZ d d
lmZ d d lmZ d Zd
\ ZZ Z ej dej Z ee e gZ!ede diZ"dZ#d Z$d Z% G d de Z& G d de Z'd(dZ(d)dZ)defd Z*d Z+d Z,d*d Z-d Z.d+d!Z/d" Z0d,d#Z1d-d$Z2d-d%Z3d& Z4d' Z5dS ). N)deletefunc) Inspector)make_url)
_ModuleMarker)RelationshipProperty sessionmaker) mysql_lib)FormattedException)Basehistory LVE_STATS_2_TABLENAME_PREFIX)alembic_migratez/var/lve/lvestats2.db)mysql
postgresqlsqlitez!<(?:user|password|host|database)>pymysqlpsycopg2shamanc t j | }t | }d |D |z
}t d t | D S )z^
Checks if views exist.
:param sqlalchemy.engine.base.Engine engine:
:return:
c " h | ] }t |z
S r ).0ns /builddir/build/BUILDROOT/lve-stats-4.3.2-1.el9.x86_64/opt/cloudlinux/venv/lib/python3.11/site-packages/lvestats/lib/dbengine.py z4find_not_existing_tables_or_views../ s DDD014DDD c 3 L K | ] }| t d V dS ) N)replacer )r xs r z4find_not_existing_tables_or_views..0 s1 ZZ7<<ZZZZZZr )r from_enginesetget_view_namestuple)enginenames inspectorexisting not_existings r !find_not_existing_tables_or_viewsr- ' sj %f--I9++--..HDDeDDDxOL ZZeLFYFYZZZ Z ZZr c t t j j } g d}t j | s t dz fd| D S )zc
Used to call engine.create_all() without views that are described as Table()
:return:
z;/opt/cloudlinux/flags/enabled-flags.d/burstable-limits.flagbursting_eventsc & g | ]
}|j v |S r name)r t tables_for_disabled_featuress r
z4get_list_of_tables_without_views..? s& L L L!/K!K!KA!K!K!Kr )
dictr metadatatablesvaluespathlibPathexistsappendr )r8 burstable_limits_feature_flagr4 s @r get_list_of_tables_without_viewsr? 3 s
$-&
'
'
.
.
0
0F#% $a! <5 6 6 = = ? ? ^$++,HK\,\]]] L L L Lv L L LLr c e Zd ZdS )MakeDbExceptionN__name__
__module__ __qualname__r r r rA rA B Dr rA c e Zd ZdS )DatabaseConfigErrorNrB r r r rH rH F rF r rH Tc B | d }|t dddid |r6|t vr-t d|d t dd | d }|t k r|t ddd id |t k r!| d
| d t
}nY|.t | rt d dd id t | }| d
| d| }t || }|S )z
Extract and validate database connection uri from config
:param dict cfg:
:param bool check_support:
:return str:
db_typeNz#"%(config_variable)s" not in configconfig_variablemessagecontextz}Incorrect database type %(database_type)s. You should only use %(database_types)s. The correct db_type for mariadb is "mysql"z", ")
database_typedatabase_typesconnect_stringz:///sqlite_db_pathzk"%(config_variable)s" contains placeholder values. Please set valid database credentials in the config file+z://)
getrH SUPPORTED_DATABASESjoinSQLITEDEFAULT_DB_PATH PLACEHOLDER_CONNECT_STRING_REsearchget_db_client_library_name
get_fixed_uri)cfg
check_supportrJ rQ uriclient_librarys r cfg_get_urira J s ggi G!=K\^gJh i i
(;;;! =-4 TgHhHhii
WW -..N&^ 3!=K\^nJo p p
&JJcgg&6 H HJJ %*G*N*N~*^*^ %% O 13C D
4G<<>>>>>n>>GS)) Jr Fc t j d } t | | }nN# t $ rA}d}dt | i} | || t
|| d |d}~ww xY w| d| d |d u r d
| v r| d
}|r&d }
t j
|d |
} n"t j
||| } | S )z
Create sqlalchemy database engine
:param dict cfg:
:param bool just_print:
:param bool debug:
:param pool_class:
:param bool check_support:
:return:
init_db_engine)r^ z2Unable to configure database connection. %(error)serrorrL NzConnecting to database: %srJ Fdebugc $ t | d S N)print)sql multiparamsparamss r dumpz make_db_engine..dump s #JJJJJr mock)strategyexecutor)echo poolclass) logging getLoggerra rH strrd rA info
sqlalchemyr(
create_engine) r]
just_printre
pool_classr^ logrQ emsgrN rl r( s r make_db_enginer} } s%
,
-
-CK$S
FFF K K KBCFF# #w #' B BCCJ K HH
)3y>::: ~~'S..G c "00 &[_0``"00 eWa0bb Ms (
A3. s VVV!AfIVVVr z?Model %s declares column %s which does not exist in database %sTr z>Model %s declares table %s which does not exist in database %sr r zWYou can run 'lve-create-db --create-missing-tables' command to recreate missing tables.zLYou can try to recreate malformed table, or ask CloudLinux support for help.)rr rs propagate
addHandler NullHandlerr r$ get_table_nameslist_decl_class_registryitems
isinstancer
__tablename__r= get_columnsrv inspectattrsr columnskeycritical)r( hide_loggingbaserz resultdatabase_inspection real_tables__classtable real_columnsmapper column_propcolumns r r r s
/
0
0C .
w*,,--- "ER_a
b
bF#/77%5577K$399;;<< 3 3 6 fm , , $| ##E*** K VV/B/N/Nu/U/UVVVL '//F %|
:
: k+?@@ :"-"5 : :!:\99 LL a & &
& 6:F> 2:
:
LLY[achjp q q q$(F= ! # $ + +E 2 2 2 2
m p nooo
n e cddd Mr c H t | d }|d |d k S )NT)r r r )r )r( inspect_results r check_need_create_dbr s* &vDAAAN * +~l/K KKr c t j | t t | d d S )N)r8 T)stamp)r r7
create_allr? r r( s r create_dbr s= M V,L,N,N OOOF$''''''r c l |st | rt | d S t | | d S )N)
lve_stats_cfg)r r r )r( create_missing_tablesr] s r setup_dbr sG 3 4V < < 3&c222222r c D t j | d S rg )r r7 drop_allr s r drop_tablesr s M6"""""r c . | }| } t t j j D ]\ }}|t | }nWt |t t f r t ||j
j |v }n t ||j
j |k }| | |
d S # t $ r | w xY wrg )connectbeginr r r7 r8 r r r r' r server_idexecutecommit Exceptionrollback)r( r conn_transr table_object delete_querys r
clear_rowsr s NN E KKMME #DM$8$>$>$@$@ A A ( (OA| %l 3 3 Ie}55
[ %lLN4LPY4Y Z Z %lLN4LPY4Y Z Z MM, ' ' ' '
s CC4 4 Dc B t | t | d S rg )r r r s r recreate_dbr s$
fr c 4 | t j t j |k t j t j t j dk t j
t j dk }|#| t j |k }|#| t j |k }d |D S )Nr c g | ]
}|d S r r )r record_s r r5 z(find_lost_keep_alive.. s 5 5 57GAJ 5 5 5r ) queryr
createdfilterr group_byhavingr maxidmin)sessionr
from_timestmp to_timestamplost_keepalives r find_lost_keep_aliver s
go&& !Y. / / '/ " " $$q( ) ) $$q( ) ) '..w,/NOO '..w-/OPP 5 5n 5 5 55r c t | ||| }|sd S d t t j j D }||t j j < |D ]*}t di |}||_ | | +|
|r&| dt | | d S d S )Nc i | ]}|d S r r )r cols r
z'fix_lost_keep_alive.. s QQQ3QQQQr z*Was fixed %s losted keep alive records: %sr )
r r r
__table__r keysr r r addr ru len) r r r r log_lost_keep_alivev2_keepalive_row timestamphistory_keepalives r fix_lost_keep_aliver s *7I}l[[O QQ$w/@/H/M/M/O/O*P*PQQQ.7W&*+$ ' ' # 7 7&6 7 7$-! %&&&& NN g >O@T@TVefffffg gr c t | }t ||d ||| | d S )N)bindr )r r r )r r close)r( r] r r r r s r fix_dbr sK 'l'''))G[!1 ]iptuuuu MMOOOOOr c f t | }|t dd| id |S )zZ
Get database Python client library name
:param str db_type:
:return str:
NzTThe client library to connect to the "%(database_type)s" database cannot be detectedrO rL )DB_CLIENT_LIBRARY_MAPrT rH )rJ r` s r r[ r[ ! sN +..w77N !t#W
r c | | t k r|S t | }t t j | S )zo
Get fixed URI for the specified database
:param str db_type:
:param str uri:
:return str:
)MYSQLr rt r
get_rfc1738_db_uri)rJ r_ us r r\ r\ 4 s8 %
A y+A.. / //r )T)FFNT)FNrg )NN)NNN)6rr r: resqlalchemy.enginerv r r sqlalchemy.engine.reflectionr sqlalchemy.engine.urlr &sqlalchemy.ext.declarative.clsregistryr sqlalchemy.ormr r clcommonr
clcommon.clexceptionr lvestats.ormr r
r lvestats.utils.dbmigratorr rX r
POSTGRESQLrW compile
IGNORECASErY rU r
__author__r- r? rA rH ra r} r r r r r r r r r r r[ r\ r r r r s # # # # # # # # 2 2 2 2 2 2 * * * * * * @ @ @ @ @ @ = = = = = = = = 3 3 3 3 3 3 & & & & & & & & 5 5 5 5 5 5 5 5 5 5 5 5) ; z6 !+
+OQSQ^ _ _ j&1 9
[ [ [ M M M ( , 0 0 0 0f! ! ! !H ,1t & & & &RL L L
( ( ( 3 3 3 3# # # $
6 6 6 6$g g g g" & 0 0 0 0 0r