OwlCyberSecurity - MANAGER
Edit File: database.pyc
� �t�ac @ s< d Z d g Z d d l Z y d d l m Z Wn e k rH e Z n Xd d l m Z d d l m Z m Z d d l m Z d d l m Z d d l m Z e � Z d e j f d � � YZ d e f d � � YZ d e f d � � YZ d e f d � � YZ e r"d e f d � � YZ n d e f d � � YZ d S( s' Generic ADAPI database access object. t AbstractADBAPIDatabasei����N( t postgres( t ConnectionPool( t inlineCallbackst returnValue( t ThreadPool( t Logger( t ConfigurationErrort ConnectionCloseThreadc B s2 e Z d Z d d d d d d d � Z d � Z RS( sR An L{Thread} that closes its DB connection when it has finished running. c C s\ | d k r! | | _ | j } n t t | � j d | d | d | d | d | d | � d S( Nt groupt targett namet argst kwargst verbose( t Nonet _realTargett targetWithConnectionCloset superR t __init__( t selfR R R R R R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR 0 s c O s0 | j | | � t | d � r, | j � n d S( Nt _db_close( R t hasattrR ( R R R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR 8 s N( ( t __name__t __module__t __doc__R R R ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR + s t ConnectionClosingThreadPoolc B s e Z d Z e Z d � Z RS( sV A L{ThreadPool} that closes connections for each worker thread when stopped. c so x[ � j j j � D]G \ } � x8 � j D]- } | j | k r) � � f d � | _ q) q) Wq Wt j � � d S( Nc s � j j � � S( N( t poolt disconnect( ( t connR ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt <lambda>I t ( R t connectionst itemst threadst identR R t stop( R t tidt thread( ( R R s) /opt/cpanel-ccs/twistedcaldav/database.pyR$ E s ( R R R R t threadFactoryR$ ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR > s c B s� e Z d Z d � Z d � Z e d � � Z d � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z d � Z d � Z d � Z e d � � Z e d � � Z d � Z d � Z d � Z e d � � Z d � Z e d � � Z e d � � Z d � Z e d � � Z e d � � Z e d � � Z e d � � Z d � Z d � Z e! d � Z" d � Z# e! d � Z$ d! � Z% RS(" s! A generic SQL database. c K s: | | _ | | _ | | _ | | _ | | _ t | _ d S( s� @param persistent: C{True} if the data in the DB must be perserved during upgrades, C{False} if the DB data can be re-created from an external source. @type persistent: bool N( t dbIDt dbapiNamet dbapiArgst dbapikwargst persistentt Falset initialized( R R( R) R* R, R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR R s c C s d | j j | j f S( Ns <%s %r>( t __class__R R ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt __repr__b s c c s� | j s�t | j | j | j � | _ | j d k r� | j j j � t d d � | j _ | j j j � | j | j j _ n y| j � V} | r~| j d � V} | j d � V} | | j � k s� | | j � k r�| | j � k r-t j d d | j d | d | j � �| j � V| j � Vq{| | j � k r{t j d d | j d | d | j � �| j | � Vq{q�n | j � Vt | _ Wq�| j j � d | _ � q�Xn d S( s� Access the underlying database. @return: a db2 connection object for this index's underlying data store. t sqlite3i s5 select VALUE from CALDAV where KEY = 'SCHEMA_VERSION's+ select VALUE from CALDAV where KEY = 'TYPE's0 Database {db} has different type ({t1} vs. {t2})t dbt t1t t2s6 Database {db} has different schema (v.{v1} vs. v.{v2})t v1t v2N( R. R R) R* R+ R t threadpoolR$ R t startt _test_schema_tablet _db_value_for_sqlt _db_versiont _db_typet logt errorR( t _db_removet _db_initt _db_upgradet Truet closeR ( R t testt versiont dbtype( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt opene s< $ c C s\ | j rX y | j j � Wn& t k rB } t j d d | �n Xd | _ t | _ n d S( Ns* Error whilst closing connection pool: {ex}t ex( R. R RC t ExceptionR= R> R R- ( R t e( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRC � s c c so xh d D]` } | j s$ | j � Vn y | j � VWn0 t k re } t j d d | �| j � q XPq Wd S( Ni i s Error in database clean: {ex}RH ( i i ( R. RG t _db_empty_data_tablesRI R= R> RC ( R t _ignoreRJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt clean� s c g su xn d D]f } | j s$ | j � Vn y | j | | � VWn0 t k rk } t j d d | �| j � q XPq Wd S( Ni i s Error in database execute: {ex}RH ( i i ( R. RG t _db_executeRI R= R> RC ( R t sqlt query_paramsRL RJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt execute� s c c sr xk d D]c } | j s$ | j � Vn y | j | � VWn0 t k rh } t j d d | �| j � q XPq Wd S( Ni i s% Error in database executescript: {ex}RH ( i i ( R. RG t _db_execute_scriptRI R= R> RC ( R t scriptRL RJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt executescript� s c g s� xp d D]h } | j s$ | j � Vn y | j | | � V} Wn0 t k rm } t j d d | �| j � q XPq Wt | � d S( Ni i s Error in database query: {ex}RH ( i i ( R. RG t _db_all_values_for_sqlRI R= R> RC R ( R RO RP RL t resultRJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt query� s c g s� xp d D]h } | j s$ | j � Vn y | j | | � V} Wn0 t k rm } t j d d | �| j � q XPq Wt | � d S( Ni i s! Error in database queryList: {ex}RH ( i i ( R. RG t _db_values_for_sqlRI R= R> RC R ( R RO RP RL RV RJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt queryList� s c g s� xp d D]h } | j s$ | j � Vn y | j | | � V} Wn0 t k rm } t j d d | �| j � q XPq Wt | � d S( Ni i s Error in database queryOne: {ex}RH ( i i ( R. RG R: RI R= R> RC R ( R RO RP RL RV RJ ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt queryOne� s c C s t � d S( sB @return: the schema version assigned to this DB. N( t NotImplementedError( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR; s c C s t � d S( sC @return: the collection type assigned to this DB. N( R[ ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR< s c C s | j d � S( Nt CALDAV( t _test_table( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR9 s c c s; t j d d | j �| j � V| j � V| j � Vd S( s< Initialise the underlying database tables. s Initializing database {db}R2 N( R= t infoR( t _db_init_schema_tablet _db_init_data_tablest _db_recreate( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR@ s c c sR | j d d d f t � V| j d | j � f � V| j d | j � f � Vd S( s� Initialise the underlying database tables. @param db_filename: the file name of the index database. @param q: a database cursor to use. R\ t KEYs text uniquet VALUEsm insert or ignore into CALDAV (KEY, VALUE) values ('SCHEMA_VERSION', :1) sc insert or ignore into CALDAV (KEY, VALUE) values ('TYPE', :1) N( Rb s text unique( Rc s text unique( t _create_tableRB RN R; R< ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR_ . s c C s t � d S( s< Initialise the underlying database tables. N( R[ ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR` K s c C s d S( s- Delete the database tables. N( ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRK Q s c C s d S( s/ Recreate the database tables. N( ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRa Y s c c s? | j r% | j | � V| j � Vn | j � V| j � Vd S( s. Upgrade the database tables. N( R, t _db_upgrade_data_tablest _db_upgrade_schemaR? R@ ( R t old_version( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRA a s c C s t d � � d S( sC Upgrade the data from an older version of the DB. s4 Persistent databases MUST support an upgrade method.N( R[ ( R Rg ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRe p s c c s | j d | j � f � Vd S( sG Upgrade the stored schema version to the current one. sH insert or replace into CALDAV (KEY, VALUE) values ('SCHEMA_VERSION', :1)N( RN R; ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRf x s c c s | j � V| j � Vd S( sB Remove all database information (all the tables) N( t _db_remove_data_tablest _db_remove_schema( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR? s c C s t d � � d S( sF Remove all the data from an older version of the DB. s) Each database must remove its own tables.N( R[ ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRh � s c c s | j d � Vd S( s9 Remove the stored schema version table. s drop table if exists CALDAVN( RN ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRi � s c g s9 | j | � } | j j | | � V} t t | � � d S( sw Execute an SQL query and obtain the resulting values. @param sql: the SQL query to execute. @param query_params: parameters to C{sql}. @return: an interable of values in the first column of each row resulting from executing C{sql} with C{query_params}. @raise AssertionError: if the query yields multiple columns. N( t _prepare_statementR t runQueryR t tuple( R RO RP t results( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRU � s c g sP | j | � } | j j | | � V} t t g | D] } | d ^ q2 � � d S( sx Execute an SQL query and obtain the resulting values. @param sql: the SQL query to execute. @param query_params: parameters to C{sql}. @return: an interable of values in the first column of each row resulting from executing C{sql} with C{query_params}. @raise AssertionError: if the query yields multiple columns. i N( Rj R Rk R Rl ( R RO RP Rm t row( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRX � s c g sZ d } xC | j | | � VD]. } | d k sB t d | | f � � | } q Wt | � d S( sQ Execute an SQL query and obtain a single value. @param sql: the SQL query to execute. @param query_params: parameters to C{sql}. @return: the value resulting from the executing C{sql} with C{query_params}. @raise AssertionError: if the query yields multiple rows or columns. s Multiple values in DB for %s %sN( R RX t AssertionErrorR ( R RO RP t valueRn ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR: � s " c G s" | j | � } | j j | | � S( s Execute an SQL operation that returns None. @param sql: the SQL query to execute. @param query_params: parameters to C{sql}. @return: an iterable of tuples for each row resulting from executing C{sql} with C{query_params}. ( Rj R t runOperation( R RO RP ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRN � s c C s t � d S( N( R[ ( R t type( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt _map_column_types� s c C s t � d S( N( R[ ( R R t columnst ifnotexists( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRd � s c C s t � d S( N( R[ ( R R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR] � s c C s t � d S( N( R[ ( R R t ontableRt Ru ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt _create_index� s c C s t � d S( N( R[ ( R RO ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRj � s (& R R R R R0 R RG RC RM RQ RT RW RY RZ R; R< R9 R@ R_ R` RK Ra RA Re Rf R? Rh Ri RU RX R: RN Rs R- Rd R] Rw Rj ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR M sD < t ADBAPISqliteMixinc B sS e Z e d � � Z e e d � � Z e d � � Z e e d � � Z d � Z RS( c C s� d } | j � } | d d k r+ d } nk | d d k rD d } nR | d j d � rd | d } n2 | d d k r} d } n | d d k r� d } n t | � d k r� | d d k r� | d 7} n | S( NR i t integert texts text(t datet serials! integer primary key autoincrementi t uniques unique( t splitt startswitht len( R t coltypeRV t splits( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRs � s " c c sl g | D]% \ } } d | | j | � f ^ q } d | rA d n d | d j | � f } | j | � Vd S( Ns %s %ss create table %s%s (%s)s if not exists R s , ( Rs t joinRN ( R R Rt Ru t colnameR� t colDefst statement( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRd s 2c c s% | j d | f � V} t | � d S( Ns] select (1) from SQLITE_MASTER where TYPE = 'table' and NAME = '%s' ( R: R ( R R RV ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR] s c c s= d | r d n d | | d j | � f } | j | � Vd S( Ns create index %s%s on %s (%s)s if not exists R s , ( R� RN ( R R Rv Rt Ru R� ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRw s c C s | S( N( ( R RO ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRj & s ( R R t classmethodRs R R- Rd R] Rw Rj ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRx � s t ADBAPIPostgreSQLMixinc B sb e Z e d � � Z e e d � � Z e d � � Z e e d � � Z e d � � Z d � Z RS( c C s� d } | j � } | d d k r+ d } ns | d d k rD d } nZ | d j d � rl d | d d } n2 | d d k r� d } n | d d k r� d } n t | � d k r� | d d k r� | d 7} n | S( NR i Ry Rz s text(t chari R{ R| i R} s unique( R~ R R� ( R R� RV R� ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRs / s " c c s� g | D]% \ } } d | | j | � f ^ q } d | d j | � f } y | j | � VWn< t j k r� | s| � n | j | � V} | s� � q� n Xd S( Ns %s %ss create table %s (%s)s , ( Rs R� RN R t DatabaseErrorR] ( R R Rt Ru R� R� R� R� RV ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRd D s 2c c s+ | j d | j � f � V} t | � d S( NsU select * from pg_tables where tablename = '%s' ( R: t lowerR ( R R RV ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR] X s c c sq d | | d j | � f } y | j | � VWn< t j k rl | sM � n | j | � V} | sm � qm n Xd S( Ns create index %s on %s (%s)s , ( R� RN R R� R] ( R R Rv Rt Ru R� RV ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRw ` s c c sm yR | j d d d f t � V| j d | j � f � V| j d | j � f � VWn t j k rh n Xd S( s� Initialise the underlying database tables. @param db_filename: the file name of the index database. @param q: a database cursor to use. R\ Rb s text uniqueRc s{ insert into CALDAV (KEY, VALUE) values ('SCHEMA_VERSION', :1) sq insert into CALDAV (KEY, VALUE) values ('TYPE', :1) N( Rb s text unique( Rc s text unique( Rd RB RN R; R< R R� ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR_ t s c C sP d } xC | j d | f � d k rK | j d | f d � } | d 7} q W| S( Ni s :%di����s %s( t findt replace( R RO t ctr( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyRj � s ( R R R� Rs R R- Rd R] Rw R_ Rj ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR� - s c B s e Z d � Z RS( c C s t d � � d S( Ns PostgreSQL module not available.( R ( R ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR � s ( R R R ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyR� � s ( R t __all__t threadingt txdav.base.datastore.subpostgresR t ImportErrorR t twisted.enterprise.adbapiR t twisted.internet.deferR R t twisted.python.threadpoolR t twext.python.logR t twistedcaldav.configR R= t ThreadR R t objectR Rx R� ( ( ( s) /opt/cpanel-ccs/twistedcaldav/database.pyt <module> s( � �:p