OwlCyberSecurity - MANAGER
Edit File: server.pyc
� �t�ac @ s� d d l Z d d l Z d d l Z d d l m Z d d l m Z m Z d d l m Z d d l m Z m Z m Z d d l m Z d d l m Z d d l m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z d d l m Z m! Z! d d l" m# Z# d d l$ m% Z% d d l& m' Z' m( Z( d d l) m* Z* m+ Z+ m, Z, m- Z- m. Z. m/ Z/ m0 Z0 m1 Z1 m2 Z2 m3 Z3 m4 Z4 m5 Z5 m6 Z6 m7 Z7 m8 Z8 m9 Z9 m: Z: m; Z; m< Z< m= Z= m> Z> m? Z? m@ Z@ mA ZA d d lB mC ZC d d lD mE ZE d d lF mG ZG e � ZH d e jI f d � � YZJ d e f d � � YZK d e f d � � YZL eG e e jM � d eN f d � � Y� ZO d S( i����N( t ErrorLoggingMultiService( t getDBPoolt storeFromConfigWithDPSServer( t Logger( t MatchTypet MatchFlagst Operand( t service( t inlineCallbackst returnValue( t Factory( t IPlugin( t amp( t Namest NamedConstant( t Optionst UsageError( t memcachepool( t config( t DEFAULT_CONFIGt DEFAULT_CONFIG_FILE( t RecordWithShortNameCommandt RecordWithUIDCommandt RecordWithGUIDCommandt RecordsWithRecordTypeCommandt RecordsWithEmailAddressCommandt RecordsMatchingTokensCommandt RecordsMatchingFieldsCommandt MembersCommandt ExpandedMembersCommandt GroupsCommandt SetMembersCommandt VerifyPlaintextPasswordCommandt VerifyHTTPDigestCommandt WikiAccessForUIDCommandt ContinuationCommandt ExternalDelegatesCommandt StatsCommandt ExpandedMemberUIDsCommandt ContainsUIDsCommandt AddMembersCommandt RemoveMembersCommandt UpdateRecordsCommandt FlushCommandt SetAutoScheduleModeCommand( t AutoScheduleMode( t WikiAccessLevel( t implementert DirectoryProxyAMPProtocolc B s� e Z d Z d � Z d � Z d � Z e j d � � Z d � Z d � Z d � Z e j e d d � � � Z e j e d d � � � Z e j e d d � � � Z e j e d d d � � � Z e j e d d d � � � Z e j e d d d d � � � Z e j e d d d d d � � � Z e j e d � � � Z e j e d � � � Z e j e d � � � Z! e" j e d � � � Z# e$ j e d � � � Z% e& j e d � � � Z' e( j e d � � � Z) e* j e d � � � Z+ e, j e d � � � Z- e. j e d � � � Z/ e0 j e d � � � Z1 e2 j e d � � � Z3 e4 j e d � � � Z5 e6 j e d � � � Z7 e8 j e d � � � Z9 e: j e d � � � Z; RS(! s( Server side of directory proxy c C s/ t j j | � | | _ d | _ i | _ d S( s i�� N( R t AMPt __init__t _directoryt _maxSizet _continuations( t selft directory( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR2 F s c C s5 t t j � � } t j j � | | f | j | <| S( sJ Store an iterable of records and generate an opaque token we can give back to the client so they can later retrieve these remaining results that did not fit in the previous AMP response. @param things: an iterable @param kind: "items" or "records" @return: a C{str} token ( t strt uuidt uuid4t datetimet nowR5 ( R6 t thingst kindt token( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt _storeContinuationW s c C sH | | j k r2 | j | \ } } } | j | =n d } d } | | f S( s Retrieve the previously stored iterable of records associated with the token, and remove the token. @param token: a C{str} token previously returned by _storeContinuation @return: an iterable of records, or None if the token does not exist N( R5 t None( R6 R? t _ignore_timestampR= R> ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt _retrieveContinuationg s c C sn t j d d | �| j | � \ } } | d k rF | j | � } n$ | d k rd | j | � } n i } | S( s� The client calls this command in order to retrieve records that did not fit into an earlier response. @param continuation: the token returned via the "continuation" key in the previous response. s Continuation: {c}t ct recordst items( t logt debugRC t _recordsToResponset _itemsToResponse( R6 t continuationR= R> t response( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRK w s c C s� g } d } | r� d } x� | | j k r� y | j � } Wn t t f k rT Pn Xt j | j | � � } | t | � } | j | � | d 7} q Wn i | d 6} | r� | j | d � | d <n | S( sc Craft an AMP response containing as many records as will fit within the size limit. Remaining records are stored as a "continuation", identified by a token that is returned to the client to fetch later via the ContinuationCommand. @param records: an iterable of records @return: the response dictionary, with a list of pickled records stored in the "items" key, and if there are leftover records that did not fit, there will be a "continuation" key containing the token the client must send via ContinuationCommand. i i RF RE RK ( R4 t popt KeyErrort IndexErrort picklet dumpst recordToDictt lent appendR@ ( R6 RE t fieldsListt countt sizet recordt pickledRL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRI � s" c C s� g } d } | r� d } xh | | j k r y | j � } Wn t t f k rT Pn X| t | � } | j | � | d 7} q Wn i | d 6} | r� | j | d � | d <n | S( sH Craft an AMP response containing as many items as will fit within the size limit. Remaining items are stored as a "continuation", identified by a token that is returned to the client to fetch later via the ContinuationCommand. @param records: an iterable @return: the response dictionary, with a list of items stored in the "items" key, and if there are leftover items that did not fit, there will be a "continuation" key containing the token the client must send via ContinuationCommand. i i RF RK ( R4 RM RN RO RS RT R@ ( R6 RF t itemsToSendRV RW t itemRL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRJ � s c C s� i } | d k r� x� | j j � D]� \ } } | j d k rC q" n | j j j | � } | t t f k rz | | | j <q" | t j k r� t | � | | j <q" t | t t f � r" | r� | j n d | | j <q" q" Wn | S( sn Turn a record in a dictionary of fields which can be reconstituted within the client u memberDNsu memberUIDsN( u memberDNsu memberUIDs( RA t fieldst iteritemst nameR t fieldNamet valueTypet unicodet boolR9 t UUIDR8 t issubclassR R ( R6 RX R\ t fieldt valueR` ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRR � s &c c s� | } | j d � } t j d d | d | �| j j | j j j | � | d | �V} | j | � } i t j | � d 6} t | � d S( Ns utf-8s RecordWithShortName: {r} {n}t rt nt timeoutSecondsR\ ( t decodeRG RH R3 t recordWithShortNamet recordTypet lookupByNameRR RP RQ R ( R6 Rl t shortNameRi RX R\ RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRk � s c c s� | j d � } t j d d | �y | j j | d | �V} Wn, t k rm } t j d d | �d } n X| j | � } i t j | � d 6} t | � d S( Ns utf-8s RecordWithUID: {u}t uRi s Failed in recordWithUIDt errorR\ ( Rj RG RH R3 t recordWithUIDt ExceptionRp RA RR RP RQ R ( R6 t uidRi RX t eR\ RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRq � s c c sn t j | � } t j d d | �| j j | d | �V} | j | � } i t j | � d 6} t | � d S( Ns RecordWithGUID: {g}t gRi R\ ( R9 Rc RG RH R3 t recordWithGUIDRR RP RQ R ( R6 t guidRi RX R\ RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRv s c c sd | } t j d d | �| j j | j j j | � d | d | �V} | j | � } t | � d S( Ns RecordsWithRecordType: {r}Rg t limitResultsRi ( RG RH R3 t recordsWithRecordTypeRl Rm RI R ( R6 Rl Rx Ri RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRy s c c s^ | j d � } t j d d | �| j j | d | d | �V} | j | � } t | � d S( Ns utf-8s RecordsWithEmailAddress: {e}Rt Rx Ri ( Rj RG RH R3 t recordsWithEmailAddressRI R ( R6 t emailAddressRx Ri RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyRz / s c c s� g | D] } | j d � ^ q } t j d d d j | � �| j j | d | d | d | �V} | j | � } t | � d S( Ns utf-8s RecordsMatchingTokens: {t}t ts , t contextRx Ri ( Rj RG RH t joinR3 t recordsMatchingTokensRI R ( R6 t tokensR} Rx Ri R| RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR > s " t ORc c s� t j d � g } x]| D]U\ } } } } | j d � } | j d � } y | j j j | � } Wn t k r| d } n X| r� | j j j | � } | t j k r� t j | � } q� n | j d � } | j d � r/| j d � r/t j } x1 | d d !j d � D] } | t j | � O} q W| } n t j | � } t j | j d � � } | j | | | | f � q Wt j | � } | r�| j j j | � } n | j j | d | d | d | d | �V} | j | � } t | � d S( Nt RecordsMatchingFieldss utf-8t {t }i i����t ,t operandRl Rx Ri ( RG RH Rj R3 R_ Rm t ValueErrorRA R` R9 Rc t startswitht endswithR t nonet splitR RT R Rl t recordsMatchingFieldsRI R ( R6 R\ R� Rl Rx Ri t newFieldsR_ t searchTermt matchFlagst matchTypeRe R` t flagst flagRE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� M s< c c s� | j d � } t j d d | �y | j j | � V} Wn, t k rg } t j d d | �d } n Xg } | d k r� | j � V} n | j | � } t | � d S( Ns utf-8s Members: {u}Ro s Failed in membersRp ( Rj RG RH R3 Rq Rr Rp RA t membersRI R ( R6 Rs RX Rt RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� x s c c s� | j d � } t j d d | �y | j j | � V} Wn, t k rg } t j d d | �d } n Xg } | d k r� | j d t � V} n | j | � } t | � d S( Ns utf-8s ExpandedMembers: {u}Ro s Failed in membersRp t expanded( Rj RG RH R3 Rq Rr Rp RA R� t TrueRI R ( R6 Rs RX Rt RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt expandedMembers� s c c s | j d � } g | D] } | j d � ^ q } t j d d | d | �y | j j | � V} Wn, t k r� } t j d d | �d } n X| d k r� g } x= | D]5 } | j j | � V} | d k r� | j | � q� q� W| j | � Vt } n t } i | d 6} t | � d S( Ns utf-8s Add Members: {u} -> {m}Ro t ms Failed in addMembersRp t success( Rj RG RH R3 Rq Rr Rp RA RT t addMembersR� t FalseR ( R6 Rs t memberUIDsR� RX Rt t memberRecordst memberUIDt memberRecordR� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s( " c c s | j d � } g | D] } | j d � ^ q } t j d d | d | �y | j j | � V} Wn, t k r� } t j d d | �d } n X| d k r� g } x= | D]5 } | j j | � V} | d k r� | j | � q� q� W| j | � Vt } n t } i | d 6} t | � d S( Ns utf-8s Remove Members: {u} -> {m}Ro R� s Failed in removeMembersRp R� ( Rj RG RH R3 Rq Rr Rp RA RT t removeMembersR� R� R ( R6 Rs R� R� RX Rt R� R� R� R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s( " c c s | j d � } g | D] } | j d � ^ q } t j d d | d | �y | j j | � V} Wn, t k r� } t j d d | �d } n X| d k r� g } x= | D]5 } | j j | � V} | d k r� | j | � q� q� W| j | � Vt } n t } i | d 6} t | � d S( Ns utf-8s Set Members: {u} -> {m}Ro R� s Failed in setMembersRp R� ( Rj RG RH R3 Rq Rr Rp RA RT t setMembersR� R� R ( R6 Rs R� R� RX Rt R� R� R� R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s( " c c s� | j d � } | j d � } t j d d | d | �| j j | � V} t } | d k ro | j | � V} n i | d 6} t | � d S( Ns utf-8s ContainsUID: {u} {t}Ro R| t result( Rj RG RH R3 Rq R� RA t containsUIDR ( R6 Rs t testUidRX R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s c c s� | s� g | D] } | j d � ^ q } t j d d | d | �g } x= | D]5 } | j j | � V} | d k rN | j | � qN qN W| j j | d t �Vt } n t j d � t } i | d 6} t | � d S( Ns utf-8s Update Records: {u} create:{c}Ro RD t creates Update Records - cannot createR� ( Rj RG RH R3 Rq RA RT t updateRecordsR� R� R ( R6 t uidsR� R� t recordUIDsRE Rs RX R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� s " c c so | j d � } | j j | � V} | j d � } t j | � } | j j | | � Vi t d 6} t | � d S( Ns utf-8R� ( Rj R3 Rq R- Rm t setAutoScheduleModeR� R ( R6 Rs t autoScheduleModeRX RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� s c c s� | j d � } t j d d | �y | j j | � V} Wn, t k rg } t j d d | �d } n Xg } x" | j � VD] } | j | � q| W| j | � } t | � d S( Ns utf-8s Groups: {u}Ro s Failed in groupsRp ( Rj RG RH R3 Rq Rr Rp RA t groupsRT RI R ( R6 Rs RX Rt RE t groupRL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� * s c c s� | j d � } t j d d | �y | j j | � V} Wn, t k rg } t j d d | �d } n X| j � V} | j g | D] } | j d � ^ q� � } t | � d S( Ns utf-8s ExpandedMemberUIDs: {u}Ro s Failed in expandedMemberUIDsRp ( Rj RG RH R3 Rq Rr Rp RA t expandedMemberUIDsRJ t encodeR ( R6 Rs RX Rt R� Ro RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� < s +c c s� | j d � } t j d d | �| j j | � V} t } | d k r� y- | j | k rs i t d 6} t | � n Wn t k r� n X| j | � V} | r� | | _ q� n i | d 6} t | � d S( Ns utf-8s VerifyPlaintextPassword: {u}Ro t authenticated( Rj RG RH R3 Rq R� RA t _cached_passwordR� R t AttributeErrort verifyPlaintextPassword( R6 Rs t passwordRX R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� L s$ c c s& | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } | j d � } t j d d | �| j j | � V} t } | d k r | j | | | | | | | | | | � V} n i | d 6} t | � d S( Ns utf-8s VerifyHTTPDigest: {u}Ro R� ( Rj RG RH R3 Rq R� RA t verifyHTTPDigestR ( R6 Rs t usernamet realmt urit noncet cnoncet algorithmt nct qopRL t methodRX R� ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� e s* c c s� | j d � } | j d � } t j d d | d | �t j } | j j | � V} | ro | j j | � V} n d } | d k r� | j | � V} n i | j j d � d 6} t | � d S( Ns utf-8s WikiAccessForUID: {w} {u}t wRo t access( Rj RG RH R. R� R3 Rq RA t accessForRecordR^ R� R ( R6 t wikiUIDRs R� t wikiRecordt userRecordRL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt wikiAccessForUID� s c c s) | j j � Vi t d 6} t | � d S( Nt flush( R3 R� R� R ( R6 RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s c c s4 | j j � V} i t j | � d 6} t | � d S( Nt stats( R3 R� RP RQ R ( R6 R� RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s c c s: t j d � | j j � V} | j | � } t | � d S( Nt ExternalDelegates( RG RH R3 t" recordsWithDirectoryBasedDelegatesRI R ( R6 RE RL ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt externalDelegates� s N(< t __name__t __module__t __doc__R2 R@ RC R# t responderRK RI RJ RR R R RA Rk R Rq R Rv R Ry R Rz R R R R� R R� R R� R( R� R) R� R R� R' R� R* R� R, R� R R� R& R� R R� R! R� R" R� R+ R� R% R� R$ R� ( ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR0 A s| % $ ' t DirectoryProxyAMPFactoryc B s& e Z d Z e Z d � Z d � Z RS( s c C s | | _ d S( N( R3 ( R6 R7 ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR2 � s c C s t | j � S( N( R0 R3 ( R6 t addr( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt buildProtocol� s ( R� R� R� R0 t protocolR2 R� ( ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s t DirectoryProxyOptionsc B sP e Z d d e d g g Z d � Z d � Z d � Z d � Z e Z d � Z RS( R t fs Path to configuration file.c O s& t t | � j | | � i | _ d S( N( t superR� R2 t overrides( R6 t argst kwargs( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR2 � s c C s� | | k r� t | | t � r. | d k } q� t | | t t t f � rc t | | � | � } q� t | | t t f � r� | j d � } q� t | | t � r� t d � � q� | d k r� d } q� n | S( sG Coerce the given C{val} to type of C{configDict[key]} R� R� s. Dict options not supported on the command lineRA N( t isinstanceRb t intt floatt longt typet listt tupleR� t dictR RA ( R6 t configDictt keyRf ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt _coerceOption� s c C s� | d } t | � d k r9 | j | | | � | | <d S| | k r� t | | t � sg t d � � n | | k r� i | | <n | j | | | d | | | � n d S( s5 Set the value at path in configDict i i Ns8 Found intermediate path element that is not a dictionary( RS R� R� R� R t _setOverride( R6 R� t pathRf t overrideDictR� ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s c C s^ d | k rF | j d � \ } } | j t | j d � | | j � n | j d | f � d S( s Set an option to override a value in the config file. True, False, int, and float options are supported, as well as comma separated lists. Only one option may be given for each --option flag, however multiple --option flags may be specified. t =t /s %s=TrueN( R� R� R R� t opt_option( R6 t optionR� Rf ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s c C s2 t j | d � t j | j � d | j d <d S( NR t pidfile( R t loadt updateDefaultsR� RA t parent( R6 ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt postOptions s ( R� R� R t optParametersR2 R� R� R� t opt_oR� ( ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� � s t DirectoryProxyServiceMakerc B s# e Z d Z d Z e Z d � Z RS( t caldav_directoryproxys Directory Proxy Servicec C s y d d l m } Wn t k r' n X| d � t t d d d t � } y2 t t � \ } } t t | � } | j | � Wn) t k r� } t j d d | �� n Xt j t j j t j j � t j d � t d j d t j j � t | j � � � } | j | � t j j r y� d d l m } d j t j j � } | i t j j t k r]| n d d 6t j j t k r|| n d d 6t j d 6d d 6d d 6t j j d 6i t d 6| d 6| d 6| j � d 6d 6� } | j | � d | f GHWq t k rd GHq Xn | S( s" Return a service i����( t setproctitles& CalendarServer Directory Proxy Servicet i s" Failed to create directory serviceRp s Created directory services unix:{path}:mode=660R� ( t makeServices tcp:{:d}:interface=127.0.0.1t sshPortt telnetPortt sshKeyDirs manhole.keyt sshKeyNamei t sshKeySizet passwdR R t storeR7 t namespaces Manhole access enabled:sJ Manhole access could not enabled because manhole_tap could not be importedN(! R� t ImportErrorR R� R R R t setServiceParentRr RG Rp R t installPoolst Memcachedt Poolst MaxClientst infot strPortsServicet formatt DirectoryProxyt SocketPathR� t directoryServicet Manholet Enabledt twisted.conch.manhole_tapR� t DPSPortNumbert UseSSHR� RA t DataRoott PasswordFilePath( R6 t optionsR� t multiServicet poolt txnFactoryR� Rt t dpsServicet manholeMakeServicet portStringt manholeService( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� sX ( R� R� t tapnamet descriptionR� R R� ( ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyR� s (P t cPickleRP R; R9 t calendarserver.tap.caldavR t calendarserver.tap.utilR R t twext.python.logR t twext.who.expressionR R R t twisted.applicationR t twisted.application.strportsR t twisted.internet.deferR R t twisted.internet.protocolR t twisted.pluginR t twisted.protocolsR t twisted.python.constantsR R t twisted.python.usageR R t twistedcaldavR t twistedcaldav.configR t twistedcaldav.stdconfigR R t txdav.dps.commandsR R R R R R R R R R R R R! R" R# R$ R% R& R' R( R) R* R+ R, t txdav.who.idirectoryR- t txdav.who.wikiR. t zope.interfaceR/ RG R1 R0 R� R� t IServiceMakert objectR� ( ( ( s# /opt/cpanel-ccs/txdav/dps/server.pyt <module> s: � � � w U