OwlCyberSecurity - MANAGER
Edit File: server.pyc
� �t�ac @ s d Z d d l m Z d d l Z d d l Z d d l Z d d l m Z m Z d d l m Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z d e e f Z e! � Z" e � Z# d � Z$ e% e$ _& d � Z' d � Z( d d d d d d d � Z) d e! f d � � YZ* d e j+ f d � � YZ+ d e! f d � � YZ, d e- f d � � YZ. d d d d d d! d" d# d g Z/ d S($ sQ This is a web-server which integrates with the twisted.internet infrastructure. i����( t print_functionN( t quotet unquote( t urlsplit( t implements( t defer( t failure( t Logger( t httpt iwebt fileuploadt responsecode( t http_headers( t rangefilter( t error( t __version__s Twisted/%s TwistedWeb/%sc C sZ | j j d � s( | j j d t � n | j j d � sV | j j d t j � � n | S( Nt servert date( t headerst hasHeadert setHeadert VERSIONt time( t requestt response( ( s /opt/cpanel-ccs/txweb2/server.pyt defaultHeadersFilter; s c C s& | j d k r" t j | | � n | S( Nt GETt HEAD( R R ( t methodR t checkPreconditions( R R ( ( s /opt/cpanel-ccs/txweb2/server.pyt preconditionfilterD s c C s� t j | � } d | j | j | j d | j d f } g } xE | j j � D]4 \ } } x% | D] } | j d | | f � qb WqO W| d j | � 7} t j t j i t j d d � d 6| � S( Ns %s %s HTTP/%d.%d i i s %s: %s t t messageR s content-type( R t IRequestR t urit clientprotoR t getAllRawHeaderst appendt joinR t ResponseR t OKR t MimeType( R t txtt lt namet valuelistt value( ( s /opt/cpanel-ccs/txweb2/server.pyt doTraceJ s id i i c s� � j j d k r t j d � S� j j d � } | d k rJ t j d � S� f d � } � f d � } d � } | j d k r� | j d k r� t j � j � } | j | | � | S| j d k rH| j d k rH| j j d � } | d k rt j t j t j t j d � � � St j � j | | | | � } | j | | � | St j t j t j t j d | j | j f � � � Sd S( sD Parse data of a POST request. @param request: the request to parse. @type request: L{txweb2.http.Request}. @param maxMem: maximum memory used during the parsing of the data. @type maxMem: C{int} @param maxFields: maximum number of form fields allowed. @type maxFields: C{int} @param maxSize: maximum size of file upload allowed. @type maxSize: C{int} @return: a deferred that will fire when the parsing is done. The deferred itself doesn't hold a return value, the request is modified directly. @rtype: C{defer.Deferred} i s content-typec s | } � j j | � d S( N( t argst update( t dataR0 ( R ( s /opt/cpanel-ccs/txweb2/server.pyt updateArgsu s c s0 | \ } } � j j | � � j j | � d S( N( R0 R1 t files( R2 R0 R4 ( R ( s /opt/cpanel-ccs/txweb2/server.pyt updateArgsAndFilesy s c S s; | j t j � t j t j t j t | j � � � � d S( N( t trapR t MimeFormatErrorR t HTTPErrort StatusResponseR t BAD_REQUESTt strR. ( t f( ( s /opt/cpanel-ccs/txweb2/server.pyR ~ s t applications x-www-form-urlencodedt multiparts form-datat boundarys' Boundary not specified in Content-Type.s Invalid content-type: %s/%sN( t streamt lengthR t succeedt NoneR t getHeadert mediaTypet mediaSubtypeR t parse_urlencodedt addCallbackst paramst gett failR R8 R9 R R: t parseMultipartFormData( R t maxMemt maxFieldst maxSizet ctypeR3 R5 R t dR? ( ( R s /opt/cpanel-ccs/txweb2/server.pyt parsePOSTData[ s< t StopTraversalc B s e Z d Z RS( s] Indicates to Request._handleSegment that it should stop handling path segments. ( t __name__t __module__t __doc__( ( ( s /opt/cpanel-ccs/txweb2/server.pyRS � s t Requestc B s, e Z d Z e e j � d Z d Z e e e j e g Z d � Z d � Z d � Z e e d � Z d d d d d d d d � Z d � Z d � Z d � Z d � Z d � Z d � Z e d � Z d � Z e j � Z d � Z! d � Z" d � Z# d � Z$ d � Z% d � Z& d � Z' d � Z( d � Z) RS( s� vars: site remoteAddr scheme host port path params querystring args files prepath postpath @ivar path: The path only (arguments not included). @ivar args: All of the arguments, including URL and POST arguments. @type args: A mapping of strings (the argument names) to lists of values. i.e., ?foo=bar&foo=baz&quux=spam results in {'foo': ['bar', 'baz'], 'quux': ['spam']}. c O s� d t j � f g | _ d | k r; | d | _ | d =n d | k r^ | d | _ | d =n i | _ i | _ | j | _ i | _ g | _ t j j | | | � y | j j j j j | _ Wn t k r� d | _ n Xd S( Nt tt sitet prepathurit Unknown( R t timeStampsRY t _initialprepatht _resourcesByURLt _urlsByResourcet responseFiltersR4 t resourcesR RW t __init__t chanRequestt channelt transportR t portt serverInstancet AttributeError( t selfR0 t kw( ( s /opt/cpanel-ccs/txweb2/server.pyRb � s" c C s | j j | t j � f � d S( N( R\ R% R ( Ri t tag( ( s /opt/cpanel-ccs/txweb2/server.pyt timeStamp� s c C s* y | j j j SWn t k r% d SXd S( N( Rc Rd t peerCredentialsRh RC ( Ri ( ( s /opt/cpanel-ccs/txweb2/server.pyt clientCredentials� s c C sI | r | | j k r d S| r2 | j j | � n | j j d | � d S( s Add a response filter to this request. Response filters are applied to the response to this request in order. @param filter: a callable which takes an response argument and returns a response object. @param atEnd: if C{True}, C{filter} is added at the end of the list of response filters; if C{False}, it is added to the beginning. @param onlyOnce: if C{True}, C{filter} is not added to the list of response filters if it already in the list. Ni ( R` R% t insert( Ri t filtert atEndt onlyOnce( ( s /opt/cpanel-ccs/txweb2/server.pyt addResponseFilter� s c C s� | d k r | j } n | d k r0 | j } n | d k rH | j } n | d k r` | j } n | d k rx | j } n | d k r� | j } n | d k r� d } n | t j j | d � k r� | } n | d t | � } t j | | | | | | f � S( s� Turn the request path into a url string. For any pieces of the url that are not specified, use the value from the request. The arguments have the same meaning as the same named attributes of Request.R i t :N( RC t schemet hostRf t pathRI t querystringR t defaultPortForSchemeRJ R; t urlparset urlunparse( Ri Ru Rv Rf Rw RI Rx t fragmentt hostport( ( s /opt/cpanel-ccs/txweb2/server.pyt unparseURL� s( c C s� | j d d k r� d | _ | _ | _ | _ | _ d | j k rk | j j d d � \ | _ | _ n | j | _ d | j k r� | j j d d � \ | _ | _ q� n3 t j | j � \ | _ | _ | _ | _ | _ } | j rt j | j t � | _ n i | _ t t | j d j d � � } | j r�t t | j d j d � � } | t | � | k r�| | _ | t | � | _ q�g | _ | | _ n g | _ | | _ d S( Ni t /R t ?i t ;( R" Ru Rv Rw RI Rx t splitRz t cgit parse_qst TrueR0 t mapR R] t lent prepatht postpath( Ri t _ignore_fragmentRw R� ( ( s /opt/cpanel-ccs/txweb2/server.pyt _parseURL s* %$ '3 c C so t | j d � r | j j s< t | j d � rk | j j rk | | j j k rR t S| | j j k rk t Sn t S( s� Try to determine the scheme matching the supplied server port. This is needed in case where a device in front of the server is changing the scheme (e.g. decoding SSL) but not rewriting the scheme in URIs returned in responses (e.g. in Location headers). This could trick clients into using an inappropriate scheme for subsequent requests. What we should do is take the port number from the Host header or request-URI and map that to the scheme that matches the service we configured to listen on that port. @param port: the port number to test @type port: C{int} @return: C{True} if scheme is https (secure), C{False} otherwise @rtype: C{bool} t EnableSSLt BehindTLSProxy( t hasattrRY R� R� t SSLPortR� t BindSSLPortst False( Ri Rf ( ( s /opt/cpanel-ccs/txweb2/server.pyt _schemeFromPortB s c C s | j j � \ } } | j s. d | | _ n | j rw t j | j | j � \ | _ | _ d | j | j � | _ n� | j j d � } | r� t j | j | � \ | _ | _ d | j | j � | _ n6 | j d k r� t j t j � � n t j t j � � d S( NR t httpsRv i ( R R� ( R R� ( R R� ( i i ( Rc t getHostInfoRu Rv R t splitHostPortRf R� R RD R# R8 R R: ( Ri t _ignore_hostaddrt secureRv ( ( s /opt/cpanel-ccs/txweb2/server.pyt _fixupURLParts] s $ ! c C sZ t j d | j | j d | j f � yi | j � | j � } | d k ri | j | � j | j � d S| j � | j � | j j � | _ Wn | j t j � � d SXt j � } | j | j | j j | j � | j | j d d j d � | j D� � � | j | j � | j d � | � | j | j � | j | j � | j d � | S( s Process a request.s %s %s %ss HTTP/%s.%sNR c s s | ] } t | � Vq d S( N( R ( t .0t s( ( s /opt/cpanel-ccs/txweb2/server.pys <genexpr>� s c S s | j | � S( N( t renderHTTP( t rest req( ( s /opt/cpanel-ccs/txweb2/server.pyt <lambda>� R ( t logt infoR R" R# t checkExpectt preprocessRequestRC t _cbFinishRendert addErrbackt _processingFailedR� R� Rc t getRemoteHostt remoteAddrR t FailureR t Deferredt addCallbackt _getChildRY t resourceR� t _rememberResourceR& t _processTimeStampt callback( Ri t respRQ ( ( s /opt/cpanel-ccs/txweb2/server.pyt processu s2 - c C s | j d � | S( Ns t-req-proc( Rl ( Ri R� ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s c C s� | j d k r$ t j t j � � n | j d k rk | j d k rk t j t j � } | j j d d � | S| j d k r� | j j d � r� | j j d � d } | r� | j | _ | | _ q� q� n d S( s� Do any request processing that doesn't follow the normal resource lookup procedure. "OPTIONS *" is handled here, for example. This would also be the place to do any CONNECT processing.i i t OPTIONSt *t allowR R t TRACEt POSTs X-HTTP-Method-Override( i i ( R R R� R� N( R# R R8 R R: R R" R' R( R R R t getRawHeaderst originalMethodRC ( Ri R t intendedMethod( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s c C sq | j j | � | s | S| j | | � } t | t j � rW | j | j | | | � S| j | | | | � Sd S( s? Call res.locateChild, and pass the result on to _handleSegment.N( Ra R% t locateChildt isinstanceR R� R� t _handleSegment( Ri t _R� Rw t updatepathst result( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s c s% | \ } � | d k r- t j t j � � n t | t j � ra | j � � � � � f d � � S� r� t d d j � � � } n d } � t k r� � St j | � } | � k r� � � k s� t d � � f � � t � � t � � k s� t d � � n � r�x@ t t � � t � � � D]" } � j j � j j d � � q Wt d d j � j � � j rx� j d rxd n d � } � j | | � nq y] � j � � } t | � d � d r�t � � d k r�d n d � } � j | | � Wn t k rn X� j d | � d � �} | S( s: Handle the result of a locateChild call done in _getChild.c s � j | � f � � � � S( N( R� ( t actualRes( t newpathRw R� Ri R� ( s /opt/cpanel-ccs/txweb2/server.pyR� � s R sP URL traversal cycle detected when attempting to locateChild %r from resource %r.s Infinite loop impending...i i����R i R� N( RC R R8 R t NOT_FOUNDR� R R� R� R R& RS R t IResourcet AssertionErrorR� t xrangeR� R% R� t popR� t urlForResourcet NoURLForResourceErrorR� ( Ri R� R� Rw R� t newrest urlR� t previousURLt child( ( R� Rw R� Ri R� s /opt/cpanel-ccs/txweb2/server.pyR� � s8 "'# <: c C s | | j | <| | j | <| S( s9 Remember the URL of a visited resource. ( R^ R_ ( Ri R� R� ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s c C s | j | =| j | =d S( s9 Remember the URL of a visited resource. N( R^ R_ ( Ri R� R� ( ( s /opt/cpanel-ccs/txweb2/server.pyt _forgetResource� s c C s4 | j j | d � } | d k r0 t | � � n | S( s� Looks up the URL of the given resource if this resource was found while processing this request. Specifically, this includes the requested resource, and resources looked up via L{locateResource}. Note that a resource may be found at multiple URIs; if the same resource is visited at more than one location while processing this request, this method will return one of those URLs, but which one is not defined, nor whether the same URL is returned in subsequent calls. @param resource: the resource to find a URI for. This resource must have been obtained from the request (i.e. via its C{uri} attribute, or through its C{locateResource} or C{locateChildResource} methods). @return: a valid URL for C{resource} in this request. @raise NoURLForResourceError: if C{resource} has no URL in this request (because it was not obtained from the request). N( R_ RJ RC R� ( Ri R� R� ( ( s /opt/cpanel-ccs/txweb2/server.pyR� s c C s� | d k r t j d � St | � \ } } } } } | s@ | rh t j t j t j d | f � � � n | j j | d � } | d k r� t j | � St | � j d � } | d d k s� t d | f � � | d } | d } d } x^ t | � rHd j | � d } | j j | d � } | d k r/Pq� | j d | j � � q� W| d k rn| j j } | d } n d � } t j | j d | | d t �} | j | j | � | j | � | S( sn Looks up the resource with the given URL. @param uri: The URL of the desired resource. @return: a L{Deferred} resulting in the L{IResource} at the given URL or C{None} if no such resource can be located. @raise HTTPError: If C{url} is not a URL on the site that this request is being applied to. The contained response will have a status code of L{responsecode.BAD_GATEWAY}. @raise HTTPError: If C{url} contains a query or fragment. The contained response will have a status code of L{responsecode.BAD_REQUEST}. s+ URL may not contain a query or fragment: %sR i R s" URL path didn't begin with '/': %si����i c S s0 | j t j � | j j j t j k r, | Sd S( N( R6 R R8 R. R t codeR R� RC ( R< ( ( s /opt/cpanel-ccs/txweb2/server.pyt notFoundO s R� N( RC R RB R R R8 R9 R R: R^ RJ R R� R� R� R& Ro R� RY R� t maybeDeferredR� R� R� R� R� ( Ri R� t _ignore_schemet _ignore_hostRw t queryR| t cachedt segmentst preSegmentst postSegmentst cachedParentt parentPathR� RQ ( ( s /opt/cpanel-ccs/txweb2/server.pyt locateResource s: # ! c C s� | d k s | d k r d Sd | k s; t d | f � � | j | � } | j d � sf | d 7} n | t | � } | } d � } t j | j d | | g d t �} | j | j | � | j | � | S( s6 Looks up the child resource with the given name given the parent resource. This is similar to locateResource(), but doesn't have to start the lookup from the root resource, so it is potentially faster. @param parent: the parent of the resource being looked up. This resource must have been obtained from the request (i.e. via its C{uri} attribute, or through its C{locateResource} or C{locateChildResource} methods). @param childName: the name of the child of C{parent} to looked up. to C{parent}. @return: a L{Deferred} resulting in the L{IResource} at the given URL or C{None} if no such resource can be located. @raise NoURLForResourceError: if C{resource} was not obtained from the request. R s" Child name may not contain '/': %sc S s0 | j t j � | j j j t j k r, | Sd S( N( R6 R R8 R. R R� R R� RC ( R< ( ( s /opt/cpanel-ccs/txweb2/server.pyR� u s R� N( RC R� R� t endswithR R R� R� R� R� R� R� ( Ri t parentt childNamet parentURLR� t segmentR� RQ ( ( s /opt/cpanel-ccs/txweb2/server.pyt locateChildResourceZ s $ c sx | j t j � d k r0 t j | j j � } n! � f d � } t j | | � } | j � j � | j � j | � | S( Nc s" t j � � � } | j � | � S( N( R t ICanHandleExceptiont renderHTTP_exception( t reasont handler( Ri ( s /opt/cpanel-ccs/txweb2/server.pyt _processingFailed_inner� s ( t checkR R8 RC R RB R. R R� R� R� R� t _processingReallyFailed( Ri R� RQ R� ( ( Ri s /opt/cpanel-ccs/txweb2/server.pyR� � s c C s� t j d | � t j d | � yB d } t j t j i t j d d � d 6| � } | j | � Wn! t j d � | j j � n Xd S( sb An error occurred when attempting to report an error to the HTTP client. s Exception rendering error pages Original exceptions� <html><head><title>Internal Server Error</title></head><body><h1>Internal Server Error</h1>An error occurred rendering the requested page. Additionally, an error occurred rendering the error page.</body></html>t textt htmls content-types� An error occurred. We tried to report that error. Reporting that error caused an error. In the process of reporting the error-reporting error to the client, there was *yet another* error. Here it is. I give up.N( R� R R R' R t INTERNAL_SERVER_ERRORR R) t writeResponseRc t abortConnection( Ri R� t origReasont bodyR ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s c s� � f d � } t j | d � } | rx t j � } x! � j D] } | j | | � q= W| j � j � | j | � | St j | d � } | r� � j j | � t j | j � � } | j � j � | St d � � d S( Nc sB t | d � s- | j d k r: | j d k r: | � | � S| Sd S( Nt handleErrorsi� i, ( R� R� ( R R< ( Ri ( s /opt/cpanel-ccs/txweb2/server.pyt filterit� s s$ html is not a resource or a response( R t IResponseRC R R� R` R� R� R� R� Ra R% R� R� R� t TypeError( Ri R� R� R RQ R< R� ( ( Ri s /opt/cpanel-ccs/txweb2/server.pyR� � s c C sE t j d | d | �d } t j t j i t j d d � d 6| � S( Ns& Exception rendering request: {request}R s� <html><head><title>Internal Server Error</title></head><body><h1>Internal Server Error</h1>An error occurred rendering the requested page. More information is available in the server log.</body></html>R� R� s content-type( R� R R R' R R� R R) ( Ri R� R� R� ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s N(* RT RU RV R R R! RC RY R] R R R t defaultErrorHandlerR R` Rb Rl Rn R� Rs R~ R� R� R� R� R� R� R� R� R� t weakreft WeakKeyDictionaryR_ R� R� R� R� R� R� R� R� R� ( ( ( s /opt/cpanel-ccs/txweb2/server.pyRW � s< ( 3 > & t Sitec B s e Z d � Z d � Z RS( c C s t j | � | _ d S( s Initialize. N( R R� R� ( Ri R� ( ( s /opt/cpanel-ccs/txweb2/server.pyRb � s c O s t d | | | � S( NRY ( RW ( Ri R0 t kwargs( ( s /opt/cpanel-ccs/txweb2/server.pyt __call__� s ( RT RU Rb R� ( ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s R� c B s e Z d � Z RS( c C s$ t j | d | f � | | _ d S( Ns' Resource %r has no URL in this request.( t RuntimeErrorRb R� ( Ri R� ( ( s /opt/cpanel-ccs/txweb2/server.pyRb � s ( RT RU Rb ( ( ( s /opt/cpanel-ccs/txweb2/server.pyR� � s R R R/ RR R (0 RV t __future__R R� R Rz t urllibR R R R� t zope.interfaceR t twisted.internetR t twisted.pythonR t twext.python.logR t txweb2R R R R R t txweb2.filter.rangeR R R t web2_versiont twistedt twisted_versionR t objectt _errorMarkerR� R R� R� R R/ RR RS RW R� R� R� t __all__( ( ( s /opt/cpanel-ccs/txweb2/server.pyt <module> sB " B� � 4