OwlCyberSecurity - MANAGER
Edit File: DistUpgradeCache.cpython-38.pyc
U ٪zc�� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl Z d dl m Z m Z ddlmZ ddlmZ ddlmZ G dd� de�ZG d d � d e�ZG d d � d e�Zd d� Ze� \ZZG dd� de�Z G dd� de�Z G dd� de j �Z e dk�r�d dl!Z!ddl"m#Z# ddl$m$Z$ e%d� e e#d�e$� d�Z&e%e&�'� � e!�(� e&�)� e&�*� e&j+ e&�,dg� e%e&�-� � e&�.� dS )� N)�Popen�PIPE� )�gettext)�ngettext)� inside_chrootc @ s e Zd ZdS )�CacheExceptionN��__name__� __module__� __qualname__� r r �>/usr/lib/python3/dist-packages/DistUpgrade/DistUpgradeCache.pyr ( s r c @ s e Zd ZdS )�CacheExceptionLockingFailedNr r r r r r , s r c @ s e Zd ZdS )� CacheExceptionDpkgInterruptedNr r r r r r 0 s r c C s� d} d}t �� d }t�d| �D ]`}|d| krD|t j�|�7 }q"|�d�dks"|�d�dks"|�d�dkrrq"q"| t j�|�7 } q"| dkr�t�d� d } |dkr�t�d � d }| d 7 } d }|d |kr�|d }||7 }| |fS )zjestimate the amount of space used by the kernel and initramfs in /boot, including a safety margin r � z /boot/*%s*z/boot/initrd.img-%sz initrd.imgz.bakz.dpkg-z>estimate_kernel_initrd_size_in_boot() returned '0' for kernel?i z>estimate_kernel_initrd_size_in_boot() returned '0' for initrd?i @i g�������?)�os�uname�glob�path�getsize�find�logging�warning)ZkernelZinitrdZkver�fZ initrd_bufferr r r �#estimate_kernel_initrd_size_in_boot4 s6 ��� r c @ s e Zd ZdZdd� Zdd� ZdS )�FreeSpaceRequiredz� FreeSpaceRequired object: This exposes: - the total size required (size_total) - the dir that requires the space (dir) - the additional space that is needed (size_needed) c C s || _ || _|| _d S �N)� size_total�dir� size_needed)�selfr r r r r r �__init__` s zFreeSpaceRequired.__init__c C s d| j | j| jf S )Nz@FreeSpaceRequired Object: Dir: %s size_total: %s size_needed: %s)r r r �r! r r r �__str__d s zFreeSpaceRequired.__str__N)r r r �__doc__r" r$ r r r r r X s r c @ s e Zd ZdZdd� ZdS )�NotEnoughFreeSpaceErrorzI Exception if there is not enough free space for this operation c C s || _ d S r )�free_space_required_list)r! r' r r r r" m s z NotEnoughFreeSpaceError.__init__N�r r r r% r" r r r r r& h s r& c @ s� e Zd ZdZdZdsdd�Zdd� Zed d � �Zd d � Z d d� Z dd� Z dd� Z dd� Z edd� �Zedd� �Zedd� �Zedd � �Zd d � Zd d � Zdtd!d"�Zd#d$� Zdud%d&�Zdvd'd(�Zdwd)d*�Zd+d,� Zd-d.� Zd/d0� Zd1d2� Z d3d4� Z d5d6� Z d7d8� Z dxd:d;�Z dyd<d=�Z!dzd>d?�Z"d{d@dA�Z#dBdC� Z$dDdE� Z%dFdG� Z&dHdI� Z'dJdK� Z(dLdM� Z)dNdO� Z*dPdQ� Z+dRdS� Z,e dTdU� �Z-dVdW� Z.dXdY� Z/edZd[� �Z0d\d]� Z1d^d_� Z2d`da� Z3dbdc� Z4e ddde� �Z5dfdg� Z6dhdi� Z7djdk� Z8dldm� Z9dndo� Z:d|dqdr�Z;dS )}�MyCacher � NTc C s0 g | _ g | _|| _|| _d| _d| _|| _| j�dd�| _d| _ |r�zt � � | � � d| _W n> t k r� } z dt|�kr�t|��t|��W 5 d }~X Y nX tj�| |� |�dd�| _| j�| d�| _tdd gtdd ��� d �� | _ | � � |� d d �dk�r dt j k�r t j�!dd� t j�!dd� d S )NF�Distro�MetaPkgs���Tzdpkg --configure -aZRemovalBlacklistFiler z-r)�stdoutZuniversal_newlinesr ZSourcesZFromZhardyZ RELEASE_UPGRADE_NO_RECOMMENDSzAPT::Install-Recommends�truez"APT::AutoRemove::SuggestsImportantZfalse)"� to_install� to_remove�view�quirks�lock�partialUpgrade�config�getlist�metapkgs� _listsLock�apt_pkg�pkgsystem_lock�lock_lists_dir� SystemError�strr r �apt�Cacher" ZgetListFromFile�removal_blacklistZ_get_linux_metapackage�linux_metapackager r � communicate�stripr � _initAptLog�getr �environ�set)r! r6 r2 r3 Zprogressr4 �er r r r" v s@ �� �zMyCache.__init__c C s2 | D ](}|j rq|jjtjkr|jddd� qdS )z! honor the dselect install state F)� auto_inst�auto_fixN)� is_installed�_pkgZselected_stater: ZSELSTATE_INSTALL� mark_install�r! �pkgr r r �_apply_dselect_upgrade� s z MyCache._apply_dselect_upgradec C sJ t � }| D ]:}|jr |jjs |jj| jks8|jj| jkr |�|j� q |S )zB return the packages not downloadable packages in reqreinst state ) rH � candidate� downloadablerM Z inst_state� ReInstReq� HoldReInstReq�add�name)r! � reqreinstrP r r r �req_reinstall_pkgs� s � �zMyCache.req_reinstall_pkgsc C s� | j }t|�dkr|tddt|��}tddt|��d�|� }|�||�r|| �� ddd gt|� }|�� �|� | � � d S d S ) z/ check for reqreinst state and offer to fix it r zRemove package in bad statez Remove packages in bad statez�The package '%s' is in an inconsistent state and needs to be reinstalled, but no archive can be found for it. Do you want to remove this package now to continue?z�The packages '%s' are in an inconsistent state and need to be reinstalled, but no archives can be found for them. Do you want to remove these packages now to continue?�, z /usr/bin/dpkgz--removez--force-remove-reinstreqTF) rY �lenr �joinZaskYesNoQuestion� release_lock�listZ getTerminalZcall�get_lock)r! r2 rX �headerZsummary�cmdr r r �fix_req_reinst� s& �� � zMyCache.fix_req_reinstc C s� | j �ddd�}tj�|�s&t�|� tj �d|� tj �dd� t�tj� |d�tj tj B tj B d�| _ tj�� }d | }t�| j |�d �� tj �d d � tj �d d � tj �dd � dS )z init logging, create log fileZFilesZLogDirz/var/log/dist-upgradezDir::LogzDir::Log::Terminalz apt-term.logzapt.logi� z Log time: %s zutf-8zDebug::pkgProblemResolverr/ zDebug::pkgDepCache::Markerz Debug::pkgDepCache::AutoInstallN)r6 �getWithDefaultr r �exists�makedirsr: rH �openr\ �O_RDWR�O_CREAT�O_APPEND�logfd�datetime�now�write�encode)r! Zlogdirrl r` r r r rE � s" � � zMyCache._initAptLogc C sZ t | d�r"t�| j� t�| j� t�d�| _t�d�| _t�| jd� t�| jd� d S )N� old_stdoutr r )�hasattrr �closero � old_stderr�dup�dup2rj r# r r r �_startAptResolverLog� s z MyCache._startAptResolverLogc C s4 t �d� t �d� t �| jd� t �| jd� d S )Nr r )r �fsyncrt ro rr r# r r r �_stopAptResolverLog� s zMyCache._stopAptResolverLogc s � fdd�}|S )z3 decorator to ensure that the apt output is logged c s& | d � � � | |�}| d �� |S �Nr )ru rw )�args�kwargs�res�r r r �wrapper� s z(MyCache.withResolverLog.<locals>.wrapperr )r r} r r| r �withResolverLog� s zMyCache.withResolverLogc C s, t �| j�}t �� }|�|| j| j� |jS )z< get the size of the packages that are required to download )r: ZPackageManager� _depcacheZAcquireZ get_archives�_list�_recordsZ fetch_needed)r! ZpmZfetcherr r r �required_download� s zMyCache.required_downloadc C s | j jS )z9 get the size of the additional required space on the fs )r Zusr_sizer# r r r �additional_required_space s z!MyCache.additional_required_spacec C s& z | j jW S tk r Y dS X dS )z< get the extra size needed to install the snap replacements r N)r3 Zextra_snap_space�AttributeErrorr# r r r �#additional_required_space_for_snaps s z+MyCache.additional_required_space_for_snapsc C s | j jdkS )z is the cache broken r )r Z broken_countr# r r r � is_broken s zMyCache.is_brokenc C s: t j�d�d }t �|�| _| jdk r6d| }t|��d S )NzDir::State::Listsr4 r zCan not lock '%s' )r: r6 �find_dirr_ r9 r )r! rW rI r r r r< s zMyCache.lock_lists_dirc C s | j dkr t�| j � d| _ d S )Nr r- )r9 r rq r# r r r �unlock_lists_dir s zMyCache.unlock_lists_dirc C sH | � � tj�| |�}| �� |r4|jr4ttd���|dkrDtd��dS )zf our own update implementation is required because we keep the lists dir lock z The server may be overloadedFzAapt.cache.update() returned False, but did not raise exception?!?N)r� r? r@ �updater< Zrelease_file_download_error�IOError�_)r! � fprogressr{ r r r r� " s zMyCache.updatec C s, t �d� | jr| �� tj�| ||� d S )Nzcache.commit())r �infor4 r] r? r@ �commit)r! r� Z iprogressr r r r� 1 s zMyCache.commitc C sN | j rJzt�� d| _ W n0 tk rH } zt�d| � W 5 d }~X Y nX d S )NFz failed to SystemUnLock() (%s) )r4 r: Zpkgsystem_unlockr= r �debug�r! Z pkgSystemOnlyrI r r r r] 7 s zMyCache.release_lockc C sN | j sJzt�� d| _ W n0 tk rH } zt�d| � W 5 d }~X Y nX d S )NTz failed to SystemLock() (%s) )r4 r: r; r= r r� r� r r r r_ ? s zMyCache.get_lockc C sB |r| j �|j�}n|jj}|dkr<t�d|j|f � dS |jS )z* check if the given pkg can be downloaded Nz1no version information for '%s' (useCandidate=%s)F)r �get_candidate_verrM Z current_verr r rW rS )r! rP Z useCandidate�verr r r rS G s zMyCache.downloadablec C s |j o| j�|j�S )z$ check if the pkg is auto-removable )rL r � is_garbagerM rO r r r �pkg_auto_removableR s �zMyCache.pkg_auto_removablec C s | j �� S )z^ try to fix broken dependencies on the system, may throw SystemError when it can't)r � fix_brokenr# r r r r� W s zMyCache.fix_brokenc C sL g | _ g | _| �� D ]2}|js$|jr2| j �|j� |jr| j�|j� qdS )z* create a snapshot of the current changes N)r0 r1 � get_changes�marked_install�marked_upgrade�appendrW � marked_deleterO r r r �create_snapshot\ s zMyCache.create_snapshotc C s | j �� d S r )r Zinitr# r r r �clearf s z MyCache.clearc C sZ t �| j�}| | �� | jD ]}| | }|�� q | jD ]}| | }|jddd� q:dS )z restore a snapshot F)rK rJ N)r: � ActionGroupr r� r1 � mark_deleter0 rN )r! � actiongrouprW rP r r r �restore_snapshoti s zMyCache.restore_snapshotc C s� | j �dd�}|D ]p}|| kr<| | jr<t�d| � dS d}| j �|d�D ]}||| kod| | jM }qN|rt�d| � dS qt�d� dS ) ac This checks if we run on a desktop or a server install. A server install has more freedoms, for a desktop install we force a desktop meta package to be install on the upgrade. We look for a installed desktop meta pkg and for key dependencies, if none of those are installed we assume server mode r+ r, z@need_server_mode(): run in 'desktop' mode, (because of pkg '%s')FT�KeyDependencieszIneed_server_mode(): run in 'desktop' mode, (because of key deps for '%s')z[need_server_mode(): can not find a desktop meta package or key deps, running in server mode)r6 r7 rL r r� )r! r8 �key� deps_foundrP r r r �need_server_modew s zMyCache.need_server_modec C sL | j rHzt�d� | �� W n* tk rF |�td�td�� Y dS X dS )zY check if the cache is ok and if the required metapkgs are installed z$Have broken pkgs, trying to fix themzBroken packagesz�Your system contains broken packages that couldn't be fixed with this software. Please fix them first using synaptic or apt-get before proceeding.FT)r� r r� r� r= �errorr� )r! r2 r r r � sanity_check� s �zMyCache.sanity_check� c K sT t �d||f � || krP| | jf |� | | jsP| | jsPt �d| � dS dS )NzInstalling '%s' (%s)z Installing/upgrading '%s' failedFT)r r� rN r� r� r� �r! rP �reason�flagsr r r rN � s zMyCache.mark_installc C sP t �d||f � || krL| | jrL| | �� | | jsLt �d| � dS dS )NzUpgrading '%s' (%s)zUpgrading '%s' failedFT)r r� rL � mark_upgrader� r� �r! rP r� r r r r� � s zMyCache.mark_upgradec K s. t �d||f � || kr*| | jf |� d S )NzRemoving '%s' (%s))r r� r� r� r r r � mark_remove� s zMyCache.mark_removec C s2 t �d||f � || kr.| j�| | jd� d S )NzPurging '%s' (%s)T)r r� r r� rM r� r r r � mark_purge� s zMyCache.mark_purgec C s, || kr(| | j r(| | jr(| �||� d S r )rL r� rN )r! �pkgnamer� r r r �_keep_installed� s ��zMyCache._keep_installedc C sh | j �dd�D ]}| �|d� q| jD ]D}|| kr&| | jsF| | jr&| j �|d�D ]}| �|d| � qTq&| j �dd�dk�rdt�d� | j �dd �D ]@}| D ]6}|j r�|j j r�|j r�|j j |kr�| �|j d | � q�q�| jD ]�}|| kr�| | j�s| | jr�| j �|d �D ]P}| D ]D}|j �r|j j �r|j �r|j j |k�r| �|j d ||f � �q�qq�d S ) z[ run after the dist-upgrade to ensure that certain packages are kept installed r+ ZKeepInstalledPkgsz Distro KeepInstalledPkgs rulez%s KeepInstalledPkgs rule�OptionsZ withNetwork�Truez"Running KeepInstalledSection rules�KeepInstalledSectionz$Distro KeepInstalledSection rule: %sz %s KeepInstalledSection rule: %sN)r6 r7 r� r8 rL r� rF r r� rR rS r� �sectionrW )r! r� r� r� rP r r r �keep_installed_rule� s< � � � �� �zMyCache.keep_installed_rulec C s | j s| j�d� dS )z. run before the upgrade was done in the cache ZPreDistUpgradeCacheN)r5 r3 �runr# r r r �pre_upgrade_rule� s zMyCache.pre_upgrade_rulec C s� d| j fd| jfd| jfd| jffD ]�\}}| j�dd| �D ]}||d| � q>| jD ]J}|| krX| | jsx| | jrX| j�|d| �D ]}||d||f � q�qXq$| j s�| j � d � d S ) z- run after the upgrade was done in the cache ZInstallZUpgradeZRemoveZPurger+ z PostUpgrade%szDistro PostUpgrade%s rulez%s PostUpgrade%s ruleZPostDistUpgradeCacheN) rN r� r� r� r6 r7 r8 rL r� r5 r3 r� )r! Zrule�actionrP r� r r r �post_upgrade_rule� s � �zMyCache.post_upgrade_rulec C sD t �d� zddlm} W n: ttfk rT } zt �d| � W Y �dS d}~X Y nX z�|dd�}|jD ]&}|| krh| | jrh| � |d � q�qht � d � W dS |� � }t �d | � || kr�t � d | � W dS | | j �s | | j�s | | �� t � d | � W dS W n2 tk �r> } zt �d| � W 5 d}~X Y nX dS )zR this checks for nvidia hardware and checks what driver is needed znvidiaUpdate()r )�NvidiaDetectionz%NvidiaDetector can not be imported %sFNz ./ubuntu-drivers-obsolete.pkgs)Zobsoletezold nvidia driverz1no old nvidia driver installed, installing no newz nv.selectDriver() returned '%s'z no '%s' foundz,installing %s as suggested by NvidiaDetectorTz$NvidiaDetection returned a error: %s)r r� Z NvidiaDetector.nvidiadetectorr� � ImportError� SyntaxErrorr� Z oldPackagesrL r� r� Z selectDriverr r� r� rN � Exception)r! r� rI ZnvZ oldDriverZdriverr r r �checkForNvidia s4 zMyCache.checkForNvidiac C s& | D ] }|j �d�r|jr dS qdS )Nzlinux-headers-TF)rW � startswithrL rO r r r � _has_kernel_headers_installed/ s �z%MyCache._has_kernel_headers_installedc C s� t �d| j � z| j�d�\}}}W n6 tk r\ } zt �d| � W Y �dS d}~X Y nX tdgtd��� d }d |kr�t �d � d S ) zd check for the running kernel and try to ensure that we have an updated version zKernel uname: '%s' �-z/Can't parse kernel uname: '%s' (self compiled?)FN�dmesg)r. r s WARNING: NR_CPUS limitzUP kernel on SMP system!?!T) r r� r �splitr� r r r rC )r! �versionZbuildZflavourrI r� r r r �checkForKernel6 s zMyCache.checkForKernelc C s� d}| j �dd�}| D ]�}|jj�|j�}|rJ|jdkrJt�d|j � q|j r|j j r|j s|j s|j |krd|j kr|j j|kr| �|j d| � qd S )N)Zrequiredr+ �RemoveEssentialOkr z Package %s has no priority set�:z;priority in required set '%s' but not scheduled for install)r6 r7 �_pcacher r� rM Zpriorityr r� rW rR rS rL r� rN )r! �need�removeEssentialOkrP r� r r r � checkPriorityF s& ���� �zMyCache.checkPriorityc C sT d}|� � r<|d dkr |�� |�� t�d� |d7 }q|jdd� |�� d S )Nr � g{�G�z�?r T)Zfinished)�lockedZ pulseProgress� processEvents�time�sleep)r! r2 r4 �ir r r � updateGUI[ s zMyCache.updateGUIc C sn t �� }|�� t j| j| j|fd�}|�� �z�z�| � � | � d� | � � | � � t � rht�d� n| �� | �� | �� | �|� |s�| �|� | �� | jr�ttd�d�dd� | D �� ��W n� tk �r� } z�td�}| j�d d �d k�r|td �7 }n4| j�d d �d k�r:| j�d d�d k�r:|td�7 }|�rN|td�7 }n|td�7 }|td�7 }| �� |� td�|� t |�}t� d|� | � � W Y �W �dS d }~X Y nX W 5 |�� |�� X g } g } | � � D ]�} | j �r�q�| j!�rl| �"| j#� | j$j%D ]^} t&�'| j(| j)j*�dk �r| j+D ]8\} }| j,j-�.| �}|�r*|j/�s*| �"| j#� �q�q*�q�q�| j0j1}d}|D ]}||j2O }�q||�s�| �"| j#� �q�z(| j�3dd�}|�r�t�d� W dS W n t4j5k �r� Y nX t6| �dk�r| �7� t� dd�| � � t6| �dk�rj| �7� t� d d�| � � | �� |� td �td �d �| �� | � � dS dS ) N)�targetry Tz5skipping kernel checks because we run inside a chrootz!Broken packages after upgrade: %srZ c s s | ]}|j s|jr|jV qd S r )Zis_inst_brokenZ is_now_brokenrW )�.0�pr r r � <genexpr>� s z&MyCache.distUpgrade.<locals>.<genexpr>zBAn unresolvable problem occurred while calculating the upgrade. r� Z foreignPkgsr� z�This was likely caused by: * Unofficial software packages not provided by Ubuntu Please use the tool 'ppa-purge' from the ppa-purge package to remove software from a Launchpad PPA and try the upgrade again. �FalseZ devReleasez�This was caused by: * Upgrading to a pre-release version of Ubuntu This is most likely a transient problem, please try again later. z@This is most likely a transient problem, please try again later.z�If none of this applies, then please report this bug using the command 'ubuntu-bug ubuntu-release-upgrader-core' in a terminal. z�If you want to investigate this yourself the log files in '/var/log/dist-upgrade' will contain details about the upgrade. Specifically, look at 'main.log' and 'apt.log'.z Could not calculate the upgradezDist-upgrade failed: '%s'Fr r+ ZAllowUnauthenticatedzAllowUnauthenticated set!z!Packages to downgrade found: '%s'� z$Unauthenticated packages found: '%s'z"Error authenticating some packagesz�It was not possible to authenticate some packages. This may be a transient network problem. You may want to try again later. See below for a list of unauthenticated packages.� )8� threadingZLock�acquireZThreadr� r2 �start�releaser\ r� Zupgrader� r� r r r r� r� r� �_keepBaseMetaPkgsInstalled�_installMetaPkgs�_verifyChangesr� r= r� r6 rF rw r� r> ru r� r� Zmarked_downgrader� rW rM � version_listr: Zversion_compareZver_str� installedr� � file_listr� r� Z find_indexZ is_trustedrR �origins�trusted� getboolean� configparser� NoOptionErrorr[ �sort)r! r2 Z serverModer5 r4 �trI ZdetailsZ error_msgZ untrustedZ downgraderP r� Z verFileIter�indexZ indexfiler� r� �origin�br r r � distUpgradef s� $� �� �� �zMyCache.distUpgradec C s t j�d�}| j�dd�}| �� D ]�}|jrX| �|j�rXt� d|j� t t d�|j ��|jr"|j j dkr"|jj|dfkr"|j|kr"t� d|j� t t d �|j ��q"| j�dd �}|D ]Z}|�d �\}}|| kr�| | jr�| | jj|kr�| | j�s| | jr�t t d �| ��q�dS ) zx this function tests if the current changes don't violate our constrains (blacklisted removals etc) zAPT::Architecturer+ r� zHThe package '%s' is marked for removal but it's in the removal blacklistzJThe package '%s' is marked for removal but it is in the removal blacklist.T�allzDThe package '%s' is marked for removal but it's an ESSENTIAL packagez1The essential package '%s' is marked for removal.Z BadVersionsr� z*Trying to install blacklisted version '%s')r: r6 r r7 r� r� �_inRemovalBlacklistrW r r� r= r� rM Z essentialr� Z architecturer� rR r� r� r� )r! Z main_archr� rP Z badVersionsZbvr� r� r r r r� � s6 ������zMyCache._verifyChangesc C sn |j j�|j�}|dkr(td|j� dS |jdkrHtd| j�� � dS |j�d�\}}|j j� ||f� dS )a helper to make sure that the pkg._records is pointing to the right location - needed because python-apt 0.7.9 dropped the python-apt version but we can not yet use the new version because on upgrade the old version is still installed NzNo candidate ver: FzNo file_list for: %s r T) r� r r� rM �printrW r� �popr� �lookup)r! rP r� r r� r r r �_lookupPkgRecord s zMyCache._lookupPkgRecordc C s� i }t � }| D ]�}| �|�s.t�d|j � q|jjj�d�D ]T}|� d�r>|t d�d � �d�D ].}|� � }||kr�t � ||< || � |j� qbq>q|D ]P}d}| j �dd�}||kr�d}|| D ]}| | js�d} q�q�|r�|� |� q�|S ) Nz&no PkgRecord found for '%s', skipping r� �Task:�,Tr+ Z IgnoredTasksF)rH r� r r� rW r� r� �recordr� r� r[ rD rV r6 r7 rL ) r! �tasksZinstalled_tasksrP �line�taskr� Z ignored_tasksr� r r r �installedTasks) s2 zMyCache.installedTasksc C s� t �d� | D ]�}|js|jr q| �|� t|jjd�rB|jjjsTt � d|j � q|jjj� d�D ]B}|� d�rd|t d�d � � d�D ] }|�� }||kr�|�� q�qdqdS )Nzrunning installTasksr� z can not find Record for '%s'r� r� r� T)r r� r� rL r� rp r� r� r� r rW r� r� r[ rD rN )r! r� rP r� r� r r r � installTasksE s zMyCache.installTasksc C s$ | j �dd�D ]}| �|d� qd S )Nr+ � BaseMetaPkgsz%base meta package keep installed rule)r6 r7 r� )r! r2 rP r r r r� V s z"MyCache._keepBaseMetaPkgsInstalledc s� � �fdd�}�j �dd�� �j �dd�D ]}�| �� q*� D ]t}z:|�kr|�| jr|�| jr|t�d| � �| �� W q@ tk r� } zt� d||f � W 5 d }~X Y q@X q@|� �s�t�d� � � D ]�}d }�j �|d �D ]}||�ko��| jM }q�|r�t�d | � z�| �� W nZ tt fk �r~ } z6t� d ||f � |� t d �| t d�� W Y � dS d }~X Y nX t�d|�| j f � �q�q�|� �s�d�� dd� �}|� t d�t d�|� d f � dS d S )Nc sV � D ]L} | �kr�| }|j r4|jr4t�d|j � |j r@|jrJ�| jr dS qdS )zy internal helper that checks if at least one meta-pkg is installed or marked install z(metapkg '%s' installed but marked_deleteTF)rL r� r r� rW r� )r� rP �r8 r! r r �metaPkgInstalled\ s �z2MyCache._installMetaPkgs.<locals>.metaPkgInstalledr+ r, r� zMarking '%s' for upgradez Can't mark '%s' for upgrade (%s)z$none of the '%s' meta-pkgs installedTr� z!guessing '%s' as missing meta-pkgz$failed to mark '%s' for install (%s)zCan't install '%s'z�It was impossible to install a required package. Please report this as a bug using 'ubuntu-bug ubuntu-release-upgrader-core' in a terminal.Fz marked_install: '%s' -> '%s'rZ r r- zCan't guess meta-packagez�Your system does not contain a %s or %s package and it was not possible to detect which version of Ubuntu you are running. Please install one of the packages above first using synaptic or apt-get before proceeding.)r6 r7 rN rL Z is_upgradabler r� r� r= r �KeyErrorr� r� r� r\ )r! r2 r� rP r� rI r� Z meta_pkgsr r� r r� Z sX ��&�� �� zMyCache._installMetaPkgsc C s8 | j D ],}t�|��|�rt�d||f � dS qdS )Nz blacklist expr '%s' matches '%s'TF)rA �re�compile�matchr r� )r! r� �exprr r r r� � s zMyCache._inRemovalBlacklistc C s� |� | j�r t�d| � dS || jkr:t�d| � dS | �|�rVt�d| � dS | j�dd�D ]:}|| krd| | jrd| | jj |krdt�d| � dS qd|| kr�dS z| j� dd �}W n t j k r� d}Y nX t �| j�}| | �� z�| | j|d � | j�� ||k�r W dS | �� D ]^}|j|k�s^|j|k�s^| �|j��s^|j| jk�r&t�d ||jf � | �� W dS �q&W nN ttfk �r� } z*t�d |t| �| f � | �� W Y �dS d } ~ X Y nX dS ) Nz skipping running kernel pkg '%s'Fz skipping kernel metapackage '%s'z#skipping '%s' (in removalBlacklist)r+ r� z'skipping '%s' (in KeepInstalledSection)TZPurgeObsoletes)�purgez8package '%s' produces an unwanted removal '%s', skippingz3_tryMarkObsoleteForRemoval failed for '%s' (%s: %s))�endswithr r r� rB r� r6 r7 r� r� r� r� r� r: r� r r� r� r2 r� r� rW r� r= r r �repr) r! r� Zremove_candidatesZforced_obsoletes� foreign_pkgsr� r r� rP rI r r r �tryMarkObsoleteForRemoval� sZ � � � �z!MyCache.tryMarkObsoleteForRemovalc C s0 t � }| D ] }|jr | �|�s |�|j� q |S �z1 get all package names that are not downloadable )rH rL �anyVersionDownloadablerV rW )r! Z obsolete_pkgsrP r r r �_getObsoletesPkgs� s zMyCache._getObsoletesPkgsc C s |j jD ]}|jr dS qdS )zA helper that checks if any of the version of pkg is downloadable TF)rM r� rS )r! rP r� r r r r � s z MyCache.anyVersionDownloadablec C s4 t � }| D ]$}|jr | j�|j�r |�|j� q |S r )rH rL r r� rM rV rW )r! Zunused_dependenciesrP r r r �_getUnusedDependencies� s z MyCache._getUnusedDependenciesc C s� t � }| j�dd�}tj�|�rVt|��(}|D ] }|�d�s.|�|� � � q.W 5 Q R X t � }|D ]<}|| krnq`| | }|j r`| j � |j �s`|jr�q`|�|� q`t|�S )z� return list of installed and demoted packages If a demoted package is a automatic install it will be skipped r+ Z Demotions�#)rH r6 rF r r rd rf r� rV rD rL r Zis_auto_installedrM r� r^ )r! Z demotionsZdemotions_fileZ demotions_fr� Zinstalled_demotionsZdemoted_pkgnamerP r r r � get_installed_demoted_packages s( �� z&MyCache.get_installed_demoted_packagesc C s~ t � }| D ]n}|jr | �|�r |js&q d}|jjD ]4}||jkrN|j|krNd}||jkr2|j|kr2d}q2|r |�|j� q |S )zm get all packages that are installed from a foreign repo (and are actually downloadable) TF) rH rL rS rR r� �archiver� rV rW )r! Zallowed_originZfromDistZtoDistr rP Zforeignr� r r r �_getForeignPkgs s$ � �zMyCache._getForeignPkgsFc sh G dd� dt �}� fdd�}g � i }i }td��x}|D ]l}z|�� \}} } } } } W n< tk r� } z t�d||f � W Y �q6W 5 d}~X Y nX | � kr6� �| � q6W 5 Q R X � jtdd � t j � d �}d }t | d ��r| j � d dd��r| j �d d�}tj�|��st�|� t�d| � dddd||dd fD ]�}tj�|�}||�}tj�|��rpt�|�}|j|j }nt�d| � d}||k�r�t�d||| f � ||| ||< n&t�d||f � |||< ||�||< �q2~t�d| � d}| D ]B}t�d |j��r�|j�s|j �r�t�d |jt f � |d 7 }�q�|t |d t }d }t | d ��r�| j � d dd��r�t�d � | j �d d�}| D ]"}|j �s�|j�r�||j j 7 }�q�d }|�r�| D ]*}|j!�r�|j �s�|j"�r�||j#j 7 }�q�t�d!| � || j$fd| j%fd| j&fd"d|fd#d$||fd|ff D ]h\}}|dk �rB�q,tj�|�}t�d%|||| || j'f � || j'|8 _'|| j(|7 _(�q,i } |D ]�}|| j'dk �r�t �)t*t+|| j'�d ��} t,| t-��r�| �.t/�0� �} t �)|| j(�} t,| t-��r| �.t/�0� �} t1| ||�| �| ||�< �q�t| �dk�rdt�2d&d'd(� | D � � t3t4| �5� ���dS ))z� this checks if we have enough free space on /var, /boot and /usr with the given cache Note: this can not be fully accurate if there are multiple mountpoints for /usr, /var, /boot c @ s e Zd ZdZdd� ZdS )z)MyCache.checkFreeSpace.<locals>.FreeSpacez@ helper class that represents the free space on each mounted fs c S s || _ d| _d S rx )�freer� )r! Z initialFreer r r r" > s z2MyCache.checkFreeSpace.<locals>.FreeSpace.__init__Nr( r r r r � FreeSpace< s r c s � D ]}| � |�r| S qdS )z� return 'id' of a directory so that directories on the same filesystem get the same id (simply the mount_point) �/)r� )�dZ mount_point�Zmountedr r � make_fs_idB s z*MyCache.checkFreeSpace.<locals>.make_fs_idz /proc/mountsz-line '%s' in /proc/mounts not understood (%s)NT)r� �reversezDir::Cache::archivesz/tmp/r6 ZAufsZEnabledFZRWDirzcache aufs_rw_dir: %sr �/usrz/varz/bootz/homez directory '%s' does not existsr zDir %s mounted on %szFree space on %s: %szfs_free contains: '%s'z%^linux-(image|image-debug)-[0-9.]*-.*z,%s (new-install) added with %s to boot spacer g z*taking aufs overlay into space calculationz&additional space for the snapshots: %s)r i )z/tmpi P )r i � z dir '%s' needs '%s' of '%s' (%f)zNot enough free space: %sc S s g | ] }t |��qS r )r> )r� r� r r r � <listcomp>� s z*MyCache.checkFreeSpace.<locals>.<listcomp>)6�objectrf r� � ValueErrorr r� r� r� r[ r: r6 r� rp rc rF r r rd re �realpath�statvfs�f_bavail�f_frsizer r r rW r� r� � KERNEL_SIZE� INITRD_SIZErR Zinstalled_sizerL r� r� r� r� r� r r� Z size_to_str�float�abs� isinstance�bytes�decode�localeZgetpreferredencodingr r� r& r^ �values) r! Zsnapshots_in_user r Zmnt_mapZfs_freeZmountsr� Zwhat�whereZfsZoptions�ar� rI Z archivedirZ aufs_rw_dirr Zfs_id�str Z kernel_countrP Z space_in_bootZrequired_for_aufsZrequired_for_snapshotsr �sizeZ required_listZ free_at_leastZ free_neededr r r �checkFreeSpace3 s� � �� � � ��� � � zMyCache.checkFreeSpace)NT)N)T)T)T)r� )r� )r� )r� )F)<r r r rT rU r" rQ �propertyrY rb rE ru rw r~ r� r� r� r� r< r� r� r� r] r_ rS r� r� r� r� r� r� r� rN r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r. r r r r r) q s� ' #* L 9 r) �__main__)�DistUpgradeConfig)�DistUpgradeViewZfoo�.zubuntu-desktop)/r? r: r r( r r r r� rk r� r� � subprocessr r ZDistUpgradeGettextr r� r Zutilsr r� r r r r r! r" r r r& r@ r) r �sysZDistUpgradeConfigParserr1 r2 r� �cr. �exitr� r� r� r� r� r� r r r r �<module> sX ! k