관리-도구
편집 파일: apps_manager.cpython-37.pyc
B �v6d�Q � @ s d dl mZ d dl mZ d dl mZ d dlZd dlZd dlZd dlZd dlm Z m Z d dl m Z d dl Z d dlmZmZ d dlmZ d d lmZmZmZ d d lmZ d d lmZmZm Z d d l m Z d d l m Z G dd� de!�Z"G dd� de!�Z#G dd� de �Z$ddd�Z%dS )� )�print_function)�division)�absolute_importN)�AnyStr�Optional)� iteritems)� get_abs_rel�run_process_in_cagefs)�drop_privileges)�BaseSelectorError�MissingVirtualenvError�MissingAppRootError)� WSGI_PATH)�ClSelectExcept� clpassenger� clselectctl)�BaseApplicationsManager)� PythonManagerc @ s e Zd ZdZdZdZdS )�PythonAppFormatVersionz@ Class represents possible python application versions. � � N)�__name__� __module__� __qualname__�__doc__�LEGACY�STABLE� r r �U/opt/alt/python37/lib/python3.7/site-packages/clselect/clselectpython/apps_manager.pyr # s r c @ s e Zd ZdZdZdZdS )�PythonVenvFormatVersionzJ Class represents possible python application venv path versions. r r N)r r r r r r r r r r r . s r c s� e Zd ZdZdZdZdZdZdZdZ dZ � fdd �Z d-� fd d � Z e d d� �Zdd� Zdd� Zd.dd�Zd/dd�Zdd� Zdd� Zd d � Zd d � Zd0d d!�Zd"d#� Zd1� fd$d%� Zd&d'� Zd2d)d*�Zd3d+d,�Z � Z S )4�ApplicationsManagerz!.cl.selector/python-selector.jsonz /var/lve/.py.migration.statusz!.cl.selector/.py.migration.statusz//var/log/cloudlinux/py-selector/app_imports.logz imported_pip_requirements.txt�python� virtualenvc s t t| ��t� � d S )N)�superr �__init__r )�self)� __class__r r r$ D s z ApplicationsManager.__init__r c s t t| �j|||d�S )N)�patterns)r# r �_find_config_files)r% � user_name� app_directoryr' )r& r r r( H s z&ApplicationsManager._find_config_filesc C s d� | �g}|S )z� Return lines for htaccess that are specific to the python interpreter :param binary_path: path to the environment's python binary :param app_config: application's config dictionary zPassengerPython "{}" )�format)� binary_path� app_config�specific_linesr r r �(get_interpreter_specific_passenger_linesL s z<ApplicationsManager.get_interpreter_specific_passenger_linesc C s� ddl m} i }i }| �|�}�xrtt�|��D �]^\}}|d | jkrJq0�ytj� |d tj �} tj� | �s||� d|� w0t | ��} | �� } W dQ R X |�| �} | r�| �� } | d }| d }nd }}tj�tj�tj�|d ���}|d d }y|| d }W n tk �r tj}Y nX ||||d d|�p8t g i |�pDdd� }|||< W q0 tk �r� |�d|� |�|g ��d| � w0Y q0X q0W ||fS )a Search server for old applications (created in old python selector) and add them to new config. :param user: user to search applications :param logger: logger to write messages to :return: tuple(list[applications], list[errors]) r )� WSGI_PATTERN� interpreter� directoryzIApplication %s was skipped during import, because wsgi file was not foundN�script�callable� �binary�domains� app_version�alias�started� application) �python_versionr8 �domain�app_uri� app_status� startup_file� config_files�env_vars� entry_pointz Unable to import application %sz�Unexpected issue during application "%s" import. Your python app will work as before, but you wo't be able to control it from Python Selector UI. Please, ask your system administrator to contact CloudLinux support to resolve this issue.)�clselect.clselectctlpythonr0 �get_user_config_datar r �summary� INTERPRETER�os�path�joinr �isfile�warning�open�read�search� groupdict�basename�dirname�KeyErrorr r � Exception� exception� setdefault�append)r% �user�loggerr0 � applications�errors�user_config_datar2 �data�app_wsgi�f� wsgi_conf�matchrP � wsgi_path�callable_object� py_versionr= Zapp_verZapp_infor r r �_get_legacy_applicationsV sZ z,ApplicationsManager._get_legacy_applicationsc C sP t �d�}|�t j� t �| j�}t �d�|_t �� }|�t j � |� |� |S )z6 Setup logger for application import. Z import_appsz*[%(levelname)s | %(asctime)s]: %(message)s) �logging� getLogger�setLevel�DEBUG� FileHandler�_IMPORT_LOG_FILE� Formatter� formatter� StreamHandler�INFO� addHandler)r% � app_logger�fhZclr r r �_setup_import_logger� s z(ApplicationsManager._setup_import_loggerNc C s� | � � }| �|�}t�dt|�� �� g }d}d}�xZt|�D �]L\}}tj� |j d�}tj� |�s�|d7 }|� d||f � q>|� d|� �y�t|��b t�� �N y| �|j |j|j�} W n tk r� i } Y nX | �||�\} }| s�w>W dQ R X W dQ R X x�t| �D ]�\} } | | k�r<| | d | d< | | d | d < | �|| |� tj� |j | | j�} tj�| ��r�| j| d k�r�| d �| j� | | | < �q W t| �� �t| �� � }x|D ]} | �| � �q�W t|��6 t�� �" | � || � | j |d |d � W dQ R X W dQ R X W q> t k �r� } zXd }|� |||� t|��* t�� � | j |d |d � W dQ R X W dQ R X |�|� W dd}~X Y q>X q>W | � |� |dk�r�|� d� dS )z� Scan users for legacy applications (created by old python selector) and import them into config file. Done automatically by spec file. z&Start applications import for users %sr Nz .cl.selectorr z-User %s is skipped due to %s directory absentzImporting user %srA rB F)�is_import_failed� apps_errorsz�Unable to import user `%s` to new python selector. Already created applications work as before, but user won't be able to manage them. Error is: `%s`Tz$Some users skipped... see import log)!rs �get_users_dictrf �debug�list�keysr rH rI rJ �pw_dir�isdirrL �infor �secureio� disable_quota� read_user_selector_config_json�pw_uid�pw_gidr re �generate_pip_requirements�_IMPORT_REQUIREMENTS_FILErK rW �set�pop�write_full_user_config_data� _set_user_legacy_import_statusrT rU � _set_admin_legacy_import_status)r% rX rq � users_info� failed_usersZskipped_users_countru �pwZcl_selector_dir�configZapps�app_rootr- Zrequirements_fileZdestroyed_apps�eZ import_errorr r r �$import_legacy_applications_to_config� s` ($ z8ApplicationsManager.import_legacy_applications_to_configc C s� |dkr8t j�| j�sdS t| j�� }t�|�S Q R X nFt�|�}t j� |j | j �}t j� |�sddS t|�� }t�|�S Q R X dS )zz Read import log which contains information about failed users or apps depending on current user. N) rH rI �exists�_IMPORT_STATUS_ADMINrM �json�load�pwd�getpwnamrJ rz �_IMPORT_STATUS_USERrK )r% rX r_ �user_pw�markerr r r �_get_legacy_import_status� s z-ApplicationsManager._get_legacy_import_statusc C st t j�t j�|jd��s dS y0t j�|j| j�}t�t� ||d��|d� W n" t t fk rn t � d� Y nX dS )z� Save information that some applications were not imported automatically to show warning for user in the future. z .cl.selectorN)rt �apps_lookup_failedi� z$Unable to save migration status file)rH rI r� rJ rz r� r} �write_file_via_tempfiler� �dumps�IOError�OSErrorrf rU )r% r� rt ru r� r r r r� s z2ApplicationsManager._set_user_legacy_import_statusc C s" t �d|i�}t�|| jd� dS )z� Save information that some users were not imported automatically to show warning for admin in the future. r� i� N)r� r� r} r� r� )r% r� Zpackedr r r r� s z3ApplicationsManager._set_admin_legacy_import_statusc C s> | � � }|d ks|d s d S djd�|d �| j| jd�}|S )Nr� a� Unexpected issue(s) happened during importing python applications for the following users: "{users}". Everything will work as before, but listed users wo't be able to control applications from Python Selector UI. Please, contact CloudLinux support and send them log file located at `{log_file_path}` to investigate and resolve this issue. Also you can hide this warning by deleting `{import_warning_marker}` file�,)�usersZ log_file_path�import_warning_marker)r� r+ rJ rk r� )r% r� Z warning_msgr r r � _get_admin_legacy_import_warning$ s z4ApplicationsManager._get_admin_legacy_import_warningc C sX | j |d�}|d krd S dj| jd�}|d r6d| S |d rTdd�|d �|f S d S ) N)rX a Everything will work as before, but you won't be able to control listed applications from Python Selector UI. Please, ask you hoster to contact CloudLinux support to investigate and resolve this issue. Also you can hide this warning by deleting `~/{import_warning_marker}` file.)r� rt zEUnexpected issue(s) happened during importing python applications. %sr� zUUnexpected issue(s) happened during importing following python applications: "%s". %sr� )r� r+ r� rJ )r% �usernamer� Zwhat_to_do_msgr r r � _get_user_legacy_import_warning6 s z3ApplicationsManager._get_user_legacy_import_warningc C s |d kr| � � S | �|�S d S )N)r� r� )r% rX r r r �"_get_legacy_import_warning_or_noneN s z6ApplicationsManager._get_legacy_import_warning_or_nonec C s� ddl m} | �||�}|dkr.t�d| ��|d tjkrJt�d| ��|||| d�}y|jdd � W n4 tk r� } zt�d ||f ��W dd}~X Y nX tj|d< | � |||� dS ) zo Update environment of specific application to support features of new python selector r )�_get_environmentNz Application %s does not existr8 zCApplication %s is already new version and does not need any updates)� apps_managerT)Z auto_restorez�Unable to migrate application %s. Error is '%s', everything restored to work as before migration. Try again later or ask your hoster to contact CloudLinux support if the issue persists.) rD r� �get_app_configr � WrongDatar r Zconfigure_environmentrT �add_app_to_config)r% rX r� r� r; � environmentr� r r r �migrate_applicationT s" z'ApplicationsManager.migrate_applicationc s. t t| ��|�}| �|�}|d k r*||d< |S )NrL )r# r �get_applications_users_infor� )r% rX �resultrL )r& r r r� q s z/ApplicationsManager.get_applications_users_infoc C s t ||�\}}tj�|| j�}tj�|�r.dS ddlm} t|�� |||| d�}|� � } W dQ R X t � |�j } d| i} d} t || ddg| d �} | d dkr�|�d t| d � � t�| d ��n| d s�| d } t|��6 t�� �" t|d�}|�| � |�� W dQ R X W dQ R X dS )z� Generates requirements file from python apps :param user: username :param app_root: app root :param app_logger: app logger Nr )r� )r� �HOMEr5 Zfreezez-l)rB � returncodez/Error during generation pip requirements file. �output�failed�w)r rH rI rJ r� r� rD r� r Zpipr� r� rz r rL �strr �ExternalProgramFailedr} r~ rM �write�close)r% rX r� rq �app_path�_�req_pathr� r� Zpip_path� user_homerB �modulesr� r_ r r r r� y s, z-ApplicationsManager.generate_pip_requirementsTc C sp | j �|�j}t||�\}}tj�||�}|rBtj�|�sBt|��tj�||�}|rhtj�|�sht |��||fS )a Calculate, check exists and return application folders This method does not check that application exists in config. :raises: NoSuchUserException, MissingVirtualenvError, MissingAppRootError :return: tuple(app_root, app_venv) with absolute paths ) �_pwd�get_pw_by_namerz �get_venv_rel_pathrH rI rJ r� r r ) r% r� r� �chk_env� chk_app_rootr� r� �rel_path�app_venvr r r �get_app_folders� s z#ApplicationsManager.get_app_foldersc C s< | � ||�}|dkr| j}t||�\}}tj�|||d|�S )a� Return a path to the environment's interpreter binary Get interpreter path for application :param user: owner of the application :param app_root: app path relative to user home (app-root) :param user_dir: User's home directory :param binary_name: name of binary in virtual environemnt (python, npm, node) :return: path to interpreter binary in virtual environment N�bin)� get_interpreter_version_for_app� BINARY_NAMEr� rH rI rJ )r% rX r� �user_dir� binary_name�versionr� r� r r r �get_binary_path� s z#ApplicationsManager.get_binary_path)r )N)N)N)N)TT)N) r r r � _USER_CONFIGr� r� rk r� rG �VENV_DIRr� r$ r( � staticmethodr/ re rs r� r� r� r� r� r� r� r� r� r� r� r� � __classcell__r r )r& r r : s2 F L & r c C s� t | tj�tj|��\}}t | tj�tjt�|���\}}|dkrptj�|�rf|t�|�krft j |fS t j |fS |t j kr�t j |fS |t j kr�t j |fS t d| ��dS )a6 Get path to users VENV relative to home dir. Old python selector transforms app_root using get_prefix() method before creating venv directory. We should handle both cases: - when app is from old selector - when app is from new selector and return right env directory. If both old and new vevns exist we use old one. Return tuple with two values: - detected version of venv path (LEGACY for path with replacements "/" -> "_" & "_" => "__" and STABLE in other case) - path to venv relative to user's home dir Nzunknown version `%s`) r rH rI rJ r r� r � get_prefixr� r r r � ValueError)rX r2 r� r� Z new_rel_dirZ old_abs_dirZ old_rel_dirr r r r� � s r� )N)&� __future__r r r rf rH r� r� �typingr r � future.utilsr r} �clselect.utilsr r �clcommon.clpwdr �clselect.baseclselectr r r Zclselect.clpassengerr �clselectr r r �"clselect.baseclselect.apps_managerr �&clselect.clselectpython.python_managerr �objectr r r r� r r r r �<module> s.