prestoadmin.yarn_slider package

Submodules

prestoadmin.yarn_slider.config module

Module for setting and validating the presto-admin Apache Slider config

class prestoadmin.yarn_slider.config.SliderConfig

Bases: prestoadmin.util.base_config.BaseConfig

presto-admin needs to update the slider config other than through the interactive config process because it needs to keep track of the name of the presto-yarn-package we install.

As a result, SliderConfig acts a little funny; it acts like enough of a dict to allow env.conf[NAME] lookups and modifications, and it also exposes the ability to store the config after it’s been modified.

is_config_loaded()

set_config_loaded()

set_env_from_conf(conf)

store_conf()

prestoadmin.yarn_slider.server module

Module for managing presto/YARN integration.

prestoadmin.yarn_slider.server.install

Install the presto-yarn package on the cluster using Apache Slider. The presto-yarn package takes the form of a zip file that conforms to Slider’s packaging requirements. After installing the presto-yarn package the presto application is registered with Slider.

Before Slider can install the presto-yarn package, the slider user’s hdfs home directory needs to be created. This needs to be done by a user that has write access to the hdfs /user directory, typically the user hdfs or a member of the superuser group.

The name of the presto application is arbitrary and set in the slider configuration file. The default is PRESTO

Parameters:presto_yarn_package – The zip file containing the presto-yarn package as structured for Slider.

prestoadmin.yarn_slider.server.uninstall

Uninstall unregisters the presto application with slider and removes the installed package.

prestoadmin.yarn_slider.slider module

Module for installing and uninstalling slider.

prestoadmin.yarn_slider.slider.install

Install slider on the slider master. You must provide a tar file on the local machine that contains the slider distribution.

Parameters:slider_tarball – The gzipped tar file containing the Apache Slider distribution

prestoadmin.yarn_slider.slider.uninstall

Uninstall slider from the slider master.

Module contents