Install Kubeflow Fairing

Setting up your Kubeflow Fairing development environment

Out of date

This guide contains outdated information pertaining to Kubeflow 1.0. This guide needs to be updated for Kubeflow 1.1.

You can use Kubeflow Fairing to build, train, and deploy machine learning (ML) models in a hybrid cloud environment directly from Python code or a Jupyter notebook. This guide describes how to install Kubeflow Fairing in your development environment for local development, or development in a hosted notebook.

Using Kubeflow Fairing with Kubeflow notebooks

Kubeflow notebook servers that are built from one of the standard Jupyter Docker images include Kubeflow Fairing and come preconfigured for using Kubeflow Fairing to run training jobs on your Kubeflow cluster.

If you use a Kubeflow notebook server that was built from a custom Jupyter Docker image as your development environment, follow the instruction on setting up Kubeflow Fairing in a hosted notebook environment.

Set up Kubeflow Fairing for local development

Follow these instructions to set up Kubeflow Fairing for local development. This guide has been tested on Linux and Mac OS X. Currently, this guide has not been tested on Windows.

Set up Python

  1. You need Python 3.6 or later to use Kubeflow Fairing. To check if you have Python 3.6 or later installed, run the following command:

    1. python3 -V

    The response should be something like this:

    1. Python 3.6.5

    If you do not have Python 3.6 or later, you can download Python from the Python Software Foundation.

  2. Use virtualenv to create a virtual environment to install Kubeflow Fairing in. To check if you have virtualenv installed, run the following command:

    1. which virtualenv

    The response should be something like this:

    1. /usr/bin/virtualenv

    If you do not have virtualenv, use pip3 to install virtualenv.

    1. pip3 install virtualenv

    Create a new virtual environment, and activate it.

    1. virtualenv venv --python=python3
    2. source venv/bin/activate

Install Kubeflow Fairing

Run the following command to install Kubeflow Fairing in your virtual environment.

  1. pip install kubeflow-fairing

After the install is complete, the fairing python package is available. Run the following command to verify that Kubeflow Fairing is installed:

  1. pip show kubeflow-fairing

The response should be something like this:

  1. Name: kubeflow-fairing
  2. Version: 0.6.0
  3. Summary: Kubeflow Fairing Python SDK.
  4. Home-page: https://github.com/kubeflow/fairing
  5. Author: Kubeflow Authors
  6. Author-email: hejinchi@cn.ibm.com
  7. License: Apache License Version 2.0
  8. Location: <path-to-kubeflow-fairing>
  9. Requires: notebook, future, docker, tornado, cloudpickle, oauth2client, numpy, requests, setuptools, httplib2, google-auth, google-api-python-client, urllib3, boto3, azure, six, kubernetes, google-cloud-storage

Docker setup

Kubeflow Fairing uses Docker to package your code. Run the following command to verify if Docker is installed and running:

  1. docker ps

Configure Kubeflow Fairing

To configure Kubeflow Fairing with access to an environment that you would like to use for training and deployment, follow the instructions in the guide to configuring Kubeflow Fairing.

Set up Kubeflow Fairing in a hosted Jupyter notebook

Follow these instructions to set up Kubeflow Fairing in a hosted Jupyter notebook.

If you are using a Kubeflow notebook server that was built from one of the standard Jupyter Docker images, your notebooks environment has been preconfigured for training and deploying ML models with Kubeflow Fairing and no additional installation steps are required.

Prerequisites

Check the following prerequisites to verify that Kubeflow Fairing is compatible with your hosted notebook environment.

  1. In the Jupyter notebooks user interface, click File > New > Terminal in the menu to start a new terminal session in your notebook environment.

  2. You need Python 3.6 or later to use Kubeflow Fairing. To check if you have Python 3.6 or later installed, run the following command in your terminal session:

    1. python3 -V

    The response should be something like this:

    1. Python 3.6.5
  3. Kubeflow Fairing uses Docker to package your code. Run the following command in your terminal session to verify if Docker is installed and running in your notebook environment:

    1. docker ps

Install Kubeflow Fairing

  1. In the Jupyter notebooks user interface, click File > New > Terminal in the menu to start a new terminal session in your notebook environment.

  2. Run the following command to install Kubeflow Fairing.

    1. pip3 install kubeflow-fairing

    After successful installation, the fairing python package should be available. Run the following command to verify that Kubeflow Fairing is installed:

    1. pip3 show kubeflow-fairing

    The response should be something like this:

    1. Name: kubeflow-fairing
    2. Version: 0.6.0
    3. Summary: Kubeflow Fairing Python SDK.
    4. Home-page: https://github.com/kubeflow/fairing
    5. Author: Kubeflow Authors
    6. Author-email: hejinchi@cn.ibm.com
    7. License: Apache License Version 2.0
    8. Location: <path-to-kubeflow-fairing>
    9. Requires: notebook, future, docker, tornado, cloudpickle, oauth2client, numpy, requests, setuptools, httplib2, google-auth, google-api-python-client, urllib3, boto3, azure, six, kubernetes, google-cloud-storage

Configure Kubeflow Fairing

To configure Kubeflow Fairing with access to the environment you would like to use for training and deployment, follow the instructions in the guide to configuring Kubeflow Fairing.

Next steps

Last modified 21.04.2021: Components v external add ons (#2630) (42f08be0)