Set up Project

Creating a Google Cloud project for your Kubeflow deployment

Follow these steps to set up your Google Cloud project:

  1. Select or create a project on the Google Cloud Console. If you plan to use different Google Cloud projects for Management Cluster and Kubeflow Clusters: create one Management project for Management Cluster, and create one or more Kubeflow projects for Kubeflow Clusters.

  2. Make sure that you have the Owner role for the project in Cloud IAM (Identity and Access Management). The deployment process creates various service accounts with appropriate roles in order to enable seamless integration with Google Cloud services. This process requires that you have the owner role for the project in order to deploy Kubeflow.

  3. Make sure that billing is enabled for your project. Refer to Enable billing for a project.

  4. Open following pages on the Google Cloud Console and ensure that the specified APIs are enabled for all projects:

    You can also enable these APIs by running the following command in Cloud Shell:

    1. gcloud services enable \
    2. compute.googleapis.com \
    3. container.googleapis.com \
    4. iam.googleapis.com \
    5. servicemanagement.googleapis.com \
    6. cloudresourcemanager.googleapis.com \
    7. ml.googleapis.com \
    8. iap.googleapis.com \
    9. sqladmin.googleapis.com \
    10. meshconfig.googleapis.com
    11. # Cloud Build API is optional, you need it if using Fairing.
    12. # gcloud services enable cloudbuild.googleapis.com
  5. If you are using the Google Cloud Free Program or the 12-month trial period with $300 credit, note that the free tier does not offer enough resources for default full Kubeflow installation. You need to upgrade to a paid account.

    For more information, see the following issues:

    Read the Google Cloud Resource quotas to understand quotas on resource usage that Compute Engine enforces, and to learn how to check and increase your quotas.

  6. Initialize your project to prepare it for Anthos Service Mesh installation:

    1. PROJECT_ID=<YOUR_PROJECT_ID>
    1. curl --request POST \
    2. --header "Authorization: Bearer $(gcloud auth print-access-token)" \
    3. --data '' \
    4. https://meshconfig.googleapis.com/v1alpha1/projects/${PROJECT_ID}:initialize

    Refer to Anthos Service Mesh documentation for details.

    If you encounter a Workload Identity Pool does not exist error, refer to the following issue:

    • kubeflow/website #2121 describes that creating and then removing a temporary Kubernetes cluster may be needed for projects that haven’t had a cluster set up beforehand.

You do not need a running GKE cluster. The deployment process creates a cluster for you.

Next steps

Last modified 17.05.2021: (gke) Full Kubeflow Deployment guide on GKE (revision for Kubeflow 1.3) (#2686) (f50693a3)