Load-balancing & Service Discovery

This tutorial will guide you to perform load-balancing and service discovery across multiple Kubernetes clusters when using Cilium.

Prerequisites

You need to have a functioning Cluster Mesh setup, please follow the guide Setting up Cluster Mesh to set it up.

Load-balancing with Global Services

Establishing load-balancing between clusters is achieved by defining a Kubernetes service with identical name and namespace in each cluster and adding the annotation io.cilium/global-service: "true" to declare it global. Cilium will automatically perform load-balancing to pods in both clusters.

  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: rebel-base
  5.   annotations:
  6.     io.cilium/global-service: "true"
  7. spec:
  8.   type: ClusterIP
  9.   ports:
  10.   - port: 80
  11.   selector:
  12.     name: rebel-base

Load-balancing Only to a Remote Cluster

By default, a Global Service will load-balance across backends in multiple clusters. This implicitly configures io.cilium/shared-service: "true". To prevent service backends from being shared to other clusters, and to ensure that the service will only load-balance to backends in remote clusters, this option should be disabled.

Below example will expose remote endpoint without sharing local endpoints.

  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: rebel-base
  5.   annotations:
  6.     io.cilium/global-service: "true"
  7.     io.cilium/shared-service: "false"
  8. spec:
  9.   type: ClusterIP
  10.   ports:
  11.   - port: 80
  12.   selector:
  13.     name: rebel-base

Deploying a Simple Example Service

  1. In cluster 1, deploy:

    1. kubectl apply -f https://raw.githubusercontent.com/cilium/cilium/v1.10/examples/kubernetes/clustermesh/global-service-example/rebel-base-global-shared.yaml
    2. kubectl apply -f https://raw.githubusercontent.com/cilium/cilium/v1.10/examples/kubernetes/clustermesh/global-service-example/cluster1.yaml

  2. In cluster 2, deploy:

    1. kubectl apply -f https://raw.githubusercontent.com/cilium/cilium/v1.10/examples/kubernetes/clustermesh/global-service-example/rebel-base-global-shared.yaml
    2. kubectl apply -f https://raw.githubusercontent.com/cilium/cilium/v1.10/examples/kubernetes/clustermesh/global-service-example/cluster2.yaml

  3. From either cluster, access the global service:

    1. kubectl exec -ti xwing-xxx -- curl rebel-base

    You will see replies from pods in both clusters.