Using Cluster Loader

You are viewing documentation for a release that is no longer supported. The latest supported version of version 3 is [3.11]. For the most recent version 4, see [4]

You are viewing documentation for a release that is no longer supported. The latest supported version of version 3 is [3.11]. For the most recent version 4, see [4]

What Cluster Loader Does

Cluster Loader is a tool that deploys large numbers of various objects to a cluster, which creates user-defined cluster objects. Build, configure, and run Cluster Loader to measure performance metrics of your OKD deployment at various cluster states.

Installing Cluster Loader

Cluster Loader is included in the atomic-openshift-tests package. To install it, run:

  1. $ yum install atomic-openshift-tests

After installation, the test executable extended.test is located in /usr/libexec/atomic-openshift/extended.test.

Running Cluster Loader

  1. Set the KUBECONFIG variable to the location of the administrator kubeconfig:

    1. $ export KUBECONFIG=${KUBECONFIG-$HOME/.kube/config}
  2. Execute Cluster Loader using the built-in test configuration, which deploys five template builds and waits for them to complete:

    1. $ cd /usr/libexec/atomic-openshift/
    2. $ ./extended.test --ginkgo.focus="Load cluster"

    Alternatively, execute Cluster Loader with a user-defined configuration by adding the flag for --viper-config:

    1. $ ./extended.test --ginkgo.focus="Load cluster" --viper-config=config/test (1)
    1In this example, there is a subdirectory called config/ with a configuration file called test.yml. In the command line, exclude the extension of the configuration file, as the tool will automatically determine the file type and extension.

Configuring Cluster Loader

Create multiple namespaces (projects), which contain multiple templates or pods.

Locate the configuration files for Cluster Loader in the config/ subdirectory. The pod files and template files referenced in these configuration examples are found in the content/ subdirectory.

Configuration Fields

Table 1. Top-level Cluster Loader Fields
FieldDescription

cleanup

Set to true or false. One definition per configuration. If set to true, cleanup will delete all namespaces (projects) created by Cluster Loader at the end of the test.

projects

A sub-object with one or many definition(s). Under projects, each namespace to create is defined and projects has several mandatory subheadings.

tuningset

A sub-object with one definition per configuration. tuningset allows the user to define a tuning set to add configurable timing to project or object creation (pods, templates, and so on).

sync

An optional sub-object with one definition per configuration. Adds synchronization possibilities during object creation.

Table 2. Fields under projects
FieldDescription

num

An integer. One definition of the count of how many projects to create.

basename

A string. One definition of the base name for the project. The count of identical namespaces will be appended to Basename to prevent collisions.

tuning

A string. One definition of what tuning set you want to apply to the objects, which you deploy inside this namespace.

ifexists

A string containing either reuse or delete. Defines what the tool does if it finds a project or namespace that has the same name of the project or namespace it creates during execution.

configmaps

A list of key-value pairs. The key is the ConfigMap name and the value is a path to a file from which you create the ConfigMap.

secrets

A list of key-value pairs. The key is the secret name and the value is a path to a file from which you create the secret.

pods

A sub-object with one or many definition(s) of pods to deploy.

templates

A sub-object with one or many definition(s) of templates to deploy.

Table 3. Fields under pods and templates
FieldDescription

total

This field is not used.

num

An integer. The number of pods or templates to deploy.

image

A string. The docker image URL to a repository where it can be pulled.

basename

A string. One definition of the base name for the template (or pod) that you want to create.

file

A string. The path to a local file, which is either a PodSpec or template to be created.

parameters

Key-value pairs. Under parameters, you can specify a list of values to override in the pod or template.

Table 4. Fields under tuningset
FieldDescription

name

A string. The name of the tuning set which will match the name specified when defining a tuning in a project.

pods

A sub-object identifying the tuningset that will apply to pods.

templates

A sub-object identifying the tuningset that will apply to templates.

Table 5. Fields under tuningset pods or tuningset templates
FieldDescription

stepping

A sub-object. A stepping configuration used if you want to create an object in a step creation pattern.

rate_limit

A sub-object. A rate-limiting tuning set configuration to limit the object creation rate.

Table 6. Fields under tuningset pods or tuningset templates, stepping
FieldDescription

stepsize

An integer. How many objects to create before pausing object creation.

pause

An integer. How many seconds to pause after creating the number of objects defined in stepsize.

timeout

An integer. How many seconds to wait before failure if the object creation is not successful.

delay

An integer. How many milliseconds (ms) to wait between creation requests.

Table 7. Fields under sync
FieldDescription

server

A sub-object with enabled and port fields. The boolean enabled defines whether to start a HTTP server for pod synchronization. The integer port defines the HTTP server port to listen on (9090 by default).

running

A boolean. Wait for pods with labels matching selectors to go into Running state.

succeeded

A boolean. Wait for pods with labels matching selectors to go into Completed state.

selectors

A list of selectors to match pods in Running or Completed states.

timeout

A string. The synchronization timeout period to wait for pods in Running or Completed states. For values that are not 0, use units: [ns|us|ms|s|m|h].

Example Cluster Loader Configuration File

Cluster Loader’s configuration file is a basic YAML file:

  1. provider: local (1)
  2. ClusterLoader:
  3. cleanup: true
  4. projects:
  5. - num: 1
  6. basename: clusterloader-cakephp-mysql
  7. tuning: default
  8. ifexists: reuse
  9. templates:
  10. - num: 1
  11. file: ./examples/quickstarts/cakephp-mysql.json
  12. - num: 1
  13. basename: clusterloader-dancer-mysql
  14. tuning: default
  15. ifexists: reuse
  16. templates:
  17. - num: 1
  18. file: ./examples/quickstarts/dancer-mysql.json
  19. - num: 1
  20. basename: clusterloader-django-postgresql
  21. tuning: default
  22. ifexists: reuse
  23. templates:
  24. - num: 1
  25. file: ./examples/quickstarts/django-postgresql.json
  26. - num: 1
  27. basename: clusterloader-nodejs-mongodb
  28. tuning: default
  29. ifexists: reuse
  30. templates:
  31. - num: 1
  32. file: ./examples/quickstarts/nodejs-mongodb.json
  33. - num: 1
  34. basename: clusterloader-rails-postgresql
  35. tuning: default
  36. templates:
  37. - num: 1
  38. file: ./examples/quickstarts/rails-postgresql.json
  39. tuningset: (2)
  40. - name: default
  41. pods:
  42. stepping: (3)
  43. stepsize: 5
  44. pause: 0 s
  45. rate_limit: (4)
  46. delay: 0 ms
1Optional setting for end-to-end tests. Set to local to avoid extra log messages.
2The tuning sets allow rate limiting and stepping, the ability to create several batches of pods while pausing in between sets. Cluster Loader monitors completion of the previous step before continuing.
3Stepping will pause for M seconds after each N objects are created.
4Rate limiting will wait M milliseconds between the creation of objects.

Known Issues

If the IDENTIFIER parameter is not defined in user templates, template creation fails with error: unknown parameter name "IDENTIFIER". If you deploy templates, add this parameter to your template to avoid this error:

  1. {
  2. "name": "IDENTIFIER",
  3. "description": "Number to append to the name of resources",
  4. "value": "1"
  5. }

If you deploy pods, adding the parameter is unnecessary.