Use Rainbond Deployment

This section describes the one-click deployment of high availability DolphinScheduler clusters through the Rainbond cloud native application management platform. This method is suitable for users who don’t know much about complex technologies such as Kubernetes, lowering the threshold for deploying DolphinScheduler in Kubernetes mode.

Prerequisites

  • Available Rainbond cloud native application management platform is a prerequisite,please refer to the official Rainbond documentation Rainbond Quick install

DolphinScheduler Cluster One-click Deployment

  • Logging in and accessing the built-in open source app store, search the keyword dolphinscheduler to find the DolphinScheduler App.

Rainbond Deployment - 图1

  • Click install on the right side of DolphinScheduler to go to the installation page. Fill in the corresponding information and click OK to start the installation. You will get automatically redirected to the application view.
Select itemDescription
Team nameuser workspace,Isolate by namespace
Cluster nameselect kubernetes cluster
Select appselect application
app versionselect DolphinScheduler version

Rainbond Deployment - 图2

  • Wait a few minutes, the installation completes and DolphinScheduler will be running.

Rainbond Deployment - 图3

  • Access DolphinScheduler-API components and the default user credentials are admin / dolphinscheduler123.

Rainbond Deployment - 图4

API Master Worker Node Telescopic

DolphinScheduler API、Master、Worker all support scaling multiple instances, ensuring the high availability of the entire service.

Take worker as an example: enter the component -> Telescopic page, and set the number of instances.

Rainbond Deployment - 图5

To verify worker node, enter DolphinScheduler UI -> Monitoring -> Worker page to view detailed node information.

Rainbond Deployment - 图6

Configuration file

API and Worker Services share the configuration file /opt/dolphinscheduler/conf/common.properties. To modify the configurations, you only need to modify that of the API service.

How to support Python 3?

Worker service is installed with default Python3,you can add environment variables PYTHON_HOME=/usr/bin/python3

How to support Hadoop, Spark, DataX ?

Take DataX as an example:

  1. Install the plugin。Rainbond Team View -> Plugin -> Install plugin from the App Store -> search initialization plugin Install.
  2. Open plugin.enter Worker component -> plugin -> open initialization plugin and modify the configuration.
  3. Update component, the plug-in Datax will be downloaded automatically and decompress to /opt/soft Rainbond Deployment - 图7