Bridge data to Pulsar

Setup a Pulsar, taking Mac OSX for instance:

  1. $ wget https://archive.apache.org/dist/pulsar/pulsar-2.3.2/apache-pulsar-2.3.2-bin.tar.gz
  2. $ tar xvfz apache-pulsar-2.3.2-bin.tar.gz
  3. $ cd apache-pulsar-2.3.2
  4. # Start Pulsar
  5. $ ./bin/pulsar standalone

Create Pulsar Topics:

  1. $ ./bin/pulsar-admin topics create-partitioned-topic -p 5 testTopic

Create a rule:

Go to EMQX DashboardBridge data to Pulsar - 图1 (opens new window), select the “rule” tab on the menu to the left.

Select “message.publish”, then type in the following SQL:

  1. SELECT
  2. *
  3. FROM
  4. "message.publish"

image

Bind an action:

Click on the “+ Add” button under “Action Handler”, and then select “Data bridge to Pulsar” in the pop-up dialog window.

image

Fill in the parameters required by the action:

Two parameters is required by action “Data bridge to Pulsar”:

1). Pulsar Topic

2). Bind a resource to the action. Since the dropdown list “Resource” is empty for now, we create a new resource by clicking on the “New Resource” to the top right, and then select “Pulsar”:

image

Configure the resource:

  1. Set the "Pulsar Server" to "pulsar://pulsar-broker1:6650" (multiple servers should be comma-separated), and keep the default values for all other configurations. Click the "Test" button to make sure the connection can be created successfully, and then click the "Create" button.
  2. `Pulsar Server` should be comma-separated Pulsar URLs, in format: `pulsar://<hostname>:<port>`, or `pulsar+ssl://<hostname>:<port>` if TLS is enabled on the Pulsar side.

image

Back to the “Actions” dialog, and then click on the “Confirm” button.

image

Back to the creating rule page, then click on “Create” button. The rule we created will be show in the rule list:

image

We have finished, testing the rule by sending an MQTT message to emqx:

  1. Topic: "t/1"
  2. QoS: 0
  3. Retained: false
  4. Payload: "hello"

Then inspect the Pulsar by consume the topic, verify a new record has been produced:

  1. \$ ./bin/pulsar-client consume testTopic -s "sub-name" -n 1000

And from the rule list, verify that the “Matched” column has increased to 1:

image

Use basic/token authentication for pulsar

Starting at EMQX Enterprise 4.3.10 and 4.4.4, we support basic and token authentication when connecting to Pulsar.

For example, to enable token authentication, select token from the Authentication Type dropdown-box:

image

And then provide the JWT in the bottom of the dialog box:

image