Configuration

Overview

Audit-proxy source-channel-sink pipeline configuration (dataproxy-{tube|pulsar}.conf).Audit-store storage service configuration (application.properties)

Audit-proxy source-channel-sink pipeline configuration (dataproxy-{tube|pulsar}.conf)

Basic Configuration

ParameterDescriptionDefault valueNotes
agent1.sourcessource typpetcp-source
agent1.channelsused channelch-msg1
agent1.sinksused sinkpulsar-sink-msg1

|

sources Configuration

ParameterDescriptionDefault valueNotes
agent1.sources.tcp-source.channelsDefine the channel used in the sourcech-msg1
agent1.sources.tcp-source.hosttcp ip binding and listening0.0.0.0
agent1.sources.tcp-source.porttcp port binding10081

channel Configuration

ParameterDescriptionDefault valueNotes
agent1.channels.ch-msg1.typememory channel typememory
agent1.channels.ch-msg2.typefile channel typefile

sink Configuration

ParameterDescriptionDefault valueNotes
agent1.sinks.pulsar-sink-msg1.channelThe upstream channel name of the sinkch-msg1
agent1.sinks.pulsar-sink-msg1.typeThe sink class is implemented, where the message pushes data to the pulsar clusterorg.apache.inlong.audit.sink.PulsarSink
agent1.sinks.pulsar-sink-msg1.pulsar_server_urlpulsar brokerpulsar://localhost:6650
agent1.sinks.pulsar-sink-msg1.topicpulsar topicpersistent://public/Default value/inlong-audit
agent1.sinks.pulsar-sink-msg1.enable_token_authWhether security certification is requiredfalse
agent1.sinks.pulsar-sink-msg1.auth_tokenpulsar authentication token

Audit-store storage service configuration (application.properties)

MQ configuration

ParameterDescriptionDefault valueNotes
audit.config.proxy.typeMQ typepulsar
audit.pulsar.server.urlpulsar brokerpulsar://127.0.0.1:6650
audit.pulsar.topicpulsar topicpersistent://public/Default value/inlong-audit
audit.pulsar.consumer.sub.nameconsumerinlong-audit-subscription
audit.pulsar.enable.authWhether security certification is requiredfalse
audit.pulsar.tokenpulsar authentication token

DB configuration

ParameterDescriptionDefault valueNotes
spring.datasource.druid.driver-class-nameSet the driver typecom.mysql.cj.jdbc.Driver
spring.datasource.druid.urljdbc URLjdbc:mysql://127.0.0.1:3306/apache_inlong_audit?characterEncoding=utf8&useSSL=false&serverTimezone=GMT%2b8&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=CONVERT_TO_NULL&allowPublicKeyRetrieval=true
spring.datasource.druid.usernameaccount nameroot
spring.datasource.druid.passwordpasswordinlong

ElasticSearch configuration

ParameterDescriptionDefault valueNotes
elasticsearch.hostbroker127.0.0.1
elasticsearch.portport9200
elasticsearch.authEnableWhether security certification is requiredfalse
elasticsearch.usernameaccount nameelastic
elasticsearch.passwordpasswordinlong
elasticsearch.indexDeleteDayIndex retention time, days5
elasticsearch.auditIdSetList of audit IDs that are allowed to write1,2

clickhouse configuration

ParameterDescriptionDefault valueNotes
clickhouse.driverSet the driver typeru.yandex.clickhouse.ClickHouseDriver
clickhouse.urlclickhouse URLjdbc:clickhouse://127.0.0.1:8123/Default value
clickhouse.usernameaccount nameDefault value
clickhouse.passwordpasswordDefault value