32 lines
1.5 KiB
Markdown
32 lines
1.5 KiB
Markdown
# 配置模版举例
|
||
|
||
## session_record.yaml.j2 （会话日志ETL场景）
|
||
|
||
- 多数中心部署场景: 分中心Data Transporter预处理后，集中汇聚至国家中心（NDC）
|
||
- etl_session_record_kafka_to_ndc_kafka (A-DT)
|
||
- Topology: kafka_source -> etl_processor -> kafka_sink
|
||
- Data Flow: SESSION-RECORD -> SESSION-RECORD-PROCESSED
|
||
- 多数中心部署场景：国家中心侧加载会话日志写入ClickHouse
|
||
- session_record_processed_kafka_to_clickhouse(A-NDC)
|
||
- Topology: kafka_source -> clickhouse_sink
|
||
- Data Flow: SESSION-RECORD-PROCESSED -> session_record_local
|
||
- 集中部署场景：摄入会话日志，预处理后写入ClickHouse
|
||
- etl_session_record_kafka_to_clickhouse (B)
|
||
- Topology: kafka_source -> etl_processor -> clickhouse_sink
|
||
- Data Flow: SESSION-RECORD -> session_record_local
|
||
|
||
## data_transporter.yaml.j2 (数据回传场景)
|
||
|
||
- troubleshooting_file_stream_kafka_to_ndc_kafka
|
||
- Topology: kafka_source -> kafka_sink (format:raw)
|
||
- Data Flow: TROUBLESHOOTING-FILE-STREAM-RECORD -> TROUBLESHOOTING-FILE-STREAM-RECORD
|
||
|
||
## realtime_log_streaming_cn_session_record.yaml.template （向其它厂商/第三方推送场景）
|
||
|
||
`install_cn_udf.sh安装CN UDFs；grootstream.yaml定义CN知识库`
|
||
|
||
- etl_session_record_kafka_to_cn_kafka
|
||
- Topology: kafka_source -> etl_processor -> post_output_field_processor -> kafka_sink
|
||
- Data Flow: SESSION-RECORD(SESSION-RECORD-PROCESSED) -> SESSION-RECORD-CN
|
||
|