Update README.md

This commit is contained in:
窦凤虎
2024-05-21 00:59:51 +00:00
parent af88ee73ef
commit 53add1c5ea

View File

@@ -1,11 +1,11 @@
## session_record.yaml.template ## session_record.yaml.template
- etl_session_record_kafka_to_ndc_kafka (A-DT) // 多数中心部署分中心Data Transporter侧经过预处理后集中汇聚至国家中心NDC - etl_session_record_kafka_to_ndc_kafka (A-DT) // 多数中心部署分中心Data Transporter 预处理后集中汇聚至国家中心NDC
- Topology: kafka_source -> etl_processor -> kafka_sink - Topology: kafka_source -> etl_processor -> kafka_sink
- Data Flow: SESSION-RECORD -> SESSION-RECORD-PROCESSED - Data Flow: SESSION-RECORD -> SESSION-RECORD-PROCESSED
- session_record_processed_kafka_to_clickhouse(A-NDC) // 多数中心部署国家中心侧加载会话日志写入ClickHouse - session_record_processed_kafka_to_clickhouse(A-NDC) // 多数中心部署国家中心侧加载会话日志写入ClickHouse
- Topology: kafka_source -> clickhouse_sink - Topology: kafka_source -> clickhouse_sink
- Data Flow: SESSION-RECORD-PROCESSED -> session_record_local - Data Flow: SESSION-RECORD-PROCESSED -> session_record_local
- etl_session_record_kafka_to_clickhouse (B) // 集中部署: 摄入会话日志,预处理后直接携入ClickHouse - etl_session_record_kafka_to_clickhouse (B) // 集中部署: 摄入会话日志,预处理后入ClickHouse
- Topology: kafka_source -> etl_processor -> clickhouse_sink - Topology: kafka_source -> etl_processor -> clickhouse_sink
- Data Flow: SESSION-RECORD -> session_record_local - Data Flow: SESSION-RECORD -> session_record_local
@@ -17,7 +17,7 @@
- Topology: kafka_source -> etl_processor -> post_output_field_processor -> kafka_sink - Topology: kafka_source -> etl_processor -> post_output_field_processor -> kafka_sink
- Data Flow: SESSION-RECORD(SESSION-RECORD-PROCESSED) -> SESSION-RECORD-CN - Data Flow: SESSION-RECORD(SESSION-RECORD-PROCESSED) -> SESSION-RECORD-CN
## data_transporter.yaml.template ## data_transporter.yaml.template
- troubleshooting_file_stream_kafka_to_ndc_kafka - troubleshooting_file_stream_kafka_to_ndc_kafka