gfwleak/galaxy-tsg-olap-log-stream-doublewrite

Archived

This repository has been archived on 2025-09-14. You can view files and clone it, but cannot push or open issues or pull requests.

Go to file

wangchengcheng 4cda43724d feat:adapt to percent log structure

2024-01-18 19:31:05 +08:00

feat:adapt to percent log structure

2024-01-18 19:31:05 +08:00

feat:adapt to percent log structure

2024-01-18 19:31:05 +08:00

pom.xml

1.适配TSG 23.07及以上功能，添加数据传输统计指标，并输出至pushgateway。(GAL-409)

2023-09-28 15:59:26 +08:00

README.md

更新README.md

2021-10-11 10:01:24 +00:00

README.md

log-stream-doublewrite

基于查询网关的动态日志预处理程序，接收原始日志根据对应schema定义进行数据清洗
同时将文件及文件元数据以约定格式写入对应Topic内供文件加载程序使用
并将结果回写到Kafka。