2025-09-14 21:52:36 +00:00
|
|
|
|
# 江苏项目:23.3.9.55版本Clickhouse适配
|
|
|
|
|
|
|
|
|
|
|
|
| ID | Creation Date | Assignee | Status |
|
|
|
|
|
|
|----|----------------|----------|--------|
|
|
|
|
|
|
| OMPUB-1159 | 2024-02-26T17:42:00.000+0800 | 戚岱杰 | 完成 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
江苏扬州反诈项目计划于2024.03.20上线,其中OLAP部署规划如下:
|
|
|
|
|
|
CK集群管局提供(管局在他们的CK集群里给咱们开用户),其他组件使用独立服务器部署。
|
|
|
|
|
|
|
|
|
|
|
|
根据之前用户反馈的信息,江苏管局的CK版本为23.3.9.55,需要OLAP进行适配,申请研发支持。
|
|
|
|
|
|
|
|
|
|
|
|
**doufenghu** commented on *2024-03-04T09:42:09.829+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
后续规划使用独立服务器部署ClickHouse,基于TSG OALP 24.02使用CK版本为21.8.3。
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**qidaijie** commented on *2024-03-12T13:58:59.093+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
与现场沟通,江苏管局提供的Clickhouse集群情况如下:
|
|
|
|
|
|
* CK集群名称 js_datahouse
|
|
|
|
|
|
* 建表时须配置表TTL(留存半年)和字段注释
|
|
|
|
|
|
* 每个都是数据节点,使用 ReplicatedMergeTree 复制引擎。
|
|
|
|
|
|
* 集群没有对max_execution_time做限制,需要在客户端做查询限制
|
|
|
|
|
|
* 不开放查询系统表的权限
|
|
|
|
|
|
* 集群非UTC时区
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
综上:
|
|
|
|
|
|
* TSG 24.02版本建表语句需进行修改调整为复制引擎,增加表TTL
|
|
|
|
|
|
* Chproxy需根据现场集群修改负载配置
|
|
|
|
|
|
* 存储配额、TTL、Report功能可能受到影响,需要测试
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**qidaijie** commented on *2024-03-13T11:47:34.581+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
现场共创建3个用户,信息如下:
|
|
|
|
|
|
* tsg_query JSFZ@2024.query
|
|
|
|
|
|
* tsg_insert JSFZ@2024.insert
|
|
|
|
|
|
* tsg_report JSFZ@2024.report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**qidaijie** commented on *2024-03-14T14:53:02.075+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
[~zhangzhihan] 按照现场需求修改的TSG 24.02版本建表语句:[^js-tsg-2402-create-table.sql]
|
|
|
|
|
|
* 增加字段注释、表TTL(半年),使用复制引擎
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**qidaijie** commented on *2024-03-27T14:44:29.570+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
基于现场CK环境情况修改的Chproxy配置文件:[^config.yml]
|
|
|
|
|
|
* ^增加不同用户的查询执行时间等限制。^
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**qidaijie** commented on *2024-04-09T15:35:14.577+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
已根据现场情况完成相关部署,TSG界面可查询到日志,时区差异问题已解决。
|
|
|
|
|
|
|
|
|
|
|
|
!SESSION日志截图.png|thumbnail!!SECURITY日志截图.png|thumbnail!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
# Attachments
|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: config.yml
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
[config.yml](https://gfwleak.exec.li/admin/geedge-jira/raw/branch/master/attachment/54673/config.yml)
|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: js-tsg-2402-create-table.sql
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
[js-tsg-2402-create-table.sql](https://gfwleak.exec.li/admin/geedge-jira/raw/branch/master/attachment/53619/js-tsg-2402-create-table.sql)
|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: SECURITY日志截图.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Attachment: SESSION日志截图.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
|
|
|
|
|
|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|