2025-09-14 21:52:36 +00:00
|
|
|
|
# 【E21现场】国家中心OLAP clickhouse 服务器上Setting Traffic Logs Max Days-Data cleaning executor执行但是未生效成功。
|
|
|
|
|
|
|
|
|
|
|
|
| ID | Creation Date | Assignee | Status |
|
|
|
|
|
|
|----|----------------|----------|--------|
|
|
|
|
|
|
| OMPUB-647 | 2022-10-03T22:16:40.000+0800 | 张洪庆 | 已关闭 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
国家中心OLAP clickhouse 服务器上Setting Traffic Logs Max Days-Data cleaning executor执行未生效成功,10.224.11.37-49 服务器本地仍存有8月份数据,2022-10-01 04:36:56硬盘/data使用100%。
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
现已手动删除10.224.11.37-49 :/data/tsg/olap/clickhouse/data/tsg_galaxy_v3/session_record_local 目录下
|
|
|
|
|
|
|
|
|
|
|
|
20220801~20220819数据先释放空间,恢复ck程序运行。**qidaijie** commented on *2022-10-06T11:51:48.275+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
经过排查为调度任务,执行存储配额任务异常,任务运行状态显示成功,但实际未删除相关数据。
|
|
|
|
|
|
!调度任务历史运行结果.png|thumbnail!
|
|
|
|
|
|
|
|
|
|
|
|
处理方式: [^调度任务存储配额功能修复_20221005.txt]
|
|
|
|
|
|
1:通过手动删除clickhouse数据方式恢复服务。
|
|
|
|
|
|
2:通过调用备用接口恢复了该功能,具体原因待排查。[~zhanghongqing]
|
|
|
|
|
|
!调度任务_运行正常截图.png|thumbnail!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**zhanghongqing** commented on *2022-10-13T15:55:26.964+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
原因: 调度中心执行ClickHouse清理任务,使用system.tables获取相关表名,并经过筛选并执行TTL清理操作。集群模式下操作查询节点system.tables 表无法获取到数据,导致相关表未清除。
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**zhanghongqing** commented on *2022-10-18T17:51:16.148+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
调度任务更新文件已上传:[https://de.files.gdnt-cloud.com/library/96d36930-4dff-4777-96d0-84e77c869c31/E21/upgrade/TSG22.07_upgrade/OLAP/20221018]
|
|
|
|
|
|
[~liuju]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
**zhanghongqing** commented on *2022-10-21T15:50:08.579+0800*:
|
|
|
|
|
|
|
|
|
|
|
|
!image-2022-10-21-15-37-00-779.png|width=525,height=84!!image-2022-10-21-15-37-37-786.png|width=565,height=225!
|
|
|
|
|
|
现场更新调度任务程序且运行了三天后进行校验,超出存储周期的历史数据已被成功清理,该功能已恢复正常。
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
# Attachments
|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: image-2022-10-21-15-37-00-779.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: image-2022-10-21-15-37-15-549.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: image-2022-10-21-15-37-37-786.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
Attachment: 调度任务_运行正常截图.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Attachment: 调度任务存储配额功能修复_20221005.txt
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|
[调度任务存储配额功能修复_20221005.txt](https://gfwleak.exec.li/admin/geedge-jira/raw/branch/master/attachment/31504/调度任务存储配额功能修复_20221005.txt)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Attachment: 调度任务历史运行结果.png
|
2025-09-14 22:27:11 +00:00
|
|
|
|
|
2025-09-14 22:26:17 +00:00
|
|
|
|

|
2025-09-14 21:52:36 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|