Files
geedge-jira/md/OMPUB-1388.md
2025-09-14 21:52:36 +00:00

1.9 KiB
Raw Blame History

【E21】OLAP ClickHouse 服务器的峰值磁盘 I/O 利用率超过 90%

ID Creation Date Assignee Status
OMPUB-1388 2024-07-29T10:59:29.000+0800 张洪庆 已关闭

!image-2024-07-29-10-58-50-778.png!!image-2024-07-29-10-59-16-523.png!!image-2024-07-29-10-59-26-273.png!zhanghongqing commented on 2024-07-30T16:29:37.266+0800:

|Data Center|2024-03-26 峰值会话日志 Logs/s|2024-07-25 峰值会话日志 Logs/s| |Bole|248,000 |513,000 | |Shashamane|86,000 |25,000 | |Bahir Dar|32,000 |56,000 | |Safaricom Kaliti|41,000 |110,000 | |Safaricom STEP HQ|33,000 |55,000 | |Dire Dawa|29,000 |15,000 | |Legehar|39,000 |28,000 | |Old Airport|28,000 |35,000 | |Microwave|121,000 |356,000 | |Nefas Silk|36,000 |112,000 | |Kirkos|35,000 |78,000 | |Total |728,000 |1,383,000 |


zhanghongqing commented on 2024-07-31T09:48:03.249+0800:

[~liuyang]  为减小clickhouse磁盘IO占用保证服务器磁盘IO使用率在健康状态80%以下。

建议会话日志部分字段不写入clickhouse存储具体字段见附件E21session-record字段统计.xlsx


zhanghongqing commented on 2024-07-31T16:50:37.416+0800:

更新内容:

将clickhouse查询节点扩容为数据节点

在Flink任务内配置部分字段不写入clickhouse数据库

操作文档:https://docs.geedge.net/pages/viewpage.action?pageId=143925053


Attachments

60340/alert-message-2024-07-25+08-48-18.xlsx


60382/clickhouse查询节点扩容为数据节点Flinksession-record任务操作.txt


60373/E21session-record字段统计.xlsx


60339/image-2024-07-29-10-58-50-778.png


60338/image-2024-07-29-10-59-16-523.png


60337/image-2024-07-29-10-59-26-273.png


60381/session_record_processed_kafka_to_clickhouse