90 lines
2.0 KiB
Markdown
90 lines
2.0 KiB
Markdown
|
# 【E21现场】利用系统报表功能统计生成一个月Top 100 Applications，report生成失败。
|
|||
|
|
|
|||
|
|
| ID | Creation Date | Assignee | Status |
|
|||
|
|
|----|----------------|----------|--------|
|
|||
|
|
| OMPUB-648 | 2022-10-04T20:38:40.000+0800 | 戚岱杰 | 已关闭 |
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
利用统计生成一个月Top 100 Application from Aug-28 to Sept-28, 2022-by bytes，多次尝试均生成失败，做一个小时的报表统计report生成成功。
|
|||
|
|
|
|||
|
|
1个月的报表配置及排查中有效日志详情参见附件。**qidaijie** commented on *2022-10-06T11:46:43.277+0800*:
|
|||
|
|
|
|||
|
|
经过排查：
|
|||
|
|
# 单台数据量已超过600亿。
|
|||
|
|
!clickhouse单台数据量图.png|thumbnail!
|
|||
|
|
# 数据量较大，经过clickhouse预计运行时间在28389秒，已超过查询超时时间，固将该查询终止，导致了报表运行失败。
|
|||
|
|
!image-2022-10-06-11-47-08-689.png|thumbnail!
|
|||
|
|
|
|||
|
|
解决方案：
|
|||
|
|
通过修改配置禁用clickhouse速度检查功能，让报表可以持续运行。
|
|||
|
|
[^ck配置修改文件-禁用速度检查参数.docx]
|
|||
|
|
|
|||
|
|
后续需要多次执行报告查看运行效果。
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**qidaijie** commented on *2022-10-11T09:59:31.673+0800*:
|
|||
|
|
|
|||
|
|
现场环境gohangout与clickhouse混部，观察到gohangout占用的资源过多，对查询的过程中有一定影响。
|
|||
|
|
!image-2022-10-11-09-59-34-564.png|thumbnail!
|
|||
|
|
|
|||
|
|
对gohangout进行优化，目前报表已执行成功。
|
|||
|
|
!image-2022-10-11-10-00-50-884.png|thumbnail!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## Attachments
|
|||
|
|
|
|||
|
|
**31501/ck配置修改文件-禁用速度检查参数.docx**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31499/clickhouse单台数据量图.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31500/image-2022-10-06-11-47-08-689.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31558/image-2022-10-11-09-59-34-564.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31557/image-2022-10-11-10-00-50-884.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31490/微信图片_20221004153649.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31491/微信图片_20221004153656-1.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31492/微信图片_20221004153700.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31493/微信图片_20221004153704.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31494/微信图片_20221004153711.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**31489/微信图片_20221004153812.jpg**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|