3.8 KiB
【WMS-UTR项目】多台tsgx出现tsg_os_container_restart告警
| ID | Creation Date | Assignee | Status |
|---|---|---|---|
| OMPUB-1170 | 2024-03-01T17:45:50.000+0800 | 刘学利 | 已关闭 |
查询过去7天告警，发现pcap-tsgx06以及twa站点所有tsgx（twa-tsgx01–05）均多次出现tsg_os_container_restart告警；
其中msh站点是因为key还未插上。
!image-2024-03-01-17-44-17-519.png!chengsiyuan commented on 2024-03-04T12:02:22.201+0800:
于2024.3.1对全网tsgx更新并enable SIP插件，同时手动重启了sapp； hotfix后截至目前，pcap-tsgx06出现重启；
!image-2024-03-04-11-49-50-186.png!
附件为pcap-tsgx06（20240226-20240304）的资产详情：
[^pcap-tsgx06(20240226-20240304).html]
^!image-2024-03-04-12-02-12-522.png!^
yangwei commented on 2024-03-06T16:18:30.568+0800:
twa05上开启jemalloc进行观测，7小时内存占用从32GB+上涨至72GB+，内存分配排名如下：
!image-2024-03-06-16-17-48-098.png|width=1225,height=689!
推测内存泄露的现场为HTTP解析层的http_doWitchGzipData [~liuxueli]
gitlab commented on 2024-03-06T16:49:11.888+0800:
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|b8f494c571] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak]:{quote}OMPUB-1170: Bugfix memory leak{quote}
gitlab commented on 2024-03-06T17:13:20.720+0800:
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/MESA_Platform/http/-/merge_requests/27] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak]:{quote}OMPUB-1170: Bugfix memory leak{quote}
gitlab commented on 2024-03-06T19:33:29.867+0800:
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|170fdce37d] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak-2|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak-2]:{quote}OMPUB-1170: Bugfix memory leak{quote}
gitlab commented on 2024-03-07T13:30:30.708+0800:
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/MESA_Platform/http/-/merge_requests/28] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak-2|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak-2]:{quote}OMPUB-1170: Bugfix memory leak{quote}
gitlab commented on 2024-03-07T13:30:34.372+0800:
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|0571d0bc63] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [master|https://git.mesalab.cn/MESA_Platform/http/-/tree/master]:{quote}OMPUB-1170: Bugfix memory leak{quote}
Attachments
52621/image-2024-03-01-17-44-17-519.png
52657/image-2024-03-04-11-49-50-186.png
52660/image-2024-03-04-12-02-12-522.png
52932/image-2024-03-06-16-17-48-098.png
52622/pcap-tsgx01(Last+7+days).html
52659/pcap-tsgx06(20240226-20240304).html
52623/pcap-tsgx06(Last+7+days).html
52624/pcap-tsgx06-sysinfo.log
52625/sosreport-pcap-tsgx06-20240301131031.tar.xz
52626/sosreport-twa-tsgx02-20240301123024.tar.xz
52627/twa-tsgx02(Last+7+days).html