131 lines
3.8 KiB
Markdown
131 lines
3.8 KiB
Markdown
|
# 【WMS-UTR项目】多台tsgx出现tsg_os_container_restart告警
|
|||
|
|
|
|||
|
|
| ID | Creation Date | Assignee | Status |
|
|||
|
|
|----|----------------|----------|--------|
|
|||
|
|
| OMPUB-1170 | 2024-03-01T17:45:50.000+0800 | 刘学利 | 已关闭 |
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
查询过去7天告警，发现pcap-tsgx06以及twa站点所有tsgx（twa-tsgx01–05）均多次出现tsg_os_container_restart告警；
|
|||
|
|
|
|||
|
|
其中msh站点是因为key还未插上。
|
|||
|
|
|
|||
|
|
!image-2024-03-01-17-44-17-519.png!**chengsiyuan** commented on *2024-03-04T12:02:22.201+0800*:
|
|||
|
|
|
|||
|
|
于2024.3.1对全网tsgx更新并enable SIP插件，同时手动重启了sapp；
|
|||
|
|
hotfix后截至目前，pcap-tsgx06出现重启；
|
|||
|
|
|
|||
|
|
!image-2024-03-04-11-49-50-186.png!
|
|||
|
|
|
|||
|
|
附件为pcap-tsgx06（20240226-20240304）的资产详情：
|
|||
|
|
|
|||
|
|
[^pcap-tsgx06(20240226-20240304).html]
|
|||
|
|
|
|||
|
|
^!image-2024-03-04-12-02-12-522.png!^
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangwei** commented on *2024-03-06T16:18:30.568+0800*:
|
|||
|
|
|
|||
|
|
twa05上开启jemalloc进行观测，7小时内存占用从32GB+上涨至72GB+，内存分配排名如下：
|
|||
|
|
|
|||
|
|
!image-2024-03-06-16-17-48-098.png|width=1225,height=689!
|
|||
|
|
|
|||
|
|
推测内存泄露的现场为HTTP解析层的http_doWitchGzipData [~liuxueli]
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2024-03-06T16:49:11.888+0800*:
|
|||
|
|
|
|||
|
|
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|https://git.mesalab.cn/MESA_Platform/http/-/commit/b8f494c571d412e748d7cb832ae7e94c41ac8b5b] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak]:{quote}OMPUB-1170: Bugfix memory leak{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2024-03-06T17:13:20.720+0800*:
|
|||
|
|
|
|||
|
|
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/MESA_Platform/http/-/merge_requests/27] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak]:{quote}OMPUB-1170: Bugfix memory leak{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2024-03-06T19:33:29.867+0800*:
|
|||
|
|
|
|||
|
|
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|https://git.mesalab.cn/MESA_Platform/http/-/commit/170fdce37d2a76684ba1c4048211a794b1e2f8da] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak-2|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak-2]:{quote}OMPUB-1170: Bugfix memory leak{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2024-03-07T13:30:30.708+0800*:
|
|||
|
|
|
|||
|
|
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/MESA_Platform/http/-/merge_requests/28] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [bugfix-memory-leak-2|https://git.mesalab.cn/MESA_Platform/http/-/tree/bugfix-memory-leak-2]:{quote}OMPUB-1170: Bugfix memory leak{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2024-03-07T13:30:34.372+0800*:
|
|||
|
|
|
|||
|
|
[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|https://git.mesalab.cn/MESA_Platform/http/-/commit/0571d0bc63c240d4c0adccaa40869a76cfe6013b] of [MESA Platform / http|https://git.mesalab.cn/MESA_Platform/http] on branch [master|https://git.mesalab.cn/MESA_Platform/http/-/tree/master]:{quote}OMPUB-1170: Bugfix memory leak{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## Attachments
|
|||
|
|
|
|||
|
|
**52621/image-2024-03-01-17-44-17-519.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52657/image-2024-03-04-11-49-50-186.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52660/image-2024-03-04-12-02-12-522.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52932/image-2024-03-06-16-17-48-098.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52622/pcap-tsgx01(Last+7+days).html**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52659/pcap-tsgx06(20240226-20240304).html**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52623/pcap-tsgx06(Last+7+days).html**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52624/pcap-tsgx06-sysinfo.log**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52625/sosreport-pcap-tsgx06-20240301131031.tar.xz**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52626/sosreport-twa-tsgx02-20240301123024.tar.xz**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**52627/twa-tsgx02(Last+7+days).html**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|