131 lines
3.5 KiB
Markdown
131 lines
3.5 KiB
Markdown
|
# 【P19现场】tsg-os出现单个线程cpu占用100%，导致丢包，火焰图发现卡在tsg_send_log
|
|||
|
|
|
|||
|
|
| ID | Creation Date | Assignee | Status |
|
|||
|
|
|----|----------------|----------|--------|
|
|||
|
|
| OMPUB-963 | 2023-07-16T14:02:51.000+0800 | 刘学利 | 已解决 |
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
No description
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangyubo** commented on *2023-07-16T14:05:33.300+0800*:
|
|||
|
|
|
|||
|
|
cat sysinfo.log发现93号线程无新建，无del；
|
|||
|
|
!企业微信截图_16894855254844.png|thumbnail! [^93perf.svg]
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangyubo** commented on *2023-07-16T14:08:16.645+0800*:
|
|||
|
|
|
|||
|
|
目前其他机器未出现该问题
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangyubo** commented on *2023-07-16T14:11:45.742+0800*:
|
|||
|
|
|
|||
|
|
当前丢包情况
|
|||
|
|
monit_stream -H -s -l
|
|||
|
|
!screenshot-1.png|thumbnail!
|
|||
|
|
perf top -C 93
|
|||
|
|
!screenshot-2.png|thumbnail!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangyubo** commented on *2023-07-16T14:26:17.611+0800*:
|
|||
|
|
|
|||
|
|
找到93cpu对应的线程号202
|
|||
|
|
pstack 202
|
|||
|
|
!screenshot-3.png|thumbnail!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2023-07-16T14:51:27.167+0800*:
|
|||
|
|
|
|||
|
|
[杨威|https://git.mesalab.cn/yangwei] mentioned this issue in [a commit|https://git.mesalab.cn/tango/tsg_master/-/commit/613bc2bbde0e6cfae60c0c4e64cb98d7b9b7f644] of [TSG Appliance / tsg_master|https://git.mesalab.cn/tango/tsg_master] on branch [Fix-OMPUB-963|https://git.mesalab.cn/tango/tsg_master/-/tree/Fix-OMPUB-963]:{quote}🐞 fix(session_l4_protocol_label_update): FIX OMPUB-963{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2023-07-16T15:03:47.186+0800*:
|
|||
|
|
|
|||
|
|
[杨威|https://git.mesalab.cn/yangwei] mentioned this issue in [a merge request|https://git.mesalab.cn/tango/tsg_master/-/merge_requests/372] of [TSG Appliance / tsg_master|https://git.mesalab.cn/tango/tsg_master] on branch [Fix-OMPUB-963|https://git.mesalab.cn/tango/tsg_master/-/tree/Fix-OMPUB-963]:{quote}🐞 fix(session_l4_protocol_label_update): FIX OMPUB-963{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2023-07-16T15:35:00.025+0800*:
|
|||
|
|
|
|||
|
|
[杨威|https://git.mesalab.cn/yangwei] mentioned this issue in [a commit|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/commit/29d73abb7ff4acd73f43e817d8d7ad64abc6a93c] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [Fix-OMPUB-963|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/Fix-OMPUB-963]:{quote}更新tsg_master-6.0.38.613bc2b，修复 OMPUB-963，发送日志时单核死锁{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2023-07-16T15:35:13.230+0800*:
|
|||
|
|
|
|||
|
|
[杨威|https://git.mesalab.cn/yangwei] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/1561] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [Fix-OMPUB-963|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/Fix-OMPUB-963]:{quote}更新tsg_master-6.0.38.613bc2b，修复 OMPUB-963，发送日志时单核死锁{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**yangyubo** commented on *2023-07-16T16:00:31.262+0800*:
|
|||
|
|
|
|||
|
|
已更新并全部重启，持续观察
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**gitlab** commented on *2023-07-17T01:30:03.944+0800*:
|
|||
|
|
|
|||
|
|
[陆秋文|https://git.mesalab.cn/luqiuwen] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/1562] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [dev-23.07|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/dev-23.07]:{quote}更新tsg_master-6.0.38.613bc2b，修复 OMPUB-963，发送日志时单核死锁{quote}
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## Attachments
|
|||
|
|
|
|||
|
|
**41341/93perf.svg**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**41343/screenshot-1.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**41344/screenshot-2.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**41345/screenshot-3.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**41342/企业微信截图_1689485501691.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**41340/企业微信截图_16894855254844.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|