6.4 KiB
福建项目:功能端升级2209后重启频繁
| ID | Creation Date | Assignee | Status |
|---|---|---|---|
| OMPUB-719 | 2022-12-02T13:18:25.000+0800 | 杨威 | 已关闭 |
功能端地址: 192.168.21.3-4 192.168.22.1-2
大概几十分钟重启一次liuxueli commented on 2022-12-03T10:49:44.387+0800:
- 根据重启生成的coredump分析,内存已经写乱,怀疑插件存在写越界的情况 ** 2022-12-02 21:00:00 192.168.21.3-4,192.168.22.2关闭dtls解析层及业务层后,程序连续运行13小时未重启,{color:#FF0000}初步定位dtls相关插件存在写越界{color} *** fw_dtls_plug-1.0.1.5f7daf5-1.el7.x86_64 *** dtls-1.0.4.cfc47d7-1.x86_64
liuxueli commented on 2022-12-03T13:06:25.315+0800:
- 192.168.21.4在运行15小时后出现重启,已定位为基础协议识别插件导致,参见:TSG-12915
liuxueli commented on 2022-12-04T14:26:04.280+0800:
- 192.168.21.3出现一次重启,已定位为HTTP协议解析层插件url decode函数导致,参见:TSG-12926
liuxueli commented on 2022-12-05T17:29:40.461+0800:
- 2022-12-05 HTTP解析层与app_proto_identify(基础协议识别)插件非法访问导致重启的问题已修复。
liuxueli commented on 2022-12-05T17:35:12.339+0800:
- 192.168.21.3/4 使用从应用模式,运行sapp+dtls解析层,发现程序重启频繁,[~pengxuanzheng] 可以使用从应用进行调试 ** 生成的minidump目录: *** /run/sapp/crashreport/ ** 从应用目录 *** :/opt/tsg/sapp_slave/; ** 从应用启动方式 *** ./r2; 后台会运行sapp_slave和r3;ps xaf可以看到 ** 从应用停止方式 *** killall r3 sapp_slave ** 重启记录:
{code:java} Mon Dec 5 15:11:22 2022, ./plug/protocol/dtls/dtls.so init succ, using [945] us Mon Dec 5 15:11:22 2022, load DTLS success! Mon Dec 5 15:13:04 2022, ./plug/protocol/dtls/dtls.so init succ, using [3147] us Mon Dec 5 15:13:04 2022, load DTLS success! Mon Dec 5 15:24:23 2022, ./plug/protocol/dtls/dtls.so init succ, using [888] us Mon Dec 5 15:24:23 2022, load DTLS success! Mon Dec 5 15:24:40 2022, ./plug/protocol/dtls/dtls.so init succ, using [802] us Mon Dec 5 15:24:40 2022, load DTLS success! Mon Dec 5 15:25:14 2022, ./plug/protocol/dtls/dtls.so init succ, using [781] us Mon Dec 5 15:25:14 2022, load DTLS success! Mon Dec 5 15:28:09 2022, ./plug/protocol/dtls/dtls.so init succ, using [704] us Mon Dec 5 15:28:09 2022, load DTLS success! Mon Dec 5 15:30:37 2022, ./plug/protocol/dtls/dtls.so init succ, using [907] us Mon Dec 5 15:30:37 2022, load DTLS success! Mon Dec 5 15:39:57 2022, ./plug/protocol/dtls/dtls.so init succ, using [721] us Mon Dec 5 15:39:57 2022, load DTLS success! Mon Dec 5 15:43:06 2022, ./plug/protocol/dtls/dtls.so init succ, using [730] us Mon Dec 5 15:43:06 2022, load DTLS success! Mon Dec 5 15:45:37 2022, ./plug/protocol/dtls/dtls.so init succ, using [803] us Mon Dec 5 15:45:37 2022, load DTLS success! Mon Dec 5 15:48:05 2022, ./plug/protocol/dtls/dtls.so init succ, using [676] us Mon Dec 5 15:48:05 2022, load DTLS success! Mon Dec 5 15:51:24 2022, ./plug/protocol/dtls/dtls.so init succ, using [761] us Mon Dec 5 15:51:24 2022, load DTLS success! Mon Dec 5 15:59:27 2022, ./plug/protocol/dtls/dtls.so init succ, using [734] us Mon Dec 5 15:59:27 2022, load DTLS success! Mon Dec 5 16:00:57 2022, ./plug/protocol/dtls/dtls.so init succ, using [748] us Mon Dec 5 16:00:57 2022, load DTLS success! Mon Dec 5 16:08:46 2022, ./plug/protocol/dtls/dtls.so init succ, using [737] us Mon Dec 5 16:08:46 2022, load DTLS success! Mon Dec 5 16:13:50 2022, ./plug/protocol/dtls/dtls.so init succ, using [693] us Mon Dec 5 16:13:50 2022, load DTLS success! Mon Dec 5 16:40:43 2022, ./plug/protocol/dtls/dtls.so init succ, using [3047] us Mon Dec 5 16:40:43 2022, load DTLS success! Mon Dec 5 17:16:01 2022, ./plug/protocol/dtls/dtls.so init succ, using [778] us Mon Dec 5 17:16:01 2022, load DTLS success! {code}
pengxuanzheng commented on 2022-12-06T17:26:18.956+0800:
http与app_proto_identify更新之后,打开dtls和fw_dtls_plug,没有出现重启现象,已经正常运行五个小时,后续继续观察
yangwei commented on 2022-12-07T10:27:16.122+0800:
[~pengxuanzheng] 补充下详细信息,192.168.21.3-4和192.168.22.1-2全部打开都没有出现重启?正常运行五个小时是从什么时刻到什么时刻?
pengxuanzheng commented on 2022-12-07T17:12:04.116+0800:
昨天中午12点多到傍晚17点多正常运行,今天21.3和21.4 有重启,分析代码发现,tsg_master使用dtls_parse_sni的时候,如果此时是server_hello,可能会因为解析到错误的字节数导致发生非法读写。修改代码后,更新到21.3, 21.4,22.1和22.2,观察 SAPP是否还会发生重启现象。TSG-12987
gitlab commented on 2022-12-21T17:21:38.110+0800:
[彭宣正|https://git.mesalab.cn/pxz] mentioned this issue in [a commit|344eb54373] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-dtls|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-dtls]:{quote}🐞 fix(TSG-13132,TSG-13007,TSG-12987, TSG-12943 , , OMPUB-719): update dtls-1.0.4 to dtls-1.0.9{quote}
gitlab commented on 2022-12-21T17:22:40.877+0800:
[彭宣正|https://git.mesalab.cn/pxz] mentioned this issue in [a commit|f524694bda] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-dtls|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-dtls]:{quote}🐞 fix(TSG-13132,TSG-13007,TSG-12987, TSG-12943 , OMPUB-719): update dtls-1.0.4 to dtls-1.0.9{quote}
gitlab commented on 2022-12-21T17:23:14.266+0800:
[彭宣正|https://git.mesalab.cn/pxz] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/1032] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-dtls|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-dtls]:{quote}🐞 fix(TSG-13132,TSG-13007,TSG-12987, TSG-12943 , OMPUB-719): update dtls-1.0.4 to dtls-1.0.9{quote}