【E21现场】BOLE-IGW 10.225.11.5 Nezha 资产详情页图表未正常显示

ID	Creation Date	Assignee	Status
OMPUB-481	2022-05-10T20:51:45.000+0800	刘学利	已关闭

BOLE-IGW 10.225.11.5 在Nezha系统上查看该NPB资产的详情页部分图表从2022-05-10 06:01:32 未正常展示，显示无数据。

具体页面展示情况详情可看附件，今天已进行初步定位

定位进展：史振东通过目前的定位查询认为BOL-IGW-T9K001-NPB05 详情页图表未正常显示，原因是该 Asset 关联 SAPP Endpoint 没有正常返回图表使用指标信息。

定位结果：目前该 Asset 关联 SAPP Endpoint 没有正常返回图表使用指标信息的原因还未定位出，研发认为需要提BUG进行进一步的定位处理。

liuxueli commented on 2022-05-11T09:45:20.027+0800:

初步定位是Nezha到功能端prometheous里采集获取统计时，返回内容不全导致的 ** 使用浏览器访问：[http://10.225.11.5:9000/metrics/blade/sapp]，捕包查看，返回内容不全 *** !image-2022-05-11-09-43-53-246.png! ** 在京版访问：http://192.168.40.81:9000/metrics/blade/sapp，返回完整的示例： *** !image-2022-05-11-09-45-14-519.png!

liuxueli commented on 2022-05-12T15:17:23.740+0800:

经测试验证，怀疑nginx反代缓存导致访问[http://10.225.11.5:9000/metrics/blade/sapp]请求内容返回结果不完整，[~luqiuwen] 帮忙看一下。
使用浏览器无痕模式访问: [http://10.225.11.5:9000/metrics/blade/sapp]，放回的结果不完整[^browser-nginx-port-9000.pcap] ** {code:java} keepalive_req_pkt{app_name="keepalive",line_name="10_10_0_20"} 118654463 keepalive_rpy_pkt{app_name="keepalive",line_name="10_10_0_20"} 118654463 plug_load_status{app_name="plug_load",line_name="__plug_platform_wannat_wangw_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_platform_wire_graft_wire_graft_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_platform_app_proto_identify_app_proto_identify_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_platform_tsg_master_tsg_master_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_platform_app_proto_engine_app_proto_engine_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_platform_tsg_ddos_sketch_tsg_ddos_sketch_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_deal_socks_deal_socks_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_sip_sip_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_rtp_rtp_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_ssl_ssl_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_http_http_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_dns_dns_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_mail_mail_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_ftp_ftp_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_quic_quic_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_l2tp_protocol_plug_l2tp_protocol_plug_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_gtp_gtp_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_radius_radius_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_ssh_ssh_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_protocol_stratum_stratum_inf"} 1 plug_load_status{app_name="plug_load",line_name="__plug_business_tsg_conn_sketch_tsg_conn_sketch_inf"} 1 {code}
使用浏览器无痕模式访问: [http://10.225.11.5:9273/sapp]，返回结果完整[^browser-sapp-port-9273.pcap] ** {code:java} sapp_Line_Pkt{app_name="sapp"} 0 sapp_Line_Bit{app_name="sapp"} 9937532884567328 sapp_Eth_Pkt{app_name="sapp"} 2123441253807 sapp_Eth_Bit{app_name="sapp"} 8785698889247416 sapp_Pkt_Inbound{app_name="sapp"} 772566403678 sapp_Bit_Inbound{app_name="sapp"} 6723260493132008 sapp_Pkt_Outbound{app_name="sapp"} 1350874850129 sapp_Bit_Outbound{app_name="sapp"} 2062438396115408 sapp_Unknown_Pkt{app_name="sapp"} 19696112 sapp_Unknown_Bit{app_name="sapp"} 45806531432 sapp_Snd_Err_Pkt{app_name="sapp"} 1604 sapp_Ipv4_Pkt{app_name="sapp"} 2122532515138 sapp_Ipv4_Bit{app_name="sapp"} 8532119152617408 sapp_Ipv6_Pkt{app_name="sapp"} 266502961 sapp_Ipv6_Bit{app_name="sapp"} 638656573000 sapp_Tcp_Pkt{app_name="sapp"} 1786469019061 sapp_Tcp_Bit{app_name="sapp"} 6392992471701728 sapp_Dup_Tcp_Pkt{app_name="sapp"} 5326374030 sapp_Dup_Tcp_Bit{app_name="sapp"} 28547541046872 sapp_Tcp_Lost_Bit{app_name="sapp"} 15016114692738632 sapp_Tcp_Lost_STM{app_name="sapp"} 856714059 sapp_Dup_Key_Err{app_name="sapp"} 0 sapp_Tcp_Close_byT{app_name="sapp"} 36544657295 sapp_Tcp_Close_byK{app_name="sapp"} 3795480956 sapp_Udp_Pkt{app_name="sapp"} 329369345598 sapp_Udp_Bit{app_name="sapp"} 1275910294214688 sapp_Dup_Udp_Pkt{app_name="sapp"} 102 sapp_Dup_Udp_Bit{app_name="sapp"} 418272 sapp_Udp_Close_byT{app_name="sapp"} 86941882013 sapp_Udp_Close_byK{app_name="sapp"} 4286981990 sapp_Tcp_Link_New{app_name="sapp"} 42875065099 sapp_Tcp_Link_Del{app_name="sapp"} 42873622672 sapp_Tcp_Concurrent{app_name="sapp"} 428572 sapp_Udp_Link_New{app_name="sapp"} 15074712736 sapp_Udp_Link_Del{app_name="sapp"} 15073566619 sapp_Udp_Concurrent{app_name="sapp"} 377795 sapp_Tcp_Link_Double{app_name="sapp"} 1659335534 sapp_Tcp_Link_C2S{app_name="sapp"} 9379783578 sapp_Tcp_Link_S2C{app_name="sapp"} 3325910555 sapp_Tcp_Link_Double_ALL{app_name="sapp"} 2580474063 sapp_Tcp_Link_C2S_ALL{app_name="sapp"} 35345133787 sapp_Tcp_Link_S2C_ALL{app_name="sapp"} 4948014822 sapp_Udp_Link_Double{app_name="sapp"} 144085604 sapp_Udp_Link_C2S{app_name="sapp"} 842301489 sapp_Udp_Link_S2C{app_name="sapp"} 930701230 sapp_Udp_Link_Double_ALL{app_name="sapp"} 837275983 sapp_Udp_Link_C2S_ALL{app_name="sapp"} 11078391070 sapp_Udp_Link_S2C_ALL{app_name="sapp"} 3157899566 sapp_Send_Tcp_Rst{app_name="sapp"} 1612 sapp_Send_Tcp_S_A{app_name="sapp"} 0 sapp_Send_Udp{app_name="sapp"} 4 sapp_DDOS_Bypass{app_name="sapp"} 1 sapp_Tcp_Bypass_STM{app_name="sapp"} 2055802816 sapp_Tcp_Bypass_Pkt{app_name="sapp"} 42699254673 sapp_Tcp_Bypass_Bit{app_name="sapp"} 17436680646331 sapp_Udp_Bypass_STM{app_name="sapp"} 635110229 sapp_Udp_Bypass_Pkt{app_name="sapp"} 81496585573 sapp_Udp_Bypass_Bit{app_name="sapp"} 42980528588929

{code}

在Nezha机器上使用curl访问: [http://10.225.11.5:9000/metrics/blade/sapp]，放回的结果不完整[^curl-nginx-port-9000.pcap]
在Nezha机器上使用curl访问 [http://10.225.11.5:9273/sapp]，放回的结果不完整[^curl-sapp-port-9273.pcap]

luqiuwen commented on 2022-05-12T15:48:48.657+0800:

!image-2022-05-12-15-51-05-199.png!

反代通过访问[http://127.0.0.1:9273/metrics]获得sapp进程下注册的所有metrics。在10.225.11.5上访问该地址，结果也不完整，说明sapp提供给反代的metrics数据不完整。

liuxueli commented on 2022-05-12T16:25:10.082+0800:

已在京版环境复现：192.168.40.21
已建相关BUG: TSG-10617

gitlab commented on 2022-05-12T17:38:18.737+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|b76250099c] of [MESA Framework / FieldStat2|https://git.mesalab.cn/MESA_framework/FieldStat2] on branch [bugfix-TSG-10617|https://git.mesalab.cn/MESA_framework/FieldStat2/-/tree/bugfix-TSG-10617]:{quote}OMPUB-481, TSG-10617: 修复FieldStat2输出prometheous格式，剩余空间较小，snprintf导致内存越界的问题{quote}

gitlab commented on 2022-05-12T17:50:51.142+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/MESA_framework/FieldStat2/-/merge_requests/65] of [MESA Framework / FieldStat2|https://git.mesalab.cn/MESA_framework/FieldStat2] on branch [bugfix-TSG-10617|https://git.mesalab.cn/MESA_framework/FieldStat2/-/tree/bugfix-TSG-10617]:{quote}OMPUB-481, TSG-10617: 修复FieldStat2输出prometheous格式，剩余空间较小，snprintf导致内存越界的问题{quote}

gitlab commented on 2022-05-26T08:25:36.864+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|8e49070477] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.02-framework|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.02-framework]:{quote}更新libmaatframe、libMESA_field_stat2，修复：{quote}

gitlab commented on 2022-05-26T08:26:21.320+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/779] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.02-framework|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.02-framework]:{quote}更新libmaatframe、libMESA_field_stat2，修复：{quote}

liuju commented on 2022-06-06T21:25:47.095+0800:

已进行tsg-os-v22.02.13版本升级，升级之后观察nezha系统上NPB资产详情界面目前展示正常。现关闭该问题[~liuxueli]

gitlab commented on 2022-08-19T18:42:31.185+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|10a9bc5339] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.08-libMESA_field_stat2|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.08-libMESA_field_stat2]:{quote}更新libMESA_field_stat2，修复: OMPUB-481: BOLE-IGW 10.225.11.5 Nezha 资产详情页图表未正常显示{quote}

gitlab commented on 2022-08-19T18:42:43.852+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/870] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.08-libMESA_field_stat2|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.08-libMESA_field_stat2]:{quote}更新libMESA_field_stat2，修复: OMPUB-481: BOLE-IGW 10.225.11.5 Nezha 资产详情页图表未正常显示{quote}

gitlab commented on 2022-08-19T18:45:23.490+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|74fa286271] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.07-libMESA_field_stat2|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.07-libMESA_field_stat2]:{quote}更新libMESA_field_stat2，修复: OMPUB-481 - 【E21现场】BOLE-IGW 10.225.11.5 Nezha 资产详情页图表未正常显示{quote}

gitlab commented on 2022-08-19T18:45:47.768+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/merge_requests/871] of [TSG / tsg-os-buildimage|https://git.mesalab.cn/tsg/tsg-os-buildimage] on branch [update-22.07-libMESA_field_stat2|https://git.mesalab.cn/tsg/tsg-os-buildimage/-/tree/update-22.07-libMESA_field_stat2]:{quote}更新libMESA_field_stat2，修复: OMPUB-481 - 【E21现场】BOLE-IGW 10.225.11.5 Nezha 资产详情页图表未正常显示{quote}