P19 UTR现场同步非结构化文件有文件内容为空的文件

ID	Creation Date	Assignee	Status
OMPUB-1215	2024-04-03T18:30:37.000+0800	刘学利	已解决

通过解析功能端发送的MessagePack数据，发现空文件只有以下一个数据块（offset为0，lastChunkFlag为1，chunk为null）。该类文件都有对应的元信息，该类数据块会被当做空文件发送到百分点。通过监控三个数据中心文件内容为空的文件占比为80%。

!image-2024-04-03-18-26-48-585.png!

发送文件数监控如下：

!image-2024-04-03-18-33-34-349.png!

空文件数监控如下：

!image-2024-04-03-18-33-52-850.png!houjinchuan commented on 2024-04-04T11:13:38.375+0800:

目前解决方案：file-chunk-combiner可以将该类空文件过滤，不发送给百分点。

需功能端确定发送的数据是否有问题。

liuxueli commented on 2024-04-07T18:16:56.119+0800:

命中monitor策略的HTTP会话无request body或response body时会出现offset为0, lastChunkFlag为1, chunk为null的现象。

gitlab commented on 2024-04-07T18:45:37.957+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|7946c6df5f] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [bugfix-http-empty-file|https://git.mesalab.cn/tango/firewall/-/tree/bugfix-http-empty-file]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-07T18:50:23.305+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|ca642dc008] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [bugfix-http-empty-file-v24.01|https://git.mesalab.cn/tango/firewall/-/tree/bugfix-http-empty-file-v24.01]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-08T11:37:11.049+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/tango/firewall/-/merge_requests/214] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [bugfix-http-empty-file|https://git.mesalab.cn/tango/firewall/-/tree/bugfix-http-empty-file]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-08T11:37:15.420+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|3c2e4d1b39] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-08T11:44:43.140+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|b832aefa95] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [dev-v24.04|https://git.mesalab.cn/tango/firewall/-/tree/dev-v24.04]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-08T11:51:47.496+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a merge request|https://git.mesalab.cn/tango/firewall/-/merge_requests/215] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [bugfix-http-empty-file|https://git.mesalab.cn/tango/firewall/-/tree/bugfix-http-empty-file]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

gitlab commented on 2024-04-08T12:07:13.656+0800:

[刘学利|https://git.mesalab.cn/liuxueli] mentioned this issue in [a commit|226fc85076] of [TSG Appliance / firewall|https://git.mesalab.cn/tango/firewall] on branch [dev-stellar-c|https://git.mesalab.cn/tango/firewall/-/tree/dev-stellar-c]:{quote}OMPUB-1215: Empty files will appear when the HTTP session has no request body or response body.{quote}

wangchengcheng commented on 2024-04-09T14:35:44.194+0800:

!image-2024-04-09-14-33-39-698.png|thumbnail!

查看现场监控，目前已无空文件，可以关闭该bug。

Attachments

Attachment: image-2024-04-03-18-26-48-585.png

Attachment: image-2024-04-03-18-29-22-746.png

Attachment: image-2024-04-03-18-33-34-349.png

Attachment: image-2024-04-03-18-33-52-850.png

Attachment: image-2024-04-09-14-33-39-698.png