geedge-jira/md/OMPUB-1189.md

E21 packet_io_rxdrop告警

ID	Creation Date	Assignee	Status
OMPUB-1189	2024-03-22T12:05:14.000+0800	杨威	已关闭

---

2024.3.19监控发现如下NPB出现tsg-0140-packet-io-rxdrop告警，对应NPB监控参见附件

• BOL-IGW-T9K001-NPB02
• BOL-IGW-T9K002-NPB02
• LGH-PE-T9K001-NPB01
• LGH-PE-T9K001-NPB02yangwei commented on 2024-03-25T09:39:20.487+0800:

两次丢包现场分析如下：

Bole-IGW

• T9K01-NPB02 于3月19日13:09前后疑似出现{}链路故障{}（NZ同时段出现链路告警），流量恢复过程造成{}marsio和Firewall同时丢包{}
• 链路故障的时段，{}T9K02-NPB02{}新建{}会话数出现突增{}，CPU和内存使用明显上升，造成{}Firewall丢包{}
•  T9K02-NPB02 于当天的9:30-16:00出现5-6次丢包，数量级在100-12k pps之间，对应时段monitor策略命中，以及Traffic Mirror数量也存在上涨趋势，推测丢包原因与策略命中+Mirror有关

!image-2024-03-25-09-26-06-465.png|width=729,height=437!

!image-2024-03-25-09-26-50-092.png|width=758,height=437!

!image-2024-03-25-09-36-56-198.png|width=757,height=395!

 

---

yangwei commented on 2024-03-25T09:55:35.386+0800:

LGH-PE

• T9K01-NPB01 丢包时段（3月19日8:00-10:00，丢包数量55Kpps+）同时触发DDoS Bypass（self protection），部分包处理线程CPU使用率超过90%
• 丢包对应时段新建会话，和TCP重复包数量也存在突增，推测丢包原因与突发流量相关

!image-2024-03-25-09-45-54-818.png|width=711,height=430!

!image-2024-03-25-09-44-00-629.png|width=307,height=330!!image-2024-03-25-09-47-45-643.png|width=310,height=331!

 

• T9K01-NPB02 丢包时段（3月19日9:30-15:30，丢包数量级100-6kpps）同样触发self protection
• 丢包时段TCP重复包数量和Traffic Mirror的数量也在同步增长，推测丢包原因与重复流突增+Mirror命中相关{}{}

!image-2024-03-25-09-49-55-416.png|width=1057,height=643!

!image-2024-03-25-09-52-25-118.png|width=270,height=286!!image-2024-03-25-09-53-42-725.png|width=262,height=273!

---

liuyang commented on 2024-08-31T18:32:04.453+0800:

系统已升级至TSG24.02，暂时关闭该bug。系统升级后如再出现该问题，重新创建bug

---

Attachments

Attachment: alert-message-2024-03-20+09-18-57.xlsx

alert-message-2024-03-20+09-18-57.xlsx

Attachment: BOL-IGW-T9K001-NPB02+(2).html

BOL-IGW-T9K001-NPB02+(2).html

Attachment: BOL-IGW-T9K002-NPB02+(1)(1).html

BOL-IGW-T9K002-NPB02+(1)(1).html

Attachment: image-2024-03-25-09-26-06-465.png

Attachment: image-2024-03-25-09-26-50-092.png

Attachment: image-2024-03-25-09-36-37-406.png

Attachment: image-2024-03-25-09-36-56-198.png

Attachment: image-2024-03-25-09-43-34-807.png

Attachment: image-2024-03-25-09-44-00-629.png

Attachment: image-2024-03-25-09-45-54-818.png

Attachment: image-2024-03-25-09-47-45-643.png

Attachment: image-2024-03-25-09-49-55-416.png

Attachment: image-2024-03-25-09-52-25-118.png

Attachment: image-2024-03-25-09-53-42-725.png

Attachment: LGH-PE-T9K001-NPB01+(1)(1).html

LGH-PE-T9K001-NPB01+(1)(1).html

Attachment: LGH-PE-T9K001-NPB02(1).html

LGH-PE-T9K001-NPB02(1).html