68 lines
1.4 KiB
Markdown
68 lines
1.4 KiB
Markdown
|
# 【E21-NZ】Cortex Push error: per-user series limit 排查
|
|||
|
|
|
|||
|
|
| ID | Creation Date | Assignee | Status |
|
|||
|
|
|----|----------------|----------|--------|
|
|||
|
|
| OMPUB-524 | 2022-06-14T14:40:23.000+0800 | 刘菊 | 完成 |
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
近期在NZ其它环境发现 NZ使用的开源组件 出现 Push error，导致部分metric数据未正确存储，从而无法查询的问题。
|
|||
|
|
|
|||
|
|
请刘菊检查E现场是否存在相同问题。
|
|||
|
|
|
|||
|
|
排查方法：
|
|||
|
|
* 登录国家中心 nz-agent 服务器
|
|||
|
|
* 执行：journalctl -u cortex.service | grep "per-user series limit"
|
|||
|
|
* 当上一步返回结果，则需要进一步处理
|
|||
|
|
|
|||
|
|
处理方法：
|
|||
|
|
* 修改 /opt/nezha/nz-agent/cortex/config.conf , 追加启动项参数 -ingester.max-series-per-user=0**liuju** commented on *2022-06-14T14:53:03.793+0800*:
|
|||
|
|
|
|||
|
|
收到
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**liuju** commented on *2022-06-14T15:01:40.306+0800*:
|
|||
|
|
|
|||
|
|
!微信图片_20220614095958.png!!微信图片_20220614100002.png!
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**liuju** commented on *2022-06-14T15:02:37.890+0800*:
|
|||
|
|
|
|||
|
|
现场
|
|||
|
|
* 登录国家中心 nz-agent 服务器
|
|||
|
|
* 执行：journalctl -u cortex.service | grep "per-user series limit"
|
|||
|
|
|
|||
|
|
该命令执行后无输出打印内容。
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## Attachments
|
|||
|
|
|
|||
|
|
**28761/微信图片_20220614095958.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**28763/微信图片_20220614095958-1.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**28762/微信图片_20220614100002.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
**28764/微信图片_20220614100002-1.png**
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|