add API 21.09 new

This commit is contained in:
doufenghu
2021-09-22 18:23:18 +08:00
parent f2ff586831
commit 22cfbf40c9

View File

@@ -2,7 +2,7 @@
"info": {
"_postman_id": "8304ab2f-208f-4d4f-80b3-237645047bea",
"name": "Galaxy Trouble Shooting API V21.09",
"description": "# galaxy-troubleshooting-api\n\n## Release 21.09 (17 SEP 2021)\n###### New Features\n* \n###### Update \n* 删除分布式调度任务5分钟TOPN校验交由FLink统计\n* 原始日志表名进行重命名,相关查询接口更新\n* 修正DNS分析的SQL数据集\n\n## Release 21.08 (15 AUG 2021)\n###### New Features\n* 新增“Dashboard查询-DoS Threat Map”功能列表显示DoS检测地图接口\n* 新增“原始日志查询-DoS事件日志”显示DoS攻击检测日志\n* 新增“原始日志查询-DoS事件日志-Summary”显示DoS攻击趋势统计\n* 新增“原始日志查询-DoS事件日志-Destination IP Traffic Trend”显示受害者IP历史流量趋势\n* 新增“基数统计-实体“流量分析\n###### Update \n* 迁移“Dashboard查询”liveCharts接口放到“Live Charts”目录中统一管理。\n* 对DNS分析增加一些查询样例\n\n## Release 21.07 (5 JUL 2021)\n\n###### New Features\n\n* 增加”常用快捷功能-基数统计“,用于分析日志分布情况\n* 增加”常用快捷功能-DNS放大攻击“查询特征数据集\n* 增加”通用检查-对象存储-获取某个文件“,用于文件获取验证\n\n\n###### Update \n* 为所有接口增加Tests脚本对接口进行批量验证测试\n* 修正部分接口查询异常\n\n\n## Release 21.06 (7 JUN 2021)\n\n###### New Features\n* Environments 增加环境变量domain、client_ip、server_ip、l7_protocol和PT1M_TIME\n* 常用快捷功能增加某域名下钻、某IP下钻、协议下钻和DNS分析功能\n\n###### Update \n* 原始日志查询基于Druid近1小时日志变化粒度从5分钟改为1分钟。包含通联、策略和代理日志。\n\n\n## Release 21.05 (6 MAY 2021)\n\n###### New Features\n* 新增“GTP-C日志”功能辅助故障诊断\n* 新增“事务日志”功能,辅助故障诊断\n* 新增“活跃会话日志”功能,辅助故障诊断\n* 新增“07.常用快捷功能-评估写入日志量”,查看当前系统的吞吐\n\n\n###### Update \n* 修改\"01.通用检查-数据存储检查\"增加事务、活跃及GTP-C 检测\n\n\n## Release 21.04 (3 APR 2021)\n\n###### New Features\n* 增加“VoIP日志”功能辅助故障诊断\n* 增加“元数据检查”分类目录\n* 增加“HOS对象存储”目录用于定位对象存储\n\n\n###### Update \n\n* 修改“SQL语法检查”为“SQL语法验证”支持SQL语句的静态分析和数据库语义验证\n* 迁移功能项位置,方便问题定位\n\n###### Delete\n* 删除“系统检查-查询引擎SQL测试集[过时]”功能,由“故障诊断-sql性能测试”替代。\n\n\n## Release 21.03 (2 MAR 2021)\n\n###### New Features\n\n* 增加故障诊断-元数据功能可分析日志字段是否与schema一致\n* 增加故障诊断-sql性能测试可对查询引擎进行功能性验证和POC性能测试 \n\n###### Update \n\n* 对查询引擎SQL测试集标记过时\n\n\n## Release 21.02 (1 FEB 2021)\n\n\n###### Update \n\n* 改善内部测试集,应对新的功能修改\n\n\n\n\n\n\n## Release 20.11.rc3 (11 DEC 2020)\n\n###### New Features\n\n* 增加常用快捷功能- 安装证书独立客户端IP数据趋势\n* 增加常用快捷功能-访问速度最慢TOP20 域名\n* 增加常用快捷功能-报告预置Metrics\n* 增加原始日志查询-安全策略-动作命中计数\n* 增加原始日志查询-代理策略-动作命中计数\n* 增加原始日志查询-通联-流量计数(now)\n\n###### Update \n\n* 改善Dashboard查询-基础统计-新建、活跃(计数)-now\n* 改善Dashboard查询-新建、活跃(趋势)\n* 目录增加编号,便于管理\n* 修改分布式调度任务-5分钟TOPN-hot表验证表名\n* 部分Action为post 改为 get便于导出命令行\n\n\n[帮助文档]: https://docs.geedge.net/pages/viewpage.action?pageId=19896569",
"description": "# galaxy-troubleshooting-api\n\n## Release 21.09 (23 SEP 2021)\n###### New Features\n* 新增DNS风大攻击Resolver接口\n###### Update \n* 删除分布式调度任务5分钟TOPN校验交由FLink统计\n* 原始日志表名进行重命名,相关查询接口更新\n* 修正DNS分析的SQL数据集\n\n## Release 21.08 (15 AUG 2021)\n###### New Features\n* 新增“Dashboard查询-DoS Threat Map”功能列表显示DoS检测地图接口\n* 新增“原始日志查询-DoS事件日志”显示DoS攻击检测日志\n* 新增“原始日志查询-DoS事件日志-Summary”显示DoS攻击趋势统计\n* 新增“原始日志查询-DoS事件日志-Destination IP Traffic Trend”显示受害者IP历史流量趋势\n* 新增“基数统计-实体“流量分析\n###### Update \n* 迁移“Dashboard查询”liveCharts接口放到“Live Charts”目录中统一管理。\n* 对DNS分析增加一些查询样例\n\n## Release 21.07 (5 JUL 2021)\n\n###### New Features\n\n* 增加”常用快捷功能-基数统计“,用于分析日志分布情况\n* 增加”常用快捷功能-DNS放大攻击“查询特征数据集\n* 增加”通用检查-对象存储-获取某个文件“,用于文件获取验证\n\n\n###### Update \n* 为所有接口增加Tests脚本对接口进行批量验证测试\n* 修正部分接口查询异常\n\n\n## Release 21.06 (7 JUN 2021)\n\n###### New Features\n* Environments 增加环境变量domain、client_ip、server_ip、l7_protocol和PT1M_TIME\n* 常用快捷功能增加某域名下钻、某IP下钻、协议下钻和DNS分析功能\n\n###### Update \n* 原始日志查询基于Druid近1小时日志变化粒度从5分钟改为1分钟。包含通联、策略和代理日志。\n\n\n## Release 21.05 (6 MAY 2021)\n\n###### New Features\n* 新增“GTP-C日志”功能辅助故障诊断\n* 新增“事务日志”功能,辅助故障诊断\n* 新增“活跃会话日志”功能,辅助故障诊断\n* 新增“07.常用快捷功能-评估写入日志量”,查看当前系统的吞吐\n\n\n###### Update \n* 修改\"01.通用检查-数据存储检查\"增加事务、活跃及GTP-C 检测\n\n\n## Release 21.04 (3 APR 2021)\n\n###### New Features\n* 增加“VoIP日志”功能辅助故障诊断\n* 增加“元数据检查”分类目录\n* 增加“HOS对象存储”目录用于定位对象存储\n\n\n###### Update \n\n* 修改“SQL语法检查”为“SQL语法验证”支持SQL语句的静态分析和数据库语义验证\n* 迁移功能项位置,方便问题定位\n\n###### Delete\n* 删除“系统检查-查询引擎SQL测试集[过时]”功能,由“故障诊断-sql性能测试”替代。\n\n\n## Release 21.03 (2 MAR 2021)\n\n###### New Features\n\n* 增加故障诊断-元数据功能可分析日志字段是否与schema一致\n* 增加故障诊断-sql性能测试可对查询引擎进行功能性验证和POC性能测试 \n\n###### Update \n\n* 对查询引擎SQL测试集标记过时\n\n\n## Release 21.02 (1 FEB 2021)\n\n\n###### Update \n\n* 改善内部测试集,应对新的功能修改\n\n\n\n\n\n\n## Release 20.11.rc3 (11 DEC 2020)\n\n###### New Features\n\n* 增加常用快捷功能- 安装证书独立客户端IP数据趋势\n* 增加常用快捷功能-访问速度最慢TOP20 域名\n* 增加常用快捷功能-报告预置Metrics\n* 增加原始日志查询-安全策略-动作命中计数\n* 增加原始日志查询-代理策略-动作命中计数\n* 增加原始日志查询-通联-流量计数(now)\n\n###### Update \n\n* 改善Dashboard查询-基础统计-新建、活跃(计数)-now\n* 改善Dashboard查询-新建、活跃(趋势)\n* 目录增加编号,便于管理\n* 修改分布式调度任务-5分钟TOPN-hot表验证表名\n* 部分Action为post 改为 get便于导出命令行\n\n\n[帮助文档]: https://docs.geedge.net/pages/viewpage.action?pageId=19896569",
"schema": "https://schema.getpostman.com/json/collection/v2.1.0/collection.json"
},
"item": [
@@ -3524,7 +3524,7 @@
"response": []
},
{
"name": "检查Druid数据库服务是否正常",
"name": "检查Apache Druid状态",
"event": [
{
"listen": "test",
@@ -3568,7 +3568,7 @@
"response": []
},
{
"name": "检查ClickHouse数据库服务是否正常",
"name": "检查ClickHouse状态",
"event": [
{
"listen": "test",
@@ -3618,7 +3618,7 @@
"response": []
},
{
"name": "检查Arango数据库服务是否正常",
"name": "检查Arango状态",
"event": [
{
"listen": "test",
@@ -3662,34 +3662,44 @@
"response": []
},
{
"name": "通联索引表正确性验证",
"name": "查询clickhouse集群列表",
"event": [
{
"listen": "test",
"script": {
"exec": [
"pm.test(\"Status code is 200\", function () {",
" pm.response.to.have.status(200);",
"});"
"tests[\"Successful POST request\"] = responseCode.code === 200 || responseCode.code === 201;"
],
"type": "text/javascript"
}
}
],
"request": {
"method": "GET",
"method": "POST",
"header": [],
"url": {
"raw": "http://{{qgw_ip}}:{{qgw_port}}?query= select 'Total' as type, count(*) as logs from session_record where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all \nselect 'Client IP' as type, count(*) as logs from session_record_common_client_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Server IP' as type, count(*) as logs from session_record_common_server_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Domain' as type, count(*) as logs from session_record_http_domain where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\n",
"raw": "http://{{clickhouse_ip}}:{{clickhouse_port}}?database={{clickhouse_database}}&user={{clickhouse_user}}&password={{clickhouse_password}}&query=SELECT DISTINCT concat(host_address,':','8123') as endpoint FROM system.clusters FORMAT JSON;",
"protocol": "http",
"host": [
"{{qgw_ip}}"
"{{clickhouse_ip}}"
],
"port": "{{qgw_port}}",
"port": "{{clickhouse_port}}",
"query": [
{
"key": "database",
"value": "{{clickhouse_database}}"
},
{
"key": "user",
"value": "{{clickhouse_user}}"
},
{
"key": "password",
"value": "{{clickhouse_password}}"
},
{
"key": "query",
"value": " select 'Total' as type, count(*) as logs from session_record where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all \nselect 'Client IP' as type, count(*) as logs from session_record_common_client_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Server IP' as type, count(*) as logs from session_record_common_server_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Domain' as type, count(*) as logs from session_record_http_domain where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\n"
"value": "SELECT DISTINCT concat(host_address,':','8123') as endpoint FROM system.clusters FORMAT JSON;"
}
]
}
@@ -7064,51 +7074,6 @@
"response": []
}
]
},
{
"name": "查询clickhouse服务endpoint",
"event": [
{
"listen": "test",
"script": {
"exec": [
"tests[\"Successful POST request\"] = responseCode.code === 200 || responseCode.code === 201;"
],
"type": "text/javascript"
}
}
],
"request": {
"method": "POST",
"header": [],
"url": {
"raw": "http://{{clickhouse_ip}}:{{clickhouse_port}}?database={{clickhouse_database}}&user={{clickhouse_user}}&password={{clickhouse_password}}&query=SELECT DISTINCT concat(host_address,':','8123') as endpoint FROM system.clusters FORMAT JSON;",
"protocol": "http",
"host": [
"{{clickhouse_ip}}"
],
"port": "{{clickhouse_port}}",
"query": [
{
"key": "database",
"value": "{{clickhouse_database}}"
},
{
"key": "user",
"value": "{{clickhouse_user}}"
},
{
"key": "password",
"value": "{{clickhouse_password}}"
},
{
"key": "query",
"value": "SELECT DISTINCT concat(host_address,':','8123') as endpoint FROM system.clusters FORMAT JSON;"
}
]
}
},
"response": []
}
]
},
@@ -11071,6 +11036,41 @@
}
},
"response": []
},
{
"name": "通联索引表正确性验证",
"event": [
{
"listen": "test",
"script": {
"exec": [
"pm.test(\"Status code is 200\", function () {",
" pm.response.to.have.status(200);",
"});"
],
"type": "text/javascript"
}
}
],
"request": {
"method": "GET",
"header": [],
"url": {
"raw": "http://{{qgw_ip}}:{{qgw_port}}?query= select 'Total' as type, count(*) as logs from session_record where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all \nselect 'Client IP' as type, count(*) as logs from session_record_common_client_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Server IP' as type, count(*) as logs from session_record_common_server_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Domain' as type, count(*) as logs from session_record_http_domain where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\n",
"protocol": "http",
"host": [
"{{qgw_ip}}"
],
"port": "{{qgw_port}}",
"query": [
{
"key": "query",
"value": " select 'Total' as type, count(*) as logs from session_record where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all \nselect 'Client IP' as type, count(*) as logs from session_record_common_client_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Server IP' as type, count(*) as logs from session_record_common_server_ip where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\nunion all\nselect 'Domain' as type, count(*) as logs from session_record_http_domain where\n\tcommon_recv_time >= UNIX_TIMESTAMP({{Last 24 Hour Start}})\n\tand common_recv_time < UNIX_TIMESTAMP({{now}})\n"
}
]
}
},
"response": []
}
]
}