80 lines
2.4 KiB
Markdown
80 lines
2.4 KiB
Markdown
# TSG OLAP End-to-End Test
|
||
|
||
## 概述
|
||
|
||
TSG OLAP 支持对Logs，Metrics和Files进行端到端业务自检,自检数据流： Smaple Datasets -> Kafka Topic -> FLINK ETL -> Storage DB -> QGW API .
|
||
|
||
## 环境依赖
|
||
|
||
- 样例数据生成工具：`e2e-mockdata-generator` ，需要JDK11环境
|
||
- Report诊断工具：`Newman`，具体参考[帮助文档](https://learning.postman.com/docs/collections/using-newman-cli/newman-options/)
|
||
|
||
## 使用方法
|
||
|
||
### 修改 enviroment.json 配置
|
||
|
||
`Newman CLI 使用QGW HTTP REST API 输出诊断报告,需要添加访问IP`
|
||
```json
|
||
[
|
||
{
|
||
"key": "qgw_ip",
|
||
"value": "127.0.0.1",
|
||
"type": "default",
|
||
"enabled": true
|
||
},
|
||
{
|
||
"key": "hos_token",
|
||
"value": "c21f969b5f03d33d43e04f8f136e7682",
|
||
"type": "secret",
|
||
"enabled": true
|
||
}
|
||
]
|
||
```
|
||
### 修改e2e_test.sh配置
|
||
|
||
- 增加每个分中心的kafka broker地址
|
||
|
||
```shell
|
||
# [data_center_name]:kafka_server_list
|
||
declare -A KAFKA_SERVERS=(
|
||
["tsg_olap_dc_a"]="192.168.44.11:9092"
|
||
["tsg_olap_dc_b"]="192.168.44.11:9092"
|
||
)
|
||
```
|
||
- 增加每个分中心的HOS访问地址
|
||
```shell
|
||
# [data_center_name]:hos_endpoint_uri
|
||
declare -A HOS_ENDPOINTS=(
|
||
["tsg_olap_dc_a"]="192.168.44.11"
|
||
["tsg_olap_dc_b"]="192.168.44.11"
|
||
)
|
||
```
|
||
|
||
### 命令详解
|
||
|
||
`./e2e_test.sh -h`
|
||
|
||
```shell
|
||
Usage: ./e2e_test.sh [options]
|
||
|
||
Options:
|
||
-g <type> Generate data (logs, metrics, files)
|
||
-d <type> Run diagnostic report (logs, metrics, files)
|
||
-c Clear test data
|
||
-a Perform all operations: generate data, run diagnostics, and clear data
|
||
-i <key=value,...> Set environment variable (data_center, hos_ip)
|
||
-v Enable verbose reporting
|
||
-e Enable emojitrain reporting
|
||
-h Show this help message
|
||
|
||
Examples:
|
||
./e2e_test.sh -a -e Perform all operations and enable emojitrain reporting
|
||
./e2e_test.sh -g logs -i data_center=my_data_center Generate log data at my_data_center
|
||
./e2e_test.sh -d logs -v Run diagnostics on logs data with verbose reporting
|
||
./e2e_test.sh -d metrics -v Run diagnostics on metrics data with verbose reporting
|
||
./e2e_test.sh -g logs Generate log data use default data center
|
||
./e2e_test.sh -c Clear test data
|
||
|
||
|
||
```
|