[2025-12-10 19:41:42.400] [INFO] [tid:129356958841088] (main_gbm.cpp:146) 读取本地配置。 [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:163) kafka brokers: 111.32.12.11:9092 [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:164) kafka topic_cnn: analyzed_queue_cnn [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:165) kafka topic_gbm: analyzed_queue_gbm [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:166) kafka group_cnn: cnnGroup [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:167) kafka group_gbm: gbmGroup [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:168) kafka produce_topic_cnn: alarmed_queue_cnn [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:169) kafka produce_topic_gbm: alarmed_queue_gbm [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:176) minio endpoint: http://111.32.12.11:9000 [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:177) minio access_key: UDM59PO2GGFR6AM8LSXP [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:178) minio secret_key: YShs5u5aj5Znc7kZkfEkel1QagG9eKko+C0mRUHr [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:182) server url: http://0.0.0.0:18087 [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:184) manage url: http://127.0.0.1:8990/api/v1/model/getSyncModel [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:192) cnnupdate:model_key: cnn_webshell [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:193) cnnupdate:black_base_path: [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:194) cnnupdate:max_samples: 1000 [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:202) gbmupdate:model_name: lgb_webshell [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:203) gbmupdate:jsonl_content_string: [2025-12-10 19:41:42.400] [DEBUG] [tid:129356958841088] (main_gbm.cpp:204) gbmupdate:threshold: 1000 [2025-12-10 19:41:42.401] [INFO] [tid:129356958841088] (main_gbm.cpp:393) 到管理端获取配置。 [2025-12-10 19:41:42.425] [DEBUG] [tid:129356958841088] (main_gbm.cpp:396) 响应长度: 320 字节 [2025-12-10 19:41:42.425] [DEBUG] [tid:129356958841088] (main_gbm.cpp:397) 响应内容: {"max_samples":1000,"model_name":"lgb_webshell","model_key":"cnn_webshell","max_alert":1000,"model_path_cnn":"./","model_path_gbm":"./","jsonl_content_string":"","threshold":1000,"black_base_path":"","model_name_gbm":"webshell_lgbm_classifier.lgb.20250902_171938.joblib","model_name_cnn":"classification_cs_20250714.h5"} [2025-12-10 19:41:42.425] [DEBUG] [tid:129356958841088] (main_gbm.cpp:406) json解析成功 [2025-12-10 19:41:42.425] [DEBUG] [tid:129356958841088] (main_gbm.cpp:491) json解析结束 [2025-12-10 19:41:42.444] [INFO] [tid:129356958841088] (main_gbm.cpp:511) 启动http服务线程... [2025-12-10 19:41:42.444] [DEBUG] [tid:129356958841088] (main_gbm.cpp:515) 触发训练告警阀值[max_alert]:1000 [2025-12-10 19:41:42.444] [INFO] [tid:129356958841088] (main_gbm.cpp:518) 启动模型线程... 2025-12-10 20:21:46,262 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:21:46,262 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:21:46,262 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765360664.jsonl?X-Amz-Date=20251210T122144Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-SignedHeaders=host&X-Amz-Expires=604800&X-Amz-Signature=d5ef1f8713d62da2454c5009c44908d78859e49f26f4b4ec662f64ec1b08fc67&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request --- 2025-12-10 20:21:46,268 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:21:52,568 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:21:52,568 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:21:52,568 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765347149.jsonl?X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122152Z&X-Amz-Signature=28ac2842656c9315397506c9a8ff34a619bcc712a7d406333774507a3c2f7cdf&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Expires=604800&X-Amz-SignedHeaders=host --- 2025-12-10 20:21:52,574 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:21:58,243 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:21:58,243 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:21:58,243 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765357961.jsonl?X-Amz-Expires=604800&X-Amz-SignedHeaders=host&X-Amz-Signature=11a8b6d9d0b6257e42b82bd749947cf1ea2b60e70eea0190e408dc47646630b4&X-Amz-Date=20251210T122158Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request --- 2025-12-10 20:21:58,247 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:01,743 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:01,743 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:01,744 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765348050.jsonl?X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20251210T122201Z&X-Amz-Expires=604800&X-Amz-Signature=e932c5ca216ad105d79bbcd801f13a188bb0747d17a4908f63fe9a78d78eed47&X-Amz-SignedHeaders=host --- 2025-12-10 20:22:01,746 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:03,120 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:03,120 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:03,120 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765346248.jsonl?X-Amz-SignedHeaders=host&X-Amz-Signature=85e23a16732186c1cfa2d68cbe177ce26a8aeb1937785c4574a191dd31728e5f&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20251210T122203Z&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Expires=604800 --- 2025-12-10 20:22:03,123 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:04,429 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:04,430 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:04,430 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765351654.jsonl?X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=0b48255402cfac387f97c6e9cfa8fbaf6f1a662d908e3e690f5d1d44826a4766&X-Amz-Expires=604800&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-SignedHeaders=host&X-Amz-Date=20251210T122204Z --- 2025-12-10 20:22:04,432 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:05,839 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:05,839 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:05,839 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765350753.jsonl?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20251210T122205Z&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=e7b88d854d15ba2853eac86de49a32d9f5f3014fc4dec7606ecb5200a0ed0fe2&X-Amz-Expires=604800 --- 2025-12-10 20:22:05,843 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:06,827 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:06,827 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:06,827 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765348951.jsonl?X-Amz-SignedHeaders=host&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122206Z&X-Amz-Expires=604800&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Signature=ba00e17b23c691e8f1502b6666ab9c8889ac50bd758a2f9c4de9a472a774287a --- 2025-12-10 20:22:06,830 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:07,704 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:07,704 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:07,704 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765352555.jsonl?X-Amz-SignedHeaders=host&X-Amz-Signature=7041e3b1401466dc13b9374e9e032167a4ad7dcc300878f1f212a0c8d4ce2e81&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122207Z&X-Amz-Expires=604800 --- 2025-12-10 20:22:07,707 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:08,555 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:08,555 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:08,555 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765349852.jsonl?X-Amz-Signature=6c608e8bf722b3dfe770fedc10e7f09f928fe1bcb18311a05f1a6fe402c88917&X-Amz-Date=20251210T122208Z&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Expires=604800&X-Amz-SignedHeaders=host --- 2025-12-10 20:22:08,559 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:09,414 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:09,415 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:09,415 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765353456.jsonl?X-Amz-Date=20251210T122209Z&X-Amz-Expires=604800&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Signature=c8cbd9d7bdc8cd7d5b146c50c7ff97418cd6fd44f68183311c54092b0356438d&X-Amz-SignedHeaders=host --- 2025-12-10 20:22:09,418 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:10,289 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:10,289 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:10,289 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765359763.jsonl?X-Amz-Signature=fcc01cba7dba5da3952d4c559f6d64acf06744c3b65169208efada0c4323da42&X-Amz-Date=20251210T122210Z&X-Amz-Expires=604800&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-SignedHeaders=host --- 2025-12-10 20:22:10,292 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:11,132 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:11,132 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:11,132 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765358862.jsonl?X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122211Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Signature=7ad52f9eb555a47e4253a060f8ffd43b9ff674b52ecbfc16d1511e2290fa911f&X-Amz-Expires=604800&X-Amz-SignedHeaders=host --- 2025-12-10 20:22:11,135 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:12,353 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:12,353 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:12,354 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765356159.jsonl?X-Amz-Signature=cfa36c9bd6f17bbc6faab59198c650dac3fc34dc0a4bb786f91f1ea16b077812&X-Amz-Date=20251210T122212Z&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Expires=604800&X-Amz-SignedHeaders=host&X-Amz-Algorithm=AWS4-HMAC-SHA256 --- 2025-12-10 20:22:12,357 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:14,016 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:14,016 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:14,016 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765355258.jsonl?X-Amz-SignedHeaders=host&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122213Z&X-Amz-Expires=604800&X-Amz-Signature=534a92ccffcf1ca7b28e1d14b9214851f09c9071c590f9b1e937069d5cb97d57 --- 2025-12-10 20:22:14,025 - WARNING - 警告：输入数据为空，无法进行预测。 2025-12-10 20:22:14,917 - INFO - 配置已保存到 lgbm_config.json 2025-12-10 20:22:14,917 - INFO - 配置已更新: MODEL_NAME=webshell_lgbm_classifier.lgb.20250902_171938.joblib, MODEL_PATH=/home/baseapp/fujian/predict/ 2025-12-10 20:22:14,917 - INFO - --- 正在加载并预处理输入源: http://111.32.12.11:9000/2025-12-10/20/output/gbm/alert.pcap.9.1765354357.jsonl?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-SignedHeaders=host&X-Amz-Signature=b7e04ed847329c9105b8066bab3e303f2573cbc174a17e856af29ff07e2adb3a&X-Amz-Credential=UDM59PO2GGFR6AM8LSXP%2F20251210%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251210T122214Z&X-Amz-Expires=604800 --- 2025-12-10 20:22:14,920 - WARNING - 警告：输入数据为空，无法进行预测。