Skip to content

"修复table_column_filter解析llm失败问题"#403

Open
johndxh wants to merge 1 commit intojd-opensource:data_agentfrom
johndxh:data_agent
Open

"修复table_column_filter解析llm失败问题"#403
johndxh wants to merge 1 commit intojd-opensource:data_agentfrom
johndxh:data_agent

Conversation

@johndxh
Copy link

@johndxh johndxh commented Dec 26, 2025

No description provided.

@johndxh
Copy link
Author

johndxh commented Dec 26, 2025

2025-12-26 03:17:43.244 INFO log_util.__aenter__ e93e2d2e-03ef-4254-b60c-a25bca3c965c enter ask_llm start...
2025-12-26 03:17:44.083 INFO log_util.__aenter__ e93e2d2e-03ef-4254-b60c-a25bca3c965c exec ask_llm start...
2025-12-26 03:17:44.083 INFO log_util.__aexit__ e93e2d2e-03ef-4254-b60c-a25bca3c965c exec ask_llm cost=[0 ms]
2025-12-26 03:17:44.083 INFO log_util.__aexit__ e93e2d2e-03ef-4254-b60c-a25bca3c965c enter ask_llm cost=[839 ms]
2025-12-26 03:17:44.083 ERROR table_column_filter._parse_json_result 生成结果格式不合法:{
    "relatedFlag": True,
    "columnIndexes": [1, 6, 7]
}{
    "relatedFlag": true,
    "columnIndexes": [1, 6, 7]
},list index out of range
2025-12-26 03:17:44.083 ERROR table_column_filter._filter_single_table [filter column] 48400ac1-b24c-4346-b354-6a16df99aebd, fail to filter columns error_msg 第2次执行结果:
{
    "relatedFlag": true,
    "columnIndexes": [1, 6, 7]
}{
    "relatedFlag": true,
    "columnIndexes": [1, 6, 7]
},报错信息:解析llm json结果失败

2025-12-26 03:17:43.237 INFO log_util.__aenter__ e93e2d2e-03ef-4254-b60c-a25bca3c965c enter ask_llm start...
2025-12-26 03:17:43.239 INFO log_util.__aenter__ e93e2d2e-03ef-4254-b60c-a25bca3c965c exec ask_llm start...
2025-12-26 03:17:43.240 INFO log_util.__aexit__ e93e2d2e-03ef-4254-b60c-a25bca3c965c exec ask_llm cost=[1 ms]
2025-12-26 03:17:43.240 INFO log_util.__aexit__ e93e2d2e-03ef-4254-b60c-a25bca3c965c enter ask_llm cost=[1360 ms]
2025-12-26 03:17:43.240 ERROR table_column_filter._parse_json_result 生成结果格式不合法:{
    "relatedFlag": true,
    "columnIndexes": [1, 6, 7]
},list index out of range
2025-12-26 03:17:43.241 ERROR table_column_filter._filter_single_table [filter column] 48400ac1-b24c-4346-b354-6a16df99aebd, fail to filter columns error_msg 第1次执行结果:
{
    "relatedFlag": true,
    "columnIndexes": [1, 6, 7]
},报错信息:解析llm json结果失败

调用deepseek等模型会因为重复输出、符号错误等因素,导致项目原来正则匹配的修正方式产生解析错误,改用json_repair库解析llm_response会使项目更稳健

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant