8000 ODPS批量导入数据不成功导入问题 · Issue #564 · OpenSPG/openspg · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
ODPS批量导入数据不成功导入问题 #564
Open
@pchengyuan

Description

@pchengyuan

docker 镜像image :e1782d2e102f
全局配置中已经成功添加odps数据源
操作过程(产品):知识构建->创建任务->批量数据 ODPS 结构化内容,输入所在项目名称、表名、分区 后"选择导入字段"能正确读取到表字段名称及字段类型->选择字段->下一步->选择"导入目标" (实体类型关键词)->连接批量数据源和关键词的字段->下一步 单次任务 插入->完成

现象:
Preprocess阶段正常

Preprocess

2025-06-05 10:26:01(172.19.0.5): Task scheduling completed. cost:199 ms !
2025-06-05 10:26:01(172.19.0.5): Lock released successfully!
2025-06-05 10:26:01(172.19.0.5): Table partitions(ads_rpt_dev.t118_sl_liantong_test_a_d:data_date='20250512') have been generated, with a total of 1 records
2025-06-05 10:26:01(172.19.0.5): Table partition(ads_rpt_dev.t118_sl_liantong_test_a_d:data_date='20250512') exists
2025-06-05 10:26:00(172.19.0.5): Check the partition exists. Table:ads_rpt_dev.t118_sl_liantong_test_a_d, partition:data_date='20250512'.
2025-06-05 10:26:00(172.19.0.5): Check the partition is generated
2025-06-05 10:26:00(172.19.0.5): Lock preempted successfully!

Scanner阶段长时间不完成
一直重复刷新如下内容

2025-06-05 10:28:30(172.19.0.5): Task scheduling completed. cost:0 ms !
2025-06-05 10:28:30(172.19.0.5): Last lock preempt time:2025-06-05 10:26:11,The threshold was not exceeded. Wait for the execution to complete

2025-06-05 10:27:30(172.19.0.5): Task scheduling completed. cost:0 ms !
2025-06-05 10:27:30(172.19.0.5): Last lock preempt time:2025-06-05 10:26:11,The threshold was not exceeded. Wait for the execution to complete

2025-06-05 10:26:30(172.19.0.5): Task scheduling completed. cost:0 ms !
2025-06-05 10:26:30(172.19.0.5): Last lock preempt time:2025-06-05 10:26:11,The threshold was not exceeded. Wait for the execution to complete

10分钟后docker 中/logs/openspgapp/common-error.log中有timeout的信息

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0