Skip to content

上传文件保存失败:无法将资源注册到数据集中.... #273

Description

@zx007nice

bug描述

  • 管理平台保存文件出错

image

复现步骤

1.启动primihub项目,主要用到node0节点
2.启动primihub-platform项目,启动primihub-meta成功
3.登入系统,添加节点,添加网关地址
image
4.资源管理-我的资源-添加资源-上传文件成功-保存失败
image
错误:
添加失败:无法将资源注册到数据集中:file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist

bug日志

node0节点:

I20241230 13:38:31.455092  3195 ds.cc:235] start to create dataset.meta info: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv fid: 11c937ad8595-e02d005d-72f9-4bb2-9548-0431d98a2b03 driver_type: csv
E20241230 13:38:31.455243  3195 csv_driver.cc:323] file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist
E20241230 13:38:31.455291  3195 ds.cc:257] Failed to load dataset from: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv driver_type: csv fid: 11c937ad8595-e02d005d-72f9-4bb2-9548-0431d98a2b03 exception: file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist


platform日志:

13:42:31.921 [INFO ] [http-nio-8090-exec-2] [com.primihub.biz.util.FileUtil:185] [id, name, age]
13:42:31.921 [INFO ] [http-nio-8090-exec-2] [com.primihub.biz.util.FileUtil:188] [1, zx, 18]
13:42:34.951 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:32] run dataServiceGrpc param:TaskParam{requestId='7a47904c2eb945e3bf408270b0c3cb0b', taskId='null', jobId='null', isSuccess=true, isEnd=false, error='null', partyCount=null, isOpenGetStatus=true, taskContentParam=DataSetTaskParam{id='11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183', accessInfo='/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv', driver='csv', visibility='null', fieldTypes=[com.primihub.sdk.task.param.TaskDataSetParam$FieldType@697cedcd, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@68165de5, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@1b0c72b5]}} - time:1735537354951
13:42:34.951 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:42] NewDatasetRequest:meta_info {
  id: "11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183"
  driver: "csv"
  access_info: "/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv"
  data_type {
    name: "id"
    type: INT32
  }
  data_type {
    name: "name"
    type: STRING
  }
  data_type {
    name: "age"
    type: INT32
  }
}

13:42:34.957 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:45] dataServiceGrpc Response:ret_code: FAIL
ret_msg: "file_path: /usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv is not exist"

13:42:34.957 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:60] end dataServiceGrpc fparam:TaskParam{requestId='7a47904c2eb945e3bf408270b0c3cb0b', taskId='null', jobId='null', isSuccess=false, isEnd=true, error='file_path: /usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv is not exist', partyCount=null, isOpenGetStatus=true, taskContentParam=DataSetTaskParam{id='11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183', accessInfo='/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv', driver='csv', visibility='null', fieldTypes=[com.primihub.sdk.task.param.TaskDataSetParam$FieldType@697cedcd, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@68165de5, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@1b0c72b5]}} - time:1735537354957


环境(请填写完整):

  • OS: Linux centos7
  • Arch: x86_64
  • 部署方式: 本机编译
  • PrimiHub版本: 1.7.0
  • Python版本: Python 2.7.5

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions