Skip to content

Incorrect path in metadata of a local Iceberg table #84

@zvonand

Description

@zvonand

Repro

Follow the steps in the readme: https://github.com/Altinity/ice/blob/master/examples/localfileio/README.md

Problem

ice writes an incorrect path to manifest-list to metadata.json. Here is what is inside it:

.....
  "snapshots" : [ {
.......
    "manifest-list" : "file://warehouse/flowers/iris/metadata/snap-9165133074007388014-1-33c60bf9-ba48-4ac1-9742-cb6d08b57412.avro",
.....

However, this path is malformed. If prefixed by scheme description (file://), it must be an absolute path (file:///...). Same incorrectness can be found in manifest list and manifest file.

Now upstream ClickHouse reads such tables properly, but this is the case where negative * negative = positive (CH also parses path incorrectly).

Solution proposed

Absolute path shall be written there (file:///absolute/path/to/location).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions