Skip to content

Conversation

@dongxiao1198
Copy link
Contributor

1 parse v1v2v3 manifest schema in adapter
2 convert ManifestFile&ManifestEntry into ArrowArray
3 add e2e case

@dongxiao1198 dongxiao1198 marked this pull request as ready for review September 9, 2025 04:47
@dongxiao1198 dongxiao1198 force-pushed the manifest_adapter_impl branch from bafed12 to 977466d Compare October 9, 2025 08:23
@dongxiao1198 dongxiao1198 requested a review from wgtmac October 9, 2025 08:49
const std::shared_ptr<Schema>& schema() const { return manifest_schema_; }

protected:
virtual Result<std::shared_ptr<StructType>> GetManifestEntryStructType();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think StructType is redundant.

std::vector<PartitionField> fields_;
int32_t last_assigned_field_id_;
std::mutex mutex_;
std::shared_ptr<Schema> partition_schema_;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as above.

@dongxiao1198 dongxiao1198 force-pushed the manifest_adapter_impl branch from 96be403 to ec65a69 Compare October 11, 2025 06:10
@wgtmac wgtmac force-pushed the manifest_adapter_impl branch from 95f0342 to 6b31e28 Compare October 16, 2025 15:00
@wgtmac wgtmac changed the title feat: manifest writer and adapter impl part2 feat: implement manifest and manifest list writer adapter (cont'd) Oct 16, 2025
@wgtmac
Copy link
Member

wgtmac commented Oct 16, 2025

Thanks @dongxiao1198 for working on this! I've resolved conflicts with some minor refactoring.

@wgtmac wgtmac merged commit 8906ff3 into apache:main Oct 17, 2025
10 checks passed
@dongxiao1198 dongxiao1198 deleted the manifest_adapter_impl branch October 17, 2025 01:48
gty404 pushed a commit to gty404/iceberg-cpp that referenced this pull request Oct 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants