Skip to content

[draft] add converters from spark to hoodieSchema for vectors#16

Draft
rahil-c wants to merge 6 commits intorahil/vector-schemafrom
rahil/vector-schema-spark-converter
Draft

[draft] add converters from spark to hoodieSchema for vectors#16
rahil-c wants to merge 6 commits intorahil/vector-schemafrom
rahil/vector-schema-spark-converter

Conversation

@rahil-c
Copy link
Owner

@rahil-c rahil-c commented Feb 10, 2026

Describe the issue this Pull Request addresses

Summary and Changelog

Impact

Risk Level

Documentation Update

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@rahil-c
Copy link
Owner Author

rahil-c commented Feb 10, 2026

  • try to end to end write flow from spark to hoodie schema to parquet files (to avoid many smaller prs)
  • need to implement for every engine (flink, java, trino?)

@rahil-c rahil-c force-pushed the rahil/vector-schema-spark-converter branch from e25cfd6 to c89d0ea Compare February 11, 2026 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant