0.1.0
What's Changed
- Add basic HuggingFace Data Source Implementation by @allisonwang-db in #1
- initial pyproject.toml by @lhoestq in #2
- Add more features to huggingface reader by @allisonwang-db in #3
- Enable predicate pushdown by @lhoestq in #4
- Add HuggingFaceSink data source by @wengh in #5
- Support custom split name by renaming files by @wengh in #6
- Use same data source name for reader and writer by @wengh in #7
New Contributors
- @allisonwang-db made their first contribution in #1
- @lhoestq made their first contribution in #2
Full Changelog: https://github.com/huggingface/pyspark_huggingface/commits/0.1.0