Skip to content

0.1.0

Choose a tag to compare

@lhoestq lhoestq released this 14 Mar 18:01

What's Changed

  • Add basic HuggingFace Data Source Implementation by @allisonwang-db in #1
  • initial pyproject.toml by @lhoestq in #2
  • Add more features to huggingface reader by @allisonwang-db in #3
  • Enable predicate pushdown by @lhoestq in #4
  • Add HuggingFaceSink data source by @wengh in #5
  • Support custom split name by renaming files by @wengh in #6
  • Use same data source name for reader and writer by @wengh in #7

New Contributors

Full Changelog: https://github.com/huggingface/pyspark_huggingface/commits/0.1.0