v1.0.0 (November 22, 2023)
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
New features
- S3IterableDataset and S3MapDataset, which allow building either an iterable-style or map-style dataset, using your S3
stored data, by specifying an S3 URI (a bucket and optional prefix) and the region the bucket is in.
- Support for multiprocess data loading for the above datasets.
- S3Checkpoint, an interface for saving and loading model checkpoints directly to and from an S3 bucket.
Breaking changes
PyPi Project
https://pypi.org/project/s3torchconnector/
