Releases: awslabs/s3-connector-for-pytorch
Releases · awslabs/s3-connector-for-pytorch
v1.2.4
New features
- Update crates and Mountpoint dependencies.
Breaking changes
- No breaking changes.
Full Changelog: v1.2.3...v1.2.4
PyPi Project
v1.2.3
v1.2.3
New features
- Update
S3ClientConfigto pass in the configuration for allowing unsigned requests, under boolean flagunsigned. - Improve the performance of
S3Readerwhen utilized withpytorch.loadby incorporating support for thereadintomethod. - [Experimental] Add support for passing an optional custom endpoint to
S3LightningCheckpointconstructor method.
Breaking changes
- No breaking changes.
Full Changelog: v1.2.2...v1.2.3
PyPi Project
v1.2.2
v1.2.2
New features
- Expose a new class, S3ClientConfig, with
throughput_target_gbpsandpart_sizeparameters of the inner S3 client.
Breaking changes
- No breaking changes.
Full Changelog: v1.2.1...v1.2.2
PyPi Project
v1.2.1
v1.2.1
Breaking changes
- Separate completely Rust logs and Python logs. Logs from Rust components used for debugging purposes
are configured through the following environment variables:S3_TORCH_CONNECTOR_DEBUG_LOGS,
S3_TORCH_CONNECTOR_LOGS_DIR_PATH
Full Changelog: v1.2.0...v1.2.1
PyPi Project
v1.2.0
v1.2.0 (March 13, 2024)
New features
- Add PyTorch Lightning checkpoints support
Bug Fixes / Improvements
- Fix deadlock when enabling CRT debug logs. Removed former experimental method _enable_debug_logging().
- Refactor User-Agent setup for extensibility.
- Update lightning User-Agent prefix to
s3torchconnector/{__version__} (lightning; {lightning.__version__}.
Breaking changes
- No breaking changes.
Full Changelog: v1.1.4...v1.2.0
PyPi Project
v1.1.4
v1.1.4
New features
- Support for Python 3.12.
- Additional logging when constructing Datasets, and when making requests to S3.
- Provide tooling for running benchmarks for S3 Connector for Pytorch.
- Update crates and Mountpoint dependencies.
- [Experimental] Allow passing in the S3 endpoint URL to Dataset constructors.
Bug Fixes
- HeadObject is no longer called when constructing datasets with
from_prefixand seeking relative to end of file.
Breaking changes
- No breaking changes.
Full Changelog: v1.1.3...v1.1.4
PyPi Project
v1.1.3
v1.1.3
New features
- Update crates and Mountpoint dependencies.
Breaking changes
- No breaking changes.
Full Changelog: v1.1.2...v1.1.3
PyPi Project
v1.1.2
v1.1.2
New features
- Update crates and Mountpoint dependencies.
- Expose a logging method for enabling debug logs of the inner dependencies.
Breaking changes
- No breaking changes.
Full Changelog: v1.1.1...v1.1.2
PyPi Project
s3-connector-for-pytorch v1.1.1
v1.1.1 (December 11, 2023)
New features
- Update crates and Mountpoint dependencies
- Avoid excessive memory consumption when utilizing s3map_dataset. Issue #89
- Run all tests against S3 and S3 Express
Breaking changes
- No breaking changes.
Full Changelog: v1.1.0...v1.1.1
PyPi Project
s3-connector-for-pytorch v1.1.0
v1.1.0 (November 29, 2023)
New features
- The Amazon S3 Connector for PyTorch now supports S3 Express One Zone directory buckets.
Breaking changes
- No breaking changes.
Full Changelog: v1.0.0...v1.1.0