November 02, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

---

Overall Activity Summary

The Apache OpenDAL repository has seen a productive week with significant contributions across various areas, including new features, bug fixes, and documentation improvements. A total of 15 pull requests were submitted, with 12 closed and merged, and 3 still open. Additionally, 8 issues were discussed, with 2 marked as good first issues for new contributors. The community also engaged in discussions about future development directions, including splitting the repository into multiple crates and exploring new features.

---

Key Ongoing Projects

1. Python Bindings Enhancements:

   • WIP: Enhance py build #6622 by @chitralverma is focused on enhancing the Python build process, including stub generation and improving compatibility with Python bindings.
   • feat(bindings/python)!: Generate stubs for Operator overloads and Scheme #6729 by @chitralverma introduces improved stubs for Python bindings, including overloads for Operator and AsyncOperator.

2. Layer Development:

   • feat: introduce foyer layer #6366 by @MrCroxx introduces the FoyerLayer for hybrid cache integration, which is still under active development.
   • feat: add SanityCheckLayer to detect unexpected list responses and ex… #6747 by @bytelazy proposes the SanityCheckLayer to detect unexpected list responses and expose it for use.

3. Node.js Bindings:

   • feat(bindings/nodejs): add concurrent limit layer #6739 by @kingsword09 adds a ConcurrentLimitLayer to the Node.js bindings, improving concurrency management.

4. Service-Specific Features:

   • feat: implement content-md5 for s3 #6508 by @waynexia implements Content-MD5 support for S3, addressing compatibility with S3-compatible services.
   • feat(bindings/python): Enable ftp/hdfs_native/sftp for python #6745 by @chitralverma enables FTP, HDFS Native, and SFTP services for Python bindings.

---

Priority Items

1. Open PRs Requiring Attention:

   • feat: introduce foyer layer #6366 by @MrCroxx: Introduces FoyerLayer for hybrid cache integration. Needs further review and feedback.
   • feat: add SanityCheckLayer to detect unexpected list responses and ex… #6747 by @bytelazy: Adds SanityCheckLayer to detect unexpected list responses. Requires review and testing.

2. Issues to Address:

   • feat: Add a sanity check layer to detect if services return unexpected responses #6646: Add a SanityCheckLayer to detect unexpected responses from services. This issue is closely tied to feat: add SanityCheckLayer to detect unexpected list responses and ex… #6747 and requires further exploration.
   • Can someone provide good article about rust 'impl' and 'type' feature? #6743: Request for articles about Rust's impl and type features to help new contributors like @I-am-Li-Ren better understand OpenDAL's service abstraction.

---

Notable Discussions

1. ideas: Split opendal rust core into multiple crates #5206: Discussion led by @Xuanwo on splitting the OpenDAL Rust core into multiple crates to improve modularity and maintainability. The community is exploring three potential plans for restructuring the repository.
2. (bindings/python)Split OpenDAL python bindings into separate packages #6748: @chitralverma proposed splitting OpenDAL's Python bindings into separate packages for services and layers, enabling dynamic loading and reducing the size of the base wheel.

---

Emerging Trends

1. Focus on Layers: Multiple contributors are working on developing new layers, such as FoyerLayer and SanityCheckLayer, indicating a trend toward enhancing OpenDAL's modularity and extensibility.
2. Improved Bindings: Significant effort is being put into refining Python and Node.js bindings, making OpenDAL more accessible to developers across different programming languages.
3. Service-Specific Features: There is an emphasis on improving compatibility with external services like S3 and enabling new services in bindings, such as FTP and HDFS Native.

---

Good First Issues

1. Tracking issues of OpenDAL wasm32-unknown-unknown target support #3803: Tracking issues for OpenDAL wasm32-unknown-unknown target support. This issue is ideal for contributors interested in WebAssembly and includes detailed tasks for adding support to various services.
2. servcices/vercel_artifacts: Tracking issues of not passed test cases #2198: Tracking issues for fixing test cases in services/vercel_artifacts. Contributors can help implement missing features like stat, delete, and create_dir.
3. new feature: Allow s3 service to configure assume role's tags #4975: Allow S3 service to configure assume role's tags. This issue is a great entry point for contributors familiar with AWS S3 and Rust.
4. Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for all services. A straightforward task for contributors to extend metadata extraction functionality to various services.
5. new feature: publish the source and lock files for binaries (oli, oay...) #6198: Publish source and lock files for binaries (oli, oay, etc.). Ideal for contributors interested in packaging and release workflows.

---

Thank you to all contributors for your hard work this week! Let's keep the momentum going and continue to make OpenDAL even better.