November 30, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

---

Overall Activity Summary

The Apache OpenDAL repository has been bustling with activity over the past week, with significant contributions across feature development, bug fixes, and discussions. The community has been focusing on enhancing service capabilities, improving metadata handling, and preparing for future releases. Notable efforts include the implementation of recursive delete functionality, metadata enrichment, and support for new services.

---

Key Ongoing Projects

• Recursive Delete Support: Progress has been made on implementing recursive delete functionality across various services. Recent contributions include:

  • feat: Add simulation for delete with recursive #6824 by @Xuanwo, which introduces simulation for recursive delete.
  • feat: Add delete with recursive support for fs #6827 by @Xuanwo, adding recursive delete support for the filesystem service.
  • Additional work is planned for services like azdls, webdav, and hdfs.

• Write Returns Metadata: The initiative to implement metadata extraction during write operations continues:

  • feat(services/seafile): Implement write returns metadata #6810 by @rich7420 implements metadata fetching for the Seafile service.
  • feat(services/ftp): Implement write returns metadata #6800 by @rich7420 adds metadata support for the FTP service.
  • feat(services/huggingface): Enrich metadata with ETag and security scan flags #6834 by @AryanBagade enriches HuggingFace metadata with ETag and security scan flags.
  • This effort is tracked in Implement Write Returns Metadata for all services #5693.

• Generic Git Service with LFS Support: A new feature is being developed to add a generic Git service with transparent LFS support:

  • feat(services/git): Add Git service with transparent LFS support #6836 by @siomporas introduces a new git service backend, enabling seamless integration with Git repositories, including private and public ones. This addresses new feature: Generic git service with LFS support #6831.

• HuggingFace Service Enhancements: Improvements to the HuggingFace service include:

  • feat(services/huggingface): Add repo_type=space support #6833 by @AryanBagade adds support for repo_type=space.
  • fix(services/huggingface): Implement pagination with Link header for large repos #6832 by @AryanBagade implements pagination for large repositories.
  • feat(services/huggingface): Enrich metadata with ETag and security scan flags #6834 by @AryanBagade enriches metadata with additional information.
  • These efforts are part of the now-closed tracking issue Improvements available on Service Hugging Face #6830.

---

Priority Items

• Critical Bug Fixes:

  • bug: write operation won't split payload into chunks following configuration #6521: Write operation not splitting payload into chunks as configured. Addressed by bug: write operation won't split payload into chunks following configuration #6796 by @0lai0, which has been closed but requires verification.
  • usability bug: operator.list(path) confusingly also lists path #6805: Clarifying the behavior of opendal list to avoid including the specified path in the results. Addressed by docs: Make it clear that opendal list returns prefix #6835 by @Xuanwo, which is still open and needs review.

• Release Preparations:

  • Finalizing tasks for the upcoming v0.55.0 release. Discussions and tasks are being tracked in Tracking issues of OpenDAL v0.55.0 Release #6751 and related PRs.

---

Notable Discussions

• RFC-6828: OpenDAL Core (RFC-6828: OpenDAL Core #6828): @Xuanwo proposed a new RFC to enhance the OpenDAL core, which has been implemented and is under review. This includes a significant refactor to simplify APIs and improve maintainability.
• Generic Git Service with LFS Support (new feature: Generic git service with LFS support #6831): @siomporas initiated a discussion on adding support for a generic Git service with LFS. This feature is under development, with an accompanying PR (feat(services/git): Add Git service with transparent LFS support #6836).
• Apache OpenDAL 2025 Roadmap (Apache OpenDAL 2025 Roadmap: Perfecting Production Adoption #5755): The community continues to track progress on the ambitious 2025 roadmap, focusing on production-ready features and improvements.

---

Emerging Trends

• Metadata Enrichment: There is a clear push to improve metadata handling across services, making OpenDAL more user-friendly and transparent.
• Recursive Operations: The implementation of recursive delete functionality across multiple services highlights the project's focus on improving usability for large-scale data operations.
• Cross-Service Compatibility: Efforts to add support for generic services like Git and enhance existing ones like HuggingFace demonstrate a commitment to expanding OpenDAL's versatility.

---

Good First Issues

• Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for all services. This involves extracting metadata from write responses, making it a straightforward task for contributors familiar with Rust and HTTP protocols.
• Tracking issues of RFC-5479: Context #5480: Context API implementation. Help refine the context system, a foundational aspect of OpenDAL’s architecture.
• Tracking issues of OpenDAL wasm32-unknown-unknown target support #3803: WASM target support. Assist in testing and verifying service compatibility with wasm32-unknown-unknown.
• Tracking issues of RFC-3911: Deleter API #3922: Recursive delete support. Contribute to implementing recursive delete functionality for services like azdls, webdav, and hdfs.

---

Thank you to all contributors for your hard work! Let’s keep the momentum going.