Skip to content

Extending ZIM file expiration detection beyond the timestamp check #1099

@Best2Two

Description

@Best2Two

This is a follow up made after the edits of this pr #1090

Currently is_zim_file_deleted only checks if the ZIM file is older than 2 weeks. There may be cases where the file disappears from Wasabi before the 2-week time to live expires.

This issue is to discuss whether and how we should extend the expiry detection to handle this case. Making HEAD requests to Wasabi would cause significant overhead e.g. HEAD request will occur on every frontend selection page load for every item in the list, creating frequent network calls to Wasabi. The whole detection logic needs to be re-architected to handle this efficiently. I want to discuss this here

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions