Skip to content

Update documentation/structure/etc in mass with fixed support #14

@nelsonjchen

Description

@nelsonjchen

Much thanks for @fcfort for implementing and fixing so much in #13

New things noticed right away to fix:

  • Stronger emphasis on using a private proxy. We're handling long lived cookies right now. Much more radioactive.
  • Speeds are slower. We're no longer transloading straight from GCS. As a result, speeds on a 50GB file seem to now hover around 350MB/s, down from GB/s.
  • Higher concurrency though.
  • Update the documentation in various parts with the new cookie approach. We aren't using URLs anymore.

Other refactors and stuff aren't in scope

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions