大文件上传 403

[suzukua]

问题描述

采用 rclone copy上传大文件失败,一直无限循环上传

重现步骤

rclone copy

版本

1.8.9

运行平台

Docker

refresh token 获取方式

网页版

日志

2022-08-04T02:44:41.672656Z  WARN aliyundrive_webdav::vfs: upload url expired file_id=62eb248759d3610b18184451baf85d5d1b08e4eb file_name=Ad.Astra.2019.UHD.BluRay.2160p.10bit.HDR.TrueHD(Atmos).7.1.x265-beAst.mkv upload_url=https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2
2022-08-04T02:44:42.932158Z ERROR aliyundrive_webdav::vfs: upload file chunk 1188 failed file_id=62eb248759d3610b18184451baf85d5d1b08e4eb file_name=Ad.Astra.2019.UHD.BluRay.2160p.10bit.HDR.TrueHD(Atmos).7.1.x265-beAst.mkv upload_url=https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2 size=36329460256 error=HTTP status client error (403 Forbidden) for url (https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2): <?xml version="1.0" encoding="UTF-8"?>
<Error>
  <Code>AccessDenied</Code>
  <Message>Request has expired.</Message>
  <RequestId>62EB3298268472333807074C</RequestId>
  <HostId>bj29-enet.cn-beijing.data.alicloudccp.com</HostId>
  <Expires>2022-08-04T02:44:39.000Z</Expires>
  <ServerTime>2022-08-04T02:44:40.000Z</ServerTime>
</Error>

2022-08-04T02:44:44.002366Z  WARN reqwest_retry::middleware: Retry attempt #0. Sleeping 267.411481ms before the next attempt

[youcanfind]

碰到跟你一样的问题，小文件上传没有问题，大文件就出错，日志如下：

2022-08-04T04:01:22.019800Z INFO aliyundrive_webdav: listening on http://0.0.0.0:8080
2022-08-04T04:02:10.527107Z WARN reqwest_retry::middleware: Retry attempt #0. Sleeping 16.416408ms before the next attempt
2022-08-04T04:02:40.546738Z WARN reqwest_retry::middleware: Retry attempt #1. Sleeping 368.207588ms before the next attempt
2022-08-04T04:03:10.917000Z WARN reqwest_retry::middleware: Retry attempt #2. Sleeping 344.520526ms before the next attempt
2022-08-04T04:03:41.264264Z ERROR aliyundrive_webdav::vfs: upload file chunk 1 failed file_id=62eb44a4550c8be105894054b6437089ca6a1e80 file_name=ERR188383.gtf upload_url=https://bj29-enet.cn-beijing.data.alicloudccp.com/1v3uy110%2F1213903%2F62eb44a4550c8be105894054b6437089ca6a1e80%2F62eb44a484d50f30553646b893f0af1a22e3ea42?partNumber=1&uploadId=B3361446F5CE4364BC096E41C1E0AE40&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659589300&x-oss-signature=4Bz2PAVVqx96ZMk9SXcLkDaxAuWqn5QCQNcjnGswSKA%3D&x-oss-signature-version=OSS2 size=7296686 error=Request error: error sending request for url (https://bj29-enet.cn-beijing.data.alicloudccp.com/1v3uy110%2F1213903%2F62eb44a4550c8be105894054b6437089ca6a1e80%2F62eb44a484d50f30553646b893f0af1a22e3ea42?partNumber=1&uploadId=B3361446F5CE4364BC096E41C1E0AE40&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659589300&x-oss-signature=4Bz2PAVVqx96ZMk9SXcLkDaxAuWqn5QCQNcjnGswSKA%3D&x-oss-signature-version=OSS2): operation timed out
2022-08-04T04:04:14.302976Z WARN reqwest_retry::middleware: Retry attempt #0. Sleeping 235.155937ms before the next attempt
2022-08-04T04:04:44.540475Z WARN reqwest_retry::middleware: Retry attempt #1. Sleeping 45.755095ms before the next attempt
2022-08-04T04:05:14.588129Z WARN reqwest_retry::middleware: Retry attempt #2. Sleeping 530.393799ms before the next attempt

[zhangbaiquan]

持续到1.9.0版本依旧

[messense]

https://github.com/messense/aliyundrive-webdav#aliyundrive-webdav

[Colin-XKL]

问题描述

采用 rclone copy上传大文件失败,一直无限循环上传

重现步骤

rclone copy

版本

1.8.9

运行平台

Docker

refresh token 获取方式

网页版

日志

2022-08-04T02:44:41.672656Z  WARN aliyundrive_webdav::vfs: upload url expired file_id=62eb248759d3610b18184451baf85d5d1b08e4eb file_name=Ad.Astra.2019.UHD.BluRay.2160p.10bit.HDR.TrueHD(Atmos).7.1.x265-beAst.mkv upload_url=https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2
2022-08-04T02:44:42.932158Z ERROR aliyundrive_webdav::vfs: upload file chunk 1188 failed file_id=62eb248759d3610b18184451baf85d5d1b08e4eb file_name=Ad.Astra.2019.UHD.BluRay.2160p.10bit.HDR.TrueHD(Atmos).7.1.x265-beAst.mkv upload_url=https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2 size=36329460256 error=HTTP status client error (403 Forbidden) for url (https://bj29-enet.cn-beijing.data.alicloudccp.com/vgVRS03T%2F172317540%2F62eb248759d3610b18184451baf85d5d1b08e4eb%2F62eb2487ec61c192847244e987e6ae666cc5157b?partNumber=1188&uploadId=0FBB6E766CE84135BAD5997B7E60580E&x-oss-access-key-id=LTAI5t8sJLSvMtxoes9pGyTv&x-oss-expires=1659581079&x-oss-signature=Rv93WWnzpQ%2FKdp7K%2FHqXt8tPq8Q7PbeZe%2FPny%2F2Lsrk%3D&x-oss-signature-version=OSS2): <?xml version="1.0" encoding="UTF-8"?>
<Error>
  <Code>AccessDenied</Code>
  <Message>Request has expired.</Message>
  <RequestId>62EB3298268472333807074C</RequestId>
  <HostId>bj29-enet.cn-beijing.data.alicloudccp.com</HostId>
  <Expires>2022-08-04T02:44:39.000Z</Expires>
  <ServerTime>2022-08-04T02:44:40.000Z</ServerTime>
</Error>

2022-08-04T02:44:44.002366Z  WARN reqwest_retry::middleware: Retry attempt #0. Sleeping 267.411481ms before the next attempt

rclone 配置chunk自动分块就可以了，可以参考这里
https://rclone.org/chunker/