备份快照至 MinIO 失败

[Aliang-code]

联系方式

No response

1Panel 版本

v1.10.13-lts

问题描述

配置MinIO正常，test文件也正常上传至MinIO了，快照上传失败

[2024-07-30 02:37:34] [DEBUG] compress successful! size of file: 636.06M  
[2024-07-30 02:37:34] [DEBUG] remove snapshot file /opt/1panel/backup/system/1panel_v1.10.13-lts_amd64_20240730023221  
[2024-07-30 02:37:34] [DEBUG] start upload snapshot to MINIO, path: 1panel/system_snapshot/1panel_v1.10.13-lts_amd64_20240730023221.tar.gz  
[2024-07-30 02:37:54] [DEBUG] upload to MINIO failed, err: One or more of the specified parts could not be found.  The part may not have been uploaded, or the specified entity tag may not match the part's entity tag. 

重现步骤

创建快照，选择MinIO存储

期待的正确结果

No response

相关日志输出

No response

附加信息

No response

[wanghe-fit2cloud]

test 文件上传成功，但快照文件上传失败。根据错误信息，推测可能是网络中断导致了分片上传失败。
你可以创建一个 备份目录 的计划任务，选择 MinIO 作为备份账号，尝试上传较大的文件夹以测试是否成功。

刚刚在本地环境应用商店中安装 MinIO 进行快照时未复现上述问题。

[Aliang-code]

备份目录分片也有问题，小文件可以，请问你测试的也是分片情况吗，查看minio请求日志，发现partNumber为什么是从2开始的？

[30/Jul/2024:17:32:45 +0800] "POST /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?uploads= HTTP/1.1" 200
.top:47443" "-" "MinIO (linux; amd64) minio-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 0.001
ul/2024:17:32:47 +0800] "GET /backup/?delimiter=%2F&encoding-type=url&fetch-owner=true&list-type=2&prefix=directory%2Fminio%E6%B5%8B%E8%AF%95%2F HTTP/1.1" 200
h.top:47443" "-" "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)" "183.136.182.138, 172.19.0.1" 172.18.0.3:9000 0.001
ul/2024:17:32:47 +0800] "GET /backup/?location= HTTP/1.1" 200 128 "s3.i.xxx:47443" "-" "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)" "
.19.0.1" 172.18.0.3:9000 0.001
ul/2024:17:32:47 +0800] "GET /backup/?policy= HTTP/1.1" 404 316 "s3.i.xxx:47443" "-" "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)" "18
9.0.1" 172.18.0.3:9000 0.000
ul/2024:17:32:47 +0800] "GET /backup/?tagging= HTTP/1.1" 404 303 "s3.i.xxx:47443" "-" "MinIO (linux; amd64) minio-go/v7.0.73 MinIO Console/(dev)" "1
19.0.1" 172.18.0.3:9000 0.000
ul/2024:17:32:47 +0800] "GET /minio/admin/v3/accountinfo HTTP/1.1" 200 2101 "s3.i.xxx:47443" "-" "MinIO (linux; amd64) madmin-go/2.0.0 MinIO Console
.138, 172.19.0.1" 172.18.0.3:9000 0.001
[30/Jul/2024:17:32:47 +0800] "GET /api/v1/buckets/backup HTTP/2.0" 200 117 "minio.i.xxx:47443" "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:128
irefox/128.0" "183.136.182.138" 172.18.0.3:9001 0.005
[30/Jul/2024:17:32:48 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=2&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.978
[30/Jul/2024:17:32:48 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=3&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 2.073
[30/Jul/2024:17:32:48 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=1&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 2.861
[30/Jul/2024:17:32:49 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=5&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.109
[30/Jul/2024:17:32:49 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=6&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.108
[30/Jul/2024:17:32:50 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=4&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 4.061
[30/Jul/2024:17:32:50 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=7&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.387
[30/Jul/2024:17:32:50 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=8&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 0.992
[30/Jul/2024:17:32:51 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=9&uploadId=N
mU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO 
-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.722
[30/Jul/2024:17:32:51 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=12&uploadId=
ZmU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO
o-go/v7.0.67" "107.148.250.191" 172.18.0.3:9000 1.272
[30/Jul/2024:17:32:52 +0800] "PUT /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?partNumber=11&uploadId=
ZmU2LTkwODgtNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 200 0 "s3.i.xxx:47443" "-" "MinIO

[Aliang-code]

可以看到上传的分片都是成功的，但是可能是少了partNumber=1导致最后合并时返回400?

[30/Jul/2024:17:33:04 +0800] "POST /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?uploadId=NzcyMjNiZDMtO
DEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 400 609 "s3.i.xxx:47443" "-" "MinIO (linux; am
[30/Jul/2024:17:33:04 +0800] "DELETE /backup/directory/minio%E6%B5%8B%E8%AF%95/directory_opt_1panel_tmp_system_20240730053157mjcbq.tar.gz?uploadId=NzcyMjNiZDM
tNDEwYzI4NWIxYTY3Ljk3MmEzZDNhLWExYzAtNDk1My1hOGJhLTYwOGRiNWU5ODJmMXgxNzIyMzMxOTY1NzcxNDI4MTAw HTTP/1.1" 204 0 "s3.i.xxx:47443" "-" "MinIO (linux; am

[ssongliu]

我们在本地测试没有复现该问题。
分片我们是直接调用的 minio 官方的 sdk，超过 16M 就会使用分片传输，并不是从 partNumber=2 开始，顺序不固定。
可以看一下上传文件多大，除个16看看有多少片。

[Aliang-code]

解决了，nginx反代minio的配置中屏蔽了Etag头proxy_hide_header ETag
删除后即解决，3Q

[Aliang-code]

顺便提个建议，希望能够方便的修改Minio备份账号的目录，现在每次编辑要重新输入accessKey和密钥