Skip to content

Commit bcb635f

Browse files
committed
(site/ls/cluster/lsstcam-ccs) set bwlimit for s3nd cp-lsstcam
s3.ls.lsst.org, currently hosted on konkong, isn't sized to handle ~8x10G bandwidth worth of uploads and frequent transfer timeouts are being observed.
1 parent 913c0ac commit bcb635f

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

hieradata/site/ls/cluster/lsstcam-ccs.yaml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,12 @@ s3nd::instances:
1919
port: 15571
2020
env:
2121
S3ND_ENDPOINT_URL: "https://s3.ls.lsst.org"
22+
S3ND_QUEUE_TIMEOUT: "20s"
23+
S3ND_UPLOAD_BWLIMIT: "1Gi"
24+
S3ND_UPLOAD_MAX_PARALLEL: "27"
25+
S3ND_UPLOAD_PARTSIZE: "100Mi"
26+
S3ND_UPLOAD_TIMEOUT: "15s"
27+
S3ND_UPLOAD_TRIES: "2"
2228
s3dfrgw-lsstcam:
2329
image: "%{alias('s3nd_default_image_ls')}"
2430
port: 15581

spec/hosts/nodes/lsstcam-dc01.ls.lsst.org_spec.rb

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,12 @@
3939
],
4040
env: {
4141
'S3ND_ENDPOINT_URL' => 'https://s3.ls.lsst.org',
42+
'S3ND_QUEUE_TIMEOUT' => '20s',
43+
'S3ND_UPLOAD_BWLIMIT' => '1Gi',
44+
'S3ND_UPLOAD_MAX_PARALLEL' => '27',
45+
'S3ND_UPLOAD_PARTSIZE' => '100Mi',
46+
'S3ND_UPLOAD_TIMEOUT' => '15s',
47+
'S3ND_UPLOAD_TRIES' => '2',
4248
}
4349
)
4450
end

0 commit comments

Comments
 (0)