Poor performance uploading to S3 bucket with many thousands of subfolders

[acutchin-bitpusher]

I am attempting to upload a folder containing a small number of small files (<10 files, <10MB) to an S3 bucket prefix/directory that contains over 30K subdirectories/sub-prefixes. Uploading the folder sometimes fails, and sometimes succeeds after about 20 minutes. I do not need to download anything from S3, and I do not need to view modification times for any S3 objects or prefixes.

Is there any way to improve the performance of this process?

Is this related to Cyberduck's handling of S3 modification timestamps? (https://docs.cyberduck.io/protocols/s3/#modification-date)

I have reviewed this discussion forum and the online Cyberduck documentation and have not seen (or recognized) any work-around for this issue.

I am using the default "S3 (HTTPS).cyberduckprofile" S3 connection profile that is packaged with the Cyberduck for MacOS installation file:

<?xml version="1.0" encoding="UTF-8"?>
<!--
  ~ Copyright (c) 2002-2017 iterate GmbH. All rights reserved.
  ~ https://cyberduck.io/
  ~
  ~ This program is free software; you can redistribute it and/or modify
  ~ it under the terms of the GNU General Public License as published by
  ~ the Free Software Foundation; either version 2 of the License, or
  ~ (at your option) any later version.
  ~
  ~ This program is distributed in the hope that it will be useful,
  ~ but WITHOUT ANY WARRANTY; without even the implied warranty of
  ~ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  ~ GNU General Public License for more details.
  -->

<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
    <dict>
        <key>Protocol</key>
        <string>s3</string>
        <key>Vendor</key>
        <string>iterate GmbH</string>
        <key>Bundled</key>
        <true/>
        <key>Default Hostname</key>
        <string>s3.amazonaws.com</string>
        <key>Hostname Configurable</key>
        <true/>
        <key>Anonymous Configurable</key>
        <true/>
        <key>Port Configurable</key>
        <false/>
        <key>Default Nickname</key>
        <string>Amazon S3</string>
        <key>Regions</key>
        <array>
            <string>af-south-1</string>
            <string>ap-east-1</string>
            <string>ap-south-1</string>
            <string>ap-south-2</string>
            <string>ap-northeast-1</string>
            <string>ap-northeast-2</string>
            <string>ap-northeast-3</string>
            <string>ap-southeast-1</string>
            <string>ap-southeast-2</string>
            <string>ap-southeast-3</string>
            <string>ap-southeast-4</string>
            <string>ap-southeast-5</string>
            <string>ca-central-1</string>
            <string>ca-west-1</string>
            <string>eu-west-1</string>
            <string>eu-west-2</string>
            <string>eu-west-3</string>
            <string>eu-north-1</string>
            <string>eu-south-1</string>
            <string>eu-south-2</string>
            <string>eu-central-1</string>
            <string>eu-central-2</string>
            <string>il-central-1</string>
            <string>me-central-1</string>
            <string>me-south-1</string>
            <string>sa-east-1</string>
            <string>us-east-1</string>
            <string>us-east-2</string>
            <string>us-west-1</string>
            <string>us-west-2</string>
        </array>
        <key>Properties</key>
        <array>
            <string>s3.storage.class.options=STANDARD INTELLIGENT_TIERING STANDARD_IA ONEZONE_IA REDUCED_REDUNDANCY GLACIER GLACIER_IR DEEP_ARCHIVE</string>
        </array>
    </dict>
</plist>