Skip to content

Commit d066ee5

Browse files
committed
Proofreading
1 parent 3a3ffdc commit d066ee5

File tree

2 files changed

+101
-70
lines changed

2 files changed

+101
-70
lines changed
Lines changed: 57 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
---
2-
title: Object Storage - How to migrate from an S3-compatible object storage provider to OVHcloud Object Storage
3-
excerpt: This guide provides details on how to migrate from an S3-compatible object storage provider to OVHcloud Object Storage using Rclone.
2+
title: Object Storage - How to migrate from an S3-compatible object storage provider to OVHcloud Object Storage
3+
excerpt: This guide provides details on how to migrate from an S3-compatible object storage provider to OVHcloud Object Storage using Rclone
44
updated: 2025-09-08
55
---
6-
6+
77
## Objective
8-
9-
This guide provides detailed steps to help you migrate from a third-party S3-compatible object storage provider to OVHcloud Object Storage using the popular [Rclone](https://rclone.org/){.external} tool, a command-line tool that can be used to manage cloud storage resources.
8+
9+
This guide provides detailed steps to help you migrate from a third-party S3-compatible object storage provider to OVHcloud Object Storage using the popular [Rclone](https://rclone.org/) tool, a command-line tool that can be used to manage cloud storage resources.
1010

1111
> [!warning]
1212
>
@@ -17,72 +17,81 @@ This guide provides detailed steps to help you migrate from a third-party S3-com
1717
1818
## Requirements
1919

20-
- An **S3-compatible source bucket** in your current object storage with:
21-
- Your bucket name
22-
- Your associated access and secret keys
23-
- The associated region ID
24-
25-
- An **OVHcloud Object Storage destination bucket** with:
26-
- Your bucket name
27-
- Your associated access and secret keys
28-
- The associated region ID
29-
30-
- An **OVHcloud virtual machine** with Rclone installed working as the management workstation in our scenario. To get the best results, within your budget, we suggest at least the following specifications:
20+
- An **S3-compatible source bucket** in your current object storage with:
21+
- Your bucket name
22+
- Your associated access and secret keys
23+
- The associated region ID
24+
- An **OVHcloud Object Storage destination bucket** with:
25+
- Your bucket name
26+
- Your associated access and secret keys
27+
- The associated region ID
28+
- An **OVHcloud virtual machine** with Rclone installed working as the management workstation in our scenario. To get the best results, within your budget, we suggest at least the following specifications:
3129
- b3-16: 4 v-cores and 16 GB of RAM
3230
- c3-16: 8 v-cores and 16 GB of RAM
3331

3432
> [!primary]
3533
>
36-
> If this is your first time creating an Object Storage bucket, see [Getting Started with Object Storage](/pages/storage_and_backup/object_storage/s3_getting_started_with_object_storage).
34+
> If this is your first time creating an Object Storage bucket, read our guide [Getting Started with Object Storage](/pages/storage_and_backup/object_storage/s3_getting_started_with_object_storage).
3735
>
38-
36+
3937
## Migration Process
4038

4139
![Architecture](images/move-to-cloud-object-storage.png){.thumbnail}
4240

4341
See the diagram above for an illustration of the architecture. An OVHcloud Public Cloud virtual machine acts as an entry point, on which Rclone (installed with SSH and sudo access enabled) moves data to OVHcloud Object Storage.
44-
42+
4543
## Considerations
4644

4745
### Egress
48-
Egress fees may apply when migrating from your current platform, depending on your provider. The term “egress” describes the volume of data transferred from the provider’s network. **We highly recommend reviewing your current provider’s egress pricing** before starting migration.
46+
47+
Egress fees may apply when migrating from your current platform, depending on your provider. The term “egress” describes the volume of data transferred from the provider’s network. **We highly recommend reviewing your current provider’s egress pricing** before starting the migration.
4948

5049
### Migration speed optimisation
50+
5151
Keep in mind that several factors could affect how long migration takes. Consider not only the volume of data you plan to migrate but also the quantity and size of individual objects. Infrastructure and network limitations (bandwidth, computing power, network interfaces, etc.) could also affect performance.
5252

5353
### Data volume
54-
This guide mainly **focuses on data migration for small to medium volumes (generally under 200 TB)**. For applications needing migration of hundreds or thousands of terabytes, we suggest contacting our professional services team for identifying the best approaches for migrating your data.
54+
55+
This guide mainly **focuses on data migration for small to medium volumes (generally under 200 TB)**. For applications needing migration of hundreds or thousands of terabytes, we suggest contacting our [Professional Services](/links/professional-services) team for identifying the best approaches for migrating your data.
5556

5657
## Instructions
5758

5859
### Step 1 - Preparing your S3-compatible source bucket
5960

6061
As explained before you will need your `access key`, `secret key` but also the `region ID` in which your bucket is. Connect to your source bucket provider console to get those details.
61-
62+
6263
### Step 2 - Preparing your OVHcloud destination bucket
6364

6465
Similar to your source bucket, you will need your `access key`, `secret key` but also the `region ID` for your destination bucket. Log in to the [OVHcloud Control Panel](/links/manager) and navigate to the `Object Storage`{.action} section to collect those details.
6566

6667
### Step 3 - Installing, configuring and running Rclone
6768

6869
#### Step 3.1 - Installing Rclone
69-
If you haven’t already, install **Rclone** by following the instructions in the [documentation](https://rclone.org/install/){.external}, based on your OS configuration.
70+
71+
If you haven’t done it already, install **Rclone** by following the instructions from its [documentation](https://rclone.org/install/), based on your OS configuration.
7072

7173
#### Step 3.2 - Configuring Rclone
74+
7275
After installing **Rclone** on your virtual machine, configure its connection to both the source and destination buckets.
7376

7477
```bash
7578
$ rclone config
7679
```
77-
This command will open the configuration menu and will guide you step by step with the configuration. The official OVHcloud provider configuration is available and will guide you step by step. Follow the steps available [here](https://rclone.org/s3/#ovhcloud){.external}.
78-
You can also create/modify the configuration file by yourself with the following command:
80+
81+
This command will open the configuration menu and will guide you step by step with the configuration. The official OVHcloud provider configuration is available and will guide you step by step. Follow the steps available [here](https://rclone.org/s3/#ovhcloud).
82+
83+
You can also create/modify the configuration file yourself with the following command:
84+
7985
```bash
8086
$ rclone config file
8187
```
82-
If the configuration file doesn’t exist, you’ll be prompted to add the following configuration using your preferred editor. For example, on linux you can use `nano` :
88+
89+
If the configuration file doesn’t exist, you’ll be prompted to add the following configuration using your preferred editor. For example, on Linux you can use `nano` :
90+
8391
```bash
8492
$ nano /home/<your linux user>/.config/rclone/rclone.conf
8593
```
94+
8695
Then, add your configuration blocks:
8796

8897
```bash
@@ -110,58 +119,70 @@ region = <region>
110119
>
111120
112121
You can then test your source provider and your OVHcloud connections using the `rclone config` command by as below:
122+
113123
```bash
114124
$ rclone config
115125
```
126+
116127
#### Step 3.3 - Running Rclone
128+
117129
Depending on your strategy you can use two different commands to start the migration. Either you use the `rclone sync` command to start the migration of one or all buckets. As detailed in the documentation, the `rclone sync`command will make source and destination identical. Be careful then when using it.
130+
118131
You can also use the `rclone copy` command that will copy files from your source to your destination.
119132
In both cases, remember to change `source-bucket-name` and `ovh-bucket-name` to your S3-compatible source provider and OVHcloud Object Storage bucket names, respectively:
120133

121134
```bash
122135
$ rclone sync <your source provider name>:source-bucket-name/ ovhcloud:ovh-bucket-name/ --progress
123136
```
124-
or
137+
138+
or:
139+
125140
```bash
126141
$ rclone copy <your source provider name>:source-bucket-name/ ovhcloud:ovh-bucket-name/ --progress
127142
```
128-
`--progress` shows progress during transfer
143+
144+
`--progress` shows progress during transfer.
129145

130146
In order to leverage the rclone WebUI GUI you can also use the following command:
131147

132148
```bash
133149
$ rclone copy <your source provider name>:source-bucket-name/ ovhcloud:ovh-bucket-name/ --transfers 50 --rc --rc-addr :5572 --rc-web-gui --rc-user USERNAME --rc-pass PASSWORD
134150
```
151+
135152
In this command we added specific flags to optimize and monitor the copy:
136153

137-
- `--transfers` int represents the number of file transfers to run in parallel (default 4). Test different value based on your use case and your configuration as high values may increase CPU usage for example.
154+
- `--transfers` represents the number of file transfers to run in parallel (default 4). Test different value based on your use case and your configuration as high values may increase CPU usage for example.
138155
- `--rc` enables the remote control server
139-
- `--rc-addr :5572` represents the address and the port used to access rclone’s WebUI GUI. Port 5572 is the default port used rclone to securely access the WebUI.
156+
- `--rc-addr :5572` represents the address and the port used to access rclone’s WebUI GUI. Port 5572 is the default port used by Rclone to securely access the WebUI.
140157
- `--rc-web-gui` launches WebGUI on localhost
141-
- `--rc-user USERNAME` `--rc-pass PASSWORD` are your user and password for authentication Be sure to enter the right credentials.
158+
- `--rc-user USERNAME` `--rc-pass PASSWORD` are your user and password for authentication. Make sure to enter the right credentials.
142159

143160
> [!primary]
144161
>
145-
> Many other flags are available with rclone. You can get them on the [Rclone documentation](https://rclone.org/commands/rclone/){.external}.
162+
> Many other flags are available with rRlone. You can get them on the [Rclone documentation](https://rclone.org/commands/rclone/).
146163
>
147-
148-
With the copy process set up, you can now begin monitoring the migration process using rclone’s WebUI GUI.
149164
150-
In your preferred web browser, use port 5572 to reach your instance’s address: `http://IP-ADDRESS:5572`{.action}
165+
With the copy process set up, you can now begin monitoring the migration process using Rclone’s WebUI GUI.
166+
167+
In your preferred web browser, use port 5572 to reach your instance’s address: `http://IP-ADDRESS:5572`.
151168

152169
You’ll need to log in using your rclone credentials: `--rc-user` and `–rc-pass`.
170+
153171
Once you’re logged in, you can track the `rclone copy` command’s progress: check job status, throughput, bandwidth, object count, and total data volume. From the GUI, you can also manage new remotes and new actions.
154172

155173
#### Migration status
156174

157175
We recommend comparing the source and destination buckets after migration. Your source and OVHcloud destination buckets can be compared via command line or their respective control panels.
158176

159177
You can check the size of both buckets and number of objects using this command line:
178+
160179
```bash
161180
rclone size <your source provider name>:source-bucket-name/
162181
rclone size ovhcloud:ovh-bucket-name/
163182
```
164183

165184
## Go further
166-
185+
186+
If you need training or technical assistance to implement our solutions, contact your sales representative or click on [this link](/links/professional-services) to get a quote and ask our Professional Services experts for assisting you on your specific use case of your project.
187+
167188
Join our [community of users](/links/community).

0 commit comments

Comments
 (0)