You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Object Storage - How to migrate from an S3-compatible object storage provider to OVHcloud Object Storage
3
-
excerpt: This guide provides details on how to migrate from an S3-compatible object storage provider to OVHcloud Object Storage using Rclone.
2
+
title: Object Storage - How to migrate from an S3-compatible object storage provider to OVHcloud Object Storage
3
+
excerpt: This guide provides details on how to migrate from an S3-compatible object storage provider to OVHcloud Object Storage using Rclone
4
4
updated: 2025-09-08
5
5
---
6
-
6
+
7
7
## Objective
8
-
9
-
This guide provides detailed steps to help you migrate from a third-party S3-compatible object storage provider to OVHcloud Object Storage using the popular [Rclone](https://rclone.org/){.external} tool, a command-line tool that can be used to manage cloud storage resources.
8
+
9
+
This guide provides detailed steps to help you migrate from a third-party S3-compatible object storage provider to OVHcloud Object Storage using the popular [Rclone](https://rclone.org/) tool, a command-line tool that can be used to manage cloud storage resources.
10
10
11
11
> [!warning]
12
12
>
@@ -17,72 +17,81 @@ This guide provides detailed steps to help you migrate from a third-party S3-com
17
17
18
18
## Requirements
19
19
20
-
- An **S3-compatible source bucket** in your current object storage with:
21
-
- Your bucket name
22
-
- Your associated access and secret keys
23
-
- The associated region ID
24
-
25
-
- An **OVHcloud Object Storage destination bucket** with:
26
-
- Your bucket name
27
-
- Your associated access and secret keys
28
-
- The associated region ID
29
-
30
-
- An **OVHcloud virtual machine** with Rclone installed working as the management workstation in our scenario. To get the best results, within your budget, we suggest at least the following specifications:
20
+
- An **S3-compatible source bucket** in your current object storage with:
21
+
- Your bucket name
22
+
- Your associated access and secret keys
23
+
- The associated region ID
24
+
- An **OVHcloud Object Storage destination bucket** with:
25
+
- Your bucket name
26
+
- Your associated access and secret keys
27
+
- The associated region ID
28
+
- An **OVHcloud virtual machine** with Rclone installed working as the management workstation in our scenario. To get the best results, within your budget, we suggest at least the following specifications:
31
29
- b3-16: 4 v-cores and 16 GB of RAM
32
30
- c3-16: 8 v-cores and 16 GB of RAM
33
31
34
32
> [!primary]
35
33
>
36
-
> If this is your first time creating an Object Storage bucket, see[Getting Started with Object Storage](/pages/storage_and_backup/object_storage/s3_getting_started_with_object_storage).
34
+
> If this is your first time creating an Object Storage bucket, read our guide[Getting Started with Object Storage](/pages/storage_and_backup/object_storage/s3_getting_started_with_object_storage).
See the diagram above for an illustration of the architecture. An OVHcloud Public Cloud virtual machine acts as an entry point, on which Rclone (installed with SSH and sudo access enabled) moves data to OVHcloud Object Storage.
44
-
42
+
45
43
## Considerations
46
44
47
45
### Egress
48
-
Egress fees may apply when migrating from your current platform, depending on your provider. The term “egress” describes the volume of data transferred from the provider’s network. **We highly recommend reviewing your current provider’s egress pricing** before starting migration.
46
+
47
+
Egress fees may apply when migrating from your current platform, depending on your provider. The term “egress” describes the volume of data transferred from the provider’s network. **We highly recommend reviewing your current provider’s egress pricing** before starting the migration.
49
48
50
49
### Migration speed optimisation
50
+
51
51
Keep in mind that several factors could affect how long migration takes. Consider not only the volume of data you plan to migrate but also the quantity and size of individual objects. Infrastructure and network limitations (bandwidth, computing power, network interfaces, etc.) could also affect performance.
52
52
53
53
### Data volume
54
-
This guide mainly **focuses on data migration for small to medium volumes (generally under 200 TB)**. For applications needing migration of hundreds or thousands of terabytes, we suggest contacting our professional services team for identifying the best approaches for migrating your data.
54
+
55
+
This guide mainly **focuses on data migration for small to medium volumes (generally under 200 TB)**. For applications needing migration of hundreds or thousands of terabytes, we suggest contacting our [Professional Services](/links/professional-services) team for identifying the best approaches for migrating your data.
55
56
56
57
## Instructions
57
58
58
59
### Step 1 - Preparing your S3-compatible source bucket
59
60
60
61
As explained before you will need your `access key`, `secret key` but also the `region ID` in which your bucket is. Connect to your source bucket provider console to get those details.
61
-
62
+
62
63
### Step 2 - Preparing your OVHcloud destination bucket
63
64
64
65
Similar to your source bucket, you will need your `access key`, `secret key` but also the `region ID` for your destination bucket. Log in to the [OVHcloud Control Panel](/links/manager) and navigate to the `Object Storage`{.action} section to collect those details.
65
66
66
67
### Step 3 - Installing, configuring and running Rclone
67
68
68
69
#### Step 3.1 - Installing Rclone
69
-
If you haven’t already, install **Rclone** by following the instructions in the [documentation](https://rclone.org/install/){.external}, based on your OS configuration.
70
+
71
+
If you haven’t done it already, install **Rclone** by following the instructions from its [documentation](https://rclone.org/install/), based on your OS configuration.
70
72
71
73
#### Step 3.2 - Configuring Rclone
74
+
72
75
After installing **Rclone** on your virtual machine, configure its connection to both the source and destination buckets.
73
76
74
77
```bash
75
78
$ rclone config
76
79
```
77
-
This command will open the configuration menu and will guide you step by step with the configuration. The official OVHcloud provider configuration is available and will guide you step by step. Follow the steps available [here](https://rclone.org/s3/#ovhcloud){.external}.
78
-
You can also create/modify the configuration file by yourself with the following command:
80
+
81
+
This command will open the configuration menu and will guide you step by step with the configuration. The official OVHcloud provider configuration is available and will guide you step by step. Follow the steps available [here](https://rclone.org/s3/#ovhcloud).
82
+
83
+
You can also create/modify the configuration file yourself with the following command:
84
+
79
85
```bash
80
86
$ rclone config file
81
87
```
82
-
If the configuration file doesn’t exist, you’ll be prompted to add the following configuration using your preferred editor. For example, on linux you can use `nano` :
88
+
89
+
If the configuration file doesn’t exist, you’ll be prompted to add the following configuration using your preferred editor. For example, on Linux you can use `nano` :
90
+
83
91
```bash
84
92
$ nano /home/<your linux user>/.config/rclone/rclone.conf
85
93
```
94
+
86
95
Then, add your configuration blocks:
87
96
88
97
```bash
@@ -110,58 +119,70 @@ region = <region>
110
119
>
111
120
112
121
You can then test your source provider and your OVHcloud connections using the `rclone config` command by as below:
122
+
113
123
```bash
114
124
$ rclone config
115
125
```
126
+
116
127
#### Step 3.3 - Running Rclone
128
+
117
129
Depending on your strategy you can use two different commands to start the migration. Either you use the `rclone sync` command to start the migration of one or all buckets. As detailed in the documentation, the `rclone sync`command will make source and destination identical. Be careful then when using it.
130
+
118
131
You can also use the `rclone copy` command that will copy files from your source to your destination.
119
132
In both cases, remember to change `source-bucket-name` and `ovh-bucket-name` to your S3-compatible source provider and OVHcloud Object Storage bucket names, respectively:
In this command we added specific flags to optimize and monitor the copy:
136
153
137
-
-`--transfers`int represents the number of file transfers to run in parallel (default 4). Test different value based on your use case and your configuration as high values may increase CPU usage for example.
154
+
-`--transfers` represents the number of file transfers to run in parallel (default 4). Test different value based on your use case and your configuration as high values may increase CPU usage for example.
138
155
-`--rc` enables the remote control server
139
-
-`--rc-addr :5572` represents the address and the port used to access rclone’s WebUI GUI. Port 5572 is the default port used rclone to securely access the WebUI.
156
+
-`--rc-addr :5572` represents the address and the port used to access rclone’s WebUI GUI. Port 5572 is the default port used by Rclone to securely access the WebUI.
140
157
-`--rc-web-gui` launches WebGUI on localhost
141
-
-`--rc-user USERNAME``--rc-pass PASSWORD` are your user and password for authentication Be sure to enter the right credentials.
158
+
-`--rc-user USERNAME``--rc-pass PASSWORD` are your user and password for authentication. Make sure to enter the right credentials.
142
159
143
160
> [!primary]
144
161
>
145
-
> Many other flags are available with rclone. You can get them on the [Rclone documentation](https://rclone.org/commands/rclone/){.external}.
162
+
> Many other flags are available with rRlone. You can get them on the [Rclone documentation](https://rclone.org/commands/rclone/).
146
163
>
147
-
148
-
With the copy process set up, you can now begin monitoring the migration process using rclone’s WebUI GUI.
149
164
150
-
In your preferred web browser, use port 5572 to reach your instance’s address: `http://IP-ADDRESS:5572`{.action}
165
+
With the copy process set up, you can now begin monitoring the migration process using Rclone’s WebUI GUI.
166
+
167
+
In your preferred web browser, use port 5572 to reach your instance’s address: `http://IP-ADDRESS:5572`.
151
168
152
169
You’ll need to log in using your rclone credentials: `--rc-user` and `–rc-pass`.
170
+
153
171
Once you’re logged in, you can track the `rclone copy` command’s progress: check job status, throughput, bandwidth, object count, and total data volume. From the GUI, you can also manage new remotes and new actions.
154
172
155
173
#### Migration status
156
174
157
175
We recommend comparing the source and destination buckets after migration. Your source and OVHcloud destination buckets can be compared via command line or their respective control panels.
158
176
159
177
You can check the size of both buckets and number of objects using this command line:
If you need training or technical assistance to implement our solutions, contact your sales representative or click on [this link](/links/professional-services) to get a quote and ask our Professional Services experts for assisting you on your specific use case of your project.
0 commit comments