You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pages/data-lab/faq.mdx
+32-30Lines changed: 32 additions & 30 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,21 +2,11 @@
2
2
title: Data Lab for Apache Spark™ FAQ
3
3
description: Discover Scaleway Data Lab for Apache Spark™ powered by Apache Spark, and how to use it.
4
4
dates:
5
-
validation: 2025-09-02
5
+
validation: 2025-09-23
6
6
productIcon: DistributedDataLabProductIcon
7
7
---
8
8
9
-
## General
10
-
11
-
### What workloads is Data Lab for Apache Spark™ suited for?
12
-
13
-
Data Lab for Apache Spark™ supports a range of workloads, including:
14
-
15
-
- Complex analytics.
16
-
- Machine learning tasks.
17
-
- High-speed operations on large datasets.
18
-
19
-
It offers scalable CPU and GPU instances with flexible node limits, and robust Apache Spark library support.
9
+
## Overview
20
10
21
11
### What is Apache Spark?
22
12
@@ -26,40 +16,52 @@ Apache Spark is an open-source unified analytics engine designed for large-scale
26
16
27
17
Apache Spark processes data in memory, which allows it to perform tasks up to 100 times faster than traditional disk-based processing frameworks like [Hadoop MapReduce](https://fr.wikipedia.org/wiki/MapReduce). It uses Resilient Distributed Datasets (RDDs) to store data across multiple nodes in a cluster and perform parallel operations on this data.
28
18
29
-
### How am I billed for Data Lab for Apache Spark™?
19
+
### What workloads is Data Lab for Apache Spark™ suited for?
30
20
31
-
Data Lab for Apache Spark™ is billed based on two factors:
32
-
- the main node configuration selected
33
-
- the worker node configuration selected, and the number of worker nodes in the cluster
21
+
Data Lab for Apache Spark™ supports a range of workloads, including:
34
22
35
-
## Clusters
23
+
- Complex analytics
24
+
- Machine learning tasks
25
+
- High-speed operations on large datasets
36
26
37
-
### Can I upscale or downscale a Data Lab for Apache Spark™?
27
+
It offers scalable CPU and GPU Instances with flexible node limits and robust Apache Spark library support.
38
28
39
-
Yes, you can upscale a Data Lab cluster to distribute your workloads across more worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context.
29
+
## Offering and availability
40
30
41
-
You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculations. You can resume the activity of your cluster by provisioning at least one worker node.
31
+
### What data source options are available?
42
32
43
-
### Can I run a Data Lab for Apache Spark™ using GPUs?
33
+
Data Lab natively integrates with Scaleway Object Storage for reading and writing data, making it easy to process data directly from your buckets. Your buckets are accessible using the Scaleway console or any other Amazon S3-compatible CLI tool.
44
34
45
-
Yes, you can run your cluster on either CPUs or GPUs. Scaleway leverages Nvidia's [RAPIDS Accelerator For Apache Spark](https://www.nvidia.com/en-gb/deep-learning-ai/software/rapids/), an open-source suite of software libraries and APIs to execute end-to-end data science and analytics pipelines entirely on GPUs. This technology allows for significant acceleration of data processing tasks compared to CPU-based processing.
35
+
### What notebook is included with Dedicated Data Labs?
46
36
47
-
## Storage
37
+
The service provides a JupyterLab notebook running on a dedicated CPU Instance, fully integrated with the Apache Spark cluster for seamless data processing and calculations.
48
38
49
-
### What data source options are available?
39
+
##Pricing and billing
50
40
51
-
Data Lab natively integrates with Scaleway Object Storage for reading and writing data, making it easy to process data directly from your buckets. Your buckets are accessible using the Scaleway console, or any other Amazon S3-compatible CLI tool.
41
+
### How am I billed for Data Lab for Apache Spark™?
52
42
53
-
### Can I connect to S3 buckets from other cloud providers?
43
+
Data Lab for Apache Spark™ is billed based on two factors:
44
+
- The main node configuration selected
45
+
- The worker node configuration selected, and the number of worker nodes in the cluster.
54
46
55
-
Currently, connections are limited to Scaleway's Object Storage environment.
47
+
## Compatibility and integration
56
48
57
-
##Notebook
49
+
### Can I run a Data Lab for Apache Spark™ using GPUs?
58
50
59
-
### What notebook is included with Dedicated Data Labs?
51
+
Yes, you can run your cluster on either CPUs or GPUs. Scaleway leverages Nvidia's [RAPIDS Accelerator For Apache Spark](https://www.nvidia.com/en-gb/deep-learning-ai/software/rapids/), an open-source suite of software libraries and APIs to execute end-to-end data science and analytics pipelines entirely on GPUs. This technology allows for significant acceleration of data processing tasks compared to CPU-based processing.
52
+
53
+
### Can I connect to S3 buckets from other cloud providers?
60
54
61
-
The service provides a JupyterLab notebook running on a dedicated CPU instance, fully integrated with the Apache Spark cluster for seamless data processing and calculations.
55
+
Currently, connections are limited to Scaleway's Object Storage environment.
62
56
63
57
### Can I connect my local JupyterLab to the Data Lab?
64
58
65
59
Remote connections to a Data Lab cluster are currently not supported.
60
+
61
+
## Usage and management
62
+
63
+
### Can I upscale or downscale a Data Lab for Apache Spark™?
64
+
65
+
Yes, you can upscale a Data Lab cluster to distribute your workloads across more worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context.
66
+
67
+
You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculations. You can resume the activity of your cluster by provisioning at least one worker node.
Copy file name to clipboardExpand all lines: pages/data-warehouse/faq.mdx
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,9 @@ dates:
6
6
productIcon: DataWarehouseProductIcon
7
7
---
8
8
9
-
## What is Scaleway Data Warehouse for ClickHouse®?
9
+
## Overview
10
+
11
+
### What is Scaleway Data Warehouse for ClickHouse®?
10
12
11
13
Scaleway Data Warehouse for ClickHouse® allows you to perform queries and analytics on structured datasets, up to petabytes, without managing any infrastructure.
A Dedibox VPS (Virtual Private Servers) is a virtualized server that provides users with the power and flexibility of a dedicated server within a shared hosting environment, offering full control at a fraction of the cost.
11
13
12
-
## How does a Dedibox VPS work?
14
+
###How does a Dedibox VPS work?
13
15
A Dedibox VPS works by partitioning a physical server into multiple isolated virtual environments, each functioning as an independent server with its own resources and configurations.
14
16
15
-
## What are the benefits of using a Dedibox VPS?
17
+
###What are the benefits of using a Dedibox VPS?
16
18
* Enhanced reliability and performance compared to traditional shared hosting environments.
17
19
* Full root access and control over server configurations to tailor your environment to your needs.
18
20
* Each Dedibox VPS is an isolated environment for enhanced protection of your data and applications.
19
21
20
-
## Who should use a Dedibox VPS?
22
+
###Who should use a Dedibox VPS?
21
23
Dedibox VPS are suitable for individuals, businesses, and developers seeking greater control, customization, and performance than traditional shared hosting can provide.
22
24
They are ideal for hosting websites, web applications, development environments, and more.
23
25
24
-
## What ranges of Dedibox VPS are available?
26
+
### How secure is a Dedibox VPS?
27
+
Each Dedibox VPS is isolated from other virtual servers on the same host, ensuring security. However, best security practices, including regular updates, strong passwords, and firewall configurations, are essential to enhance security further.
28
+
29
+
## Offering and availability
30
+
31
+
### What ranges of Dedibox VPS are available?
25
32
Currently, we offer two ranges of Dedibox VPS:
26
33
***Dedibox VPS START**: Ideal for smaller projects and development, offering 1 to 16 vCores, 1 to 32 GB RAM, and SATA SSD storage ranging from 10 GB to 320 GB.
27
34
***Dedibox VPS PRO**: Designed for production workloads, with 1 to 16 vCores, 1 to 16 GB RAM, and NVMe storage ranging from 20 GB to 640 GB.
28
35
29
-
## What are the available locations for Dedibox VPS?
36
+
###What are the available locations for Dedibox VPS?
30
37
Dedibox VPS are available in 60+ different locations worldwide, allowing you to deploy a Dedibox VPS as close as geographically possible to your user base.
31
38
32
-
## What operating systems can I run on a Dedibox VPS?
39
+
## Specifications
40
+
41
+
### What operating systems can I run on a Dedibox VPS?
33
42
We support various Linux distributions such as Ubuntu, CentOS, and Debian, providing flexibility for your specific requirements.
34
43
35
-
## How do I manage my Dedibox VPS?
36
-
You can manage your Dedibox VPS from the Dedibox console for administrative tasks such as restarting or reinstalling. For advanced users who prefer command-line interaction, you have full access as the root user via SSH.
44
+
### Does my Dedibox VPS use shared resources or dedicated resources?
45
+
Dedibox VPS provide an isolated environment in which you can access shared resources of the host system.
46
+
47
+
### Are IP addresses for Dedibox VPS assigned statically?
48
+
IP addresses for Dedibox VPS are generally assigned statically. However, in rare cases, such as maintenance or replacement of a faulty host node, we may perform IP migrations, which can result in a change of IP address.
49
+
You can find your updated IP address in the Dedibox console. Please note that we do not currently notify users of such changes. You can contact our [Support team](https://console.online.net/en/assistance/commercial) if you experience any issues.
50
+
51
+
## Compatibility and integration
37
52
38
-
## Is my Dedibox VPS compatible with the Dedibox ecosystem?
53
+
###Is my Dedibox VPS compatible with the Dedibox ecosystem?
39
54
No, a Dedibox VPS is a standalone product and not compatible with the Dedibox ecosystem (RPN, Failovers IPs, Dedibackup, RPN-SAN, etc.).
40
55
41
-
## Does my Dedibox VPS use shared resources or dedicated resources?
42
-
Dedibox VPS provide an isolated environment in which you can access shared resources of the host system.
56
+
## Quotas and limitations
43
57
44
-
## Does my Dedibox VPS come with unlimited traffic?
58
+
###Does my Dedibox VPS come with unlimited traffic?
45
59
Yes, but the bandwidth will be throttled beyond a certain amount of traffic (fair use).
46
60
The amount of unthrottled bandwidth included with the VPS depends on the server configuration.
47
61
@@ -66,17 +80,15 @@ The amount of unthrottled bandwidth included with the VPS depends on the server
66
80
| VPS-PRO-XXL | 1000 | 20 TB | 10 |
67
81
68
82
69
-
## What happens when I exceed my fair-use traffic?
83
+
###What happens when I exceed my fair-use traffic?
70
84
Your monthly fair-use traffic allowance includes all incoming and outgoing data. Each plan comes with a specified monthly data allocation.
71
85
If you exceed this limit, your connection speed will be reduced for the remainder of the billing cycle, in accordance with your plan's terms.
72
86
The speed of your connection will return to normal at the start of the next billing cycle when your data allocation resets.
73
87
74
-
## How can I send email from my Dedibox VPS?
75
-
For security reasons the SMTP ports of your Dedibox VPS are blocked and it is not possible to send email from your virtual machine.
88
+
## Usage and management
76
89
77
-
## How secure is a Dedibox VPS?
78
-
Each Dedibox VPS is isolated from other virtual servers on the same host, ensuring security. However, best security practices, including regular updates, strong passwords, and firewall configurations, are essential to enhance security further.
90
+
###How can I send email from my Dedibox VPS?
91
+
For security reasons, the SMTP ports of your Dedibox VPS are blocked, and it is not possible to send email from your virtual machine.
79
92
80
-
## Are IP addresses for Dedibox VPS assigned statically?
81
-
IP addresses for Dedibox VPS are generally assigned statically. However, in rare cases, such as maintenance or replacement of a faulty host node, we may perform IP migrations, which can result in a change of IP address.
82
-
You can find your updated IP address in the Dedibox console. Please note that we do not currently notify users of such changes. You can contact our [Support team](https://console.online.net/en/assistance/commercial) if you experience any issues.
93
+
### How do I manage my Dedibox VPS?
94
+
You can manage your Dedibox VPS from the Dedibox console for administrative tasks such as restarting or reinstalling. For advanced users who prefer command-line interaction, you have full access as the root user via SSH.
We offer five ranges of Dedibox servers: **Start**, **Pro**, **Core**, **Store**, and **GPU**. Check the [Dedibox website](https://www.scaleway.com/en/dedibox/) to find detailed information on their specifications and discover the one that best fits your needs.
9
+
## Overview
11
10
12
-
## How long does it take to deliver my dedicated server?
11
+
###How long does it take to deliver my dedicated server?
13
12
The delivery of Dedibox dedicated servers is ultra-fast: 2 minutes on average. Next, choose your operating system in our library or install your ISO image directly. Any configuration displayed on our website is available in stock for instant delivery.
14
13
15
-
## Where are the Dedibox dedicated servers hosted?
16
-
All Dedibox servers and associated services are hosted in our Paris & Amsterdam data centers. We also have a Warsaw data center.
17
-
18
-
## Is my data secure?
14
+
### Is my data secure?
19
15
Scaleway does not have access to your data; however, you are responsible for your backups and the redundancy systems to be put in place to ensure continuity of service even in the event of hardware failure.
20
16
21
-
## I need help, who can I talk to?
22
-
When choosing your servers for your use case, you can contact our solution advisors [here](https://www.scaleway.com/en/contact/). For technical assistance on the configuration and use of your servers, our experts are at your disposal.
17
+
## Offering and availability
18
+
19
+
### Which dedicated server should I choose?
20
+
We offer five ranges of Dedibox servers: **Start**, **Pro**, **Core**, **Store**, and **GPU**. Check the [Dedibox website](https://www.scaleway.com/en/dedibox/) to find detailed information on their specifications and discover the one that best fits your needs.
21
+
22
+
### Where are the Dedibox dedicated servers hosted?
23
+
All Dedibox servers and associated services are hosted in our Paris and Amsterdam data centers. We also have a Warsaw data center.
23
24
24
-
## What is your policy regarding IP addresses?
25
+
###What is your policy regarding IP addresses?
25
26
Public IPv4 addresses have become a rare and expensive resource. Each dedicated server is provided with a public IPv4 address at no extra cost. Additional addresses are available for an additional charge with the “IP Failover” option.
26
27
27
-
## How is the price of my server calculated?
28
+
## Pricing and billing
29
+
30
+
### How is the price of my server calculated?
28
31
Our prices are updated daily based on demand, available stocks, and component and energy market prices. Some components, such as RAM memory and SSD disks, have high volatility. Do not worry, the price at the time of order is guaranteed for the first 12 months of your subscription.
29
32
30
-
## How long is my server contract?
33
+
###How long is my server contract?
31
34
Your server operates on a monthly contract, with the billing cycle running from the first to the last day of each month. When placing an order, you will be billed pro rata for the current month, unless you pay via SEPA direct debit. In that case, your first invoice will be issued during your first complete month and include both the pro rata amount for the current month and the full amount for the following month.
32
35
<Messagetype="note">
33
36
If you chose a commitment period during server creation, your contract will have a fixed duration of 12 or 36 months, depending on your selected option.
34
37
</Message>
35
38
36
-
## What are Dedibox commitment plans?
39
+
###What are Dedibox commitment plans?
37
40
A commitment plan allows you to commit to keeping your Dedibox for a period of 12 or 36 months. By choosing a commitment period, you benefit from lower monthly rent for your server and free setup, depending on the plan you choose.
38
41
39
-
## Can I benefit from a commitment plan on a server I'm already renting?
42
+
###Can I benefit from a commitment plan on a server I'm already renting?
40
43
Yes, in most cases, you can apply a commitment plan to a server you're already renting. To check your eligibility and choose a plan, go to your server in the Scaleway Dedibox console and click **Commitment** in the left-side menu.
41
44
42
-
## Will my server options also benefit from the discount?
45
+
###Will my server options also benefit from the discount?
43
46
No, the discount applies only to the Dedibox server.
44
47
45
-
## Is there an automatic renewal of the commitment?
48
+
###Is there an automatic renewal of the commitment?
46
49
Yes, by default, your commitment is renewed automatically at the end of the commitment period. You can disable the automatic renewal in your server's options.
47
50
48
-
## At the end of the commitment, what will the price for my Dedibox be?
51
+
###At the end of the commitment, what will the price for my Dedibox be?
49
52
At the end of the commitment, you will pay the standard price at the time of the subscription. Your commitment discount will no longer apply.
50
53
51
-
## Can I terminate a Dedibox during the commitment period?
54
+
###Can I terminate a Dedibox during the commitment period?
52
55
You can request termination at any time, but it will only be effective after the end of the commitment period. You will retain access to your server until the commitment period ends.
53
56
54
-
## Can I change the commitment period?
57
+
###Can I change the commitment period?
55
58
No, the commitment period cannot be changed after the subscription.
56
59
57
-
## Are there commitment plans for Elastic Metal or Dedibox VPS?
60
+
###Are there commitment plans for Elastic Metal or Dedibox VPS?
58
61
No, commitment plans are only available for eligible Dedibox dedicated servers.
59
62
60
-
## How much does a Windows Server license cost?
63
+
###How much does a Windows Server license cost?
61
64
62
65
Windows Server 2019 and 2022 licenses are billed monthly (no prorating) based on the following factors:
63
66
- Number of physical CPUs
64
67
- Number of cores per CPU
65
68
- Operating System version: Standard or Datacenter
66
69
67
-
Refer to the [Pricing page](https://www.scaleway.com/en/pricing/dedibox-options/#windows-licences) to learn about the current costs for Windows licenses.
70
+
Refer to the [Pricing page](https://www.scaleway.com/en/pricing/dedibox-options/#windows-licences) to learn about the current costs for Windows licenses.
71
+
72
+
## Support and troubleshooting
73
+
74
+
### I need help, who can I talk to?
75
+
When choosing your servers for your use case, you can contact our solution advisors [here](https://www.scaleway.com/en/contact/). For technical assistance on the configuration and use of your servers, our experts are at your disposal.
0 commit comments