Skip to content

Commit 13cbaae

Browse files
committed
docs(dlb): update
1 parent 7e3785f commit 13cbaae

File tree

1 file changed

+45
-7
lines changed

1 file changed

+45
-7
lines changed

faq/data-lab.mdx

Lines changed: 45 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -5,27 +5,65 @@ meta:
55
content:
66
h1: Distributed Data Lab FAQ
77
dates:
8-
validation: 2025-02-06
8+
validation: 2025-02-18
99
category: managed-services
1010
productIcon: DistributedDataLabProductIcon
1111
---
1212

13-
## What is Apache Spark?
13+
## General
14+
15+
### What workloads is Distributed Data Lab suited for?
16+
17+
Distributed Data Lab supports a range of workloads, including:
18+
19+
- Complex analytics.
20+
- Machine learning tasks.
21+
- High-speed operations on large datasets.
22+
23+
It offers scalable CPU and GPU instances with flexible node limits, and robust Apache Spark library support.
24+
25+
### What is Apache Spark?
1426

1527
Apache Spark is an open-source unified analytics engine designed for large-scale data processing. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance. Spark offers high-level APIs in Java, Scala, Python, and R, and an optimized engine that supports general execution graphs.
1628

17-
## How does Apache Spark work?
29+
### How does Apache Spark work?
1830

1931
Apache Spark processes data in memory, which allows it to perform tasks up to 100 times faster than traditional disk-based processing frameworks like [Hadoop MapReduce](https://fr.wikipedia.org/wiki/MapReduce). It uses Resilient Distributed Datasets (RDDs) to store data across multiple nodes in a cluster and perform parallel operations on this data.
2032

21-
## How am I billed for Distributed Data Lab?
33+
### How am I billed for Distributed Data Lab?
2234

2335
Distributed Data Lab is billed based on two factors:
2436
- the main node configuration selected
2537
- the worker node configuration selected, and the number of worker nodes in the cluster
2638

27-
## Can I upscale or downscale a Distributed Data Lab?
39+
## Clusters
40+
41+
### Can I upscale or downscale a Distributed Data Lab?
42+
43+
Yes, you can upscale a Data Lab cluster to distribute your workloads across more worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context.
44+
45+
You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculation. You can resume the activity of your cluster by provisioning at least one worker node.
46+
47+
### Can I run a Distributed Data Lab using GPUs?
48+
49+
Yes, you can run your cluster on either CPUs or GPUs. Scaleway leverages Nvidia's RAPIDS Accelerator For Apache Spark, an open-source suite of software libraries and APIs to execute end-to-end data science and analytics pipelines entirely on GPUs. This technology allows for significant acceleration of data processing tasks compared to CPU-based processing.
50+
51+
## Storage
52+
53+
### What data source options are available?
54+
55+
Data Lab natively integrates with Scaleway Object Storage for reading and writing data, making it easy to process data directly from your buckets. Your buckets are accessible using the Scaleway Console, or any other Amazon S3-compatible CLI tool.
56+
57+
### Can I connect to S3 buckets from other cloud providers?
58+
59+
Currently, connections are limited to Scaleway's Object Storage environment.
60+
61+
## Notebook
62+
63+
### What notebook is included with Dedicated Data Labs?
64+
65+
The service provides a JupyterLab notebook running on a dedicated CPU instance, fully integrated with the Apache Spark cluster for seamless data processing and calculations.
2866

29-
Yes, you can upscale a Data Lab cluster to distribute your workloads across a greater number of worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context.
67+
### Can I connect my local JupyterLab to the Data Lab?
3068

31-
You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculation. You can resume the activity of your cluster by provisioning at least one worker node.
69+
Remote connections to a Data Lab cluster are currently not supported.

0 commit comments

Comments
 (0)