Skip to content

Commit b07bc1f

Browse files
authored
Merge pull request #210162 from v-lanjli/addsettings_notebooksettings/master
add settings properties
2 parents e48f519 + 3217233 commit b07bc1f

File tree

2 files changed

+13
-2
lines changed

2 files changed

+13
-2
lines changed
1.98 KB
Loading

articles/synapse-analytics/synapse-notebook-activity.md

Lines changed: 13 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,9 +27,20 @@ You can create a Synapse notebook activity directly from the Synapse pipeline ca
2727

2828
Drag and drop **Synapse notebook** under **Activities** onto the Synapse pipeline canvas. Select on the Synapse notebook activity box and config the notebook content for current activity in the **settings**. You can select an existing notebook from the current workspace or add a new one.
2929

30-
You can also select an Apache Spark pool in the settings. It should be noted that the Apache spark pool set here will replace the Apache spark pool used in the notebook. If Apache spark pool is not selected in the settings of notebook content for current activity, the Apache spark pool selected in that notebook will be used to run.
30+
(Optional) You can also reconfigure Spark pool\Executor size\Dynamically allocate executors\Min executors\Max executors\Driver size in settings. It should be noted that the settings reconfigured here will replace the settings of the configure session in Notebook. If nothing is set in the settings of the current notebook activity, it will run with the settings of the configure session in that notebook.
3131

32-
![screenshot-showing-create-notebook-activity](./media/synapse-notebook-activity/create-synapse-notebook-activity.png)
32+
> [!div class="mx-imgBorder"]
33+
> ![screenshot-showing-create-notebook-activity](./media/synapse-notebook-activity/create-synapse-notebook-activity.png)
34+
35+
36+
| Property | Description | Required |
37+
| ----- | ----- | ----- |
38+
|Spark pool| Reference to the Spark pool. You can select Apache Spark pool from the list. If this setting is empty, it will run in the spark pool of the notebook itself.| No |
39+
|Executor size| Number of cores and memory to be used for executors allocated in the specified Apache Spark pool for the session.| No |
40+
|Dynamically allocate executors| This setting maps to the dynamic allocation property in Spark configuration for Spark Application executors allocation.| No |
41+
|Min executors| Min number of executors to be allocated in the specified Spark pool for the job.| No |
42+
|Max executors| Max number of executors to be allocated in the specified Spark pool for the job.| No |
43+
|Driver size| Number of cores and memory to be used for driver given in the specified Apache Spark pool for the job.| No |
3344

3445
> [!NOTE]
3546
> The execution of parallel Spark Notebooks in Azure Synapse pipelines be queued and executed in a FIFO manner, jobs order in the queue is according to the time sequence, the expire time of a job in the queue is 3 days, please notice that queue for notebook only work in synapse pipeline.

0 commit comments

Comments
 (0)