Skip to content

Commit 77bc751

Browse files
feat: acceptance tests for for each tasks validation
1 parent 1e4193a commit 77bc751

File tree

15 files changed

+130
-0
lines changed

15 files changed

+130
-0
lines changed
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
bundle:
2+
name: "for_each_task_validation"
3+
4+
resources:
5+
jobs:
6+
test_job:
7+
name: "Test Job"
8+
tasks:
9+
- task_key: "parent_task"
10+
for_each_task:
11+
inputs: "[1, 2, 3]"
12+
task:
13+
task_key: "child_task"
14+
notebook_task:
15+
notebook_path: "test.py"
16+
max_retries: 3

acceptance/bundle/validate/for_each_task_max_retries/out.test.toml

Lines changed: 5 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
Error: Invalid max_retries configuration for for_each_task
2+
at resources.jobs.test_job.tasks[0]
3+
in databricks.yml:9:11
4+
5+
Task "parent_task" has max_retries defined at the parent level, but it uses for_each_task.
6+
When using for_each_task, max_retries must be defined on the nested task (for_each_task.task.max_retries), not on the parent task.
7+
8+
Name: for_each_task_validation
9+
Target: default
10+
Workspace:
11+
User: [USERNAME]
12+
Path: /Workspace/Users/[USERNAME]/.bundle/for_each_task_validation/default
13+
14+
Found 1 error
15+
16+
Exit code: 1
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
#!/bin/bash
2+
errcode $CLI bundle validate
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
# Databricks notebook source
2+
print("test")
Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
bundle:
2+
name: "for_each_task_validation"
3+
4+
resources:
5+
jobs:
6+
test_job:
7+
name: "Test Job"
8+
tasks:
9+
- task_key: "parent_task"
10+
for_each_task:
11+
inputs: "[1, 2, 3]"
12+
task:
13+
task_key: "child_task"
14+
notebook_task:
15+
notebook_path: "test.py"
16+
max_retries: 3
17+
min_retry_interval_millis: 1000
18+
retry_on_timeout: true

acceptance/bundle/validate/for_each_task_retry_fields/out.test.toml

Lines changed: 5 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
Error: Invalid max_retries configuration for for_each_task
2+
at resources.jobs.test_job.tasks[0]
3+
in databricks.yml:9:11
4+
5+
Task "parent_task" has max_retries defined at the parent level, but it uses for_each_task.
6+
When using for_each_task, max_retries must be defined on the nested task (for_each_task.task.max_retries), not on the parent task.
7+
8+
Warning: Invalid min_retry_interval_millis configuration for for_each_task
9+
at resources.jobs.test_job.tasks[0]
10+
in databricks.yml:9:11
11+
12+
Task "parent_task" has min_retry_interval_millis defined at the parent level, but it uses for_each_task.
13+
When using for_each_task, min_retry_interval_millis must be defined on the nested task (for_each_task.task.min_retry_interval_millis), not on the parent task.
14+
15+
Warning: Invalid retry_on_timeout configuration for for_each_task
16+
at resources.jobs.test_job.tasks[0]
17+
in databricks.yml:9:11
18+
19+
Task "parent_task" has retry_on_timeout defined at the parent level, but it uses for_each_task.
20+
When using for_each_task, retry_on_timeout must be defined on the nested task (for_each_task.task.retry_on_timeout), not on the parent task.
21+
22+
Name: for_each_task_validation
23+
Target: default
24+
Workspace:
25+
User: [USERNAME]
26+
Path: /Workspace/Users/[USERNAME]/.bundle/for_each_task_validation/default
27+
28+
Found 1 error and 2 warnings
29+
30+
Exit code: 1
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
#!/bin/bash
2+
errcode $CLI bundle validate
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
# Databricks notebook source
2+
print("test")

0 commit comments

Comments
 (0)