Skip to content

Commit 2c22b18

Browse files
authored
Platform: DAG options (#355)
1 parent d4496da commit 2c22b18

File tree

1 file changed

+32
-5
lines changed

1 file changed

+32
-5
lines changed

platform/workflows.mdx

Lines changed: 32 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -245,12 +245,39 @@ There are two ways to create a custom workflow:
245245
- Checking this box reprocesses all documents in the source location on every workflow run.
246246
- Unchecking this box causes only new documents that are added to the source location since the last workflow run to be processed on future runs. Previously processed documents are not processed again, even if those documents' contents change.
247247

248-
8. In the pipeline designer, click the **Source** node. In the **Source** pane, select the source location. Then click **Save**.
248+
8. The workflow begins with the following layout:
249+
250+
251+
```mermaid
252+
flowchart LR
253+
Source-->Partitioner-->Destination
254+
```
255+
256+
The following workflow layouts are also valid:
257+
258+
```mermaid
259+
flowchart LR
260+
Source-->Partitioner-->Chunker-->Destination
261+
```
262+
```mermaid
263+
flowchart LR
264+
Source-->Partitioner-->Chunker-->Embedder-->Destination
265+
```
266+
```mermaid
267+
flowchart LR
268+
Source-->Partitioner-->Enrichment-->Chunker-->Destination
269+
```
270+
```mermaid
271+
flowchart LR
272+
Source-->Partitioner-->Enrichment-->Chunker-->Embedder-->Destination
273+
```
274+
275+
9. In the pipeline designer, click the **Source** node. In the **Source** pane, select the source location. Then click **Save**.
249276

250277
![Workflow designer](/img/platform/Workflow-Designer.png)
251278

252-
9. Click the **Destination** node. In the **Destination** pane, select the destination location. Then click **Save**.
253-
10. As needed, add more nodes by clicking the plus icon (recommended) or **Add Node** button:
279+
10. Click the **Destination** node. In the **Destination** pane, select the destination location. Then click **Save**.
280+
11. As needed, add more nodes by clicking the plus icon (recommended) or **Add Node** button:
254281

255282
![Add node to workflow](/img/platform/Workflow-Add-Node.png)
256283

@@ -269,8 +296,8 @@ There are two ways to create a custom workflow:
269296

270297
To delete a node, click that node, and then click the trash can icon above it.
271298

272-
11. Click **Save**.
273-
12. If you did not set the workflow to run on a schedule, you can [run the worklow](#edit-delete-or-run-a-workflow) now.
299+
12. Click **Save**.
300+
13. If you did not set the workflow to run on a schedule, you can [run the worklow](#edit-delete-or-run-a-workflow) now.
274301

275302
#### Custom workflow node types
276303

0 commit comments

Comments
 (0)