Skip to content

Commit 3ffbdce

Browse files
authored
Merge pull request #92445 from kromerm/dataflow-1
Dataflow 1
2 parents 3005d9c + 746a481 commit 3ffbdce

File tree

5 files changed

+16
-1
lines changed

5 files changed

+16
-1
lines changed

articles/data-factory/data-flow-lookup.md

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,20 @@ The Lookup transformation performs the equivalent of a left outer join. So, you'
2424

2525
After your Lookup transformation, you can use subsequent transformations to inspect the results of each match row by using the expression function `isMatch()` to make further choices in your logic based on whether or not the Lookup resulted in a row match or not.
2626

27+
![Lookup pattern](media/data-flow/lookup111.png "Lookup pattern")
28+
29+
After you use the Lookup transformation, you can add a Conditional Split transformation splitting on the ```isMatch()``` function. In the example above, matching rows go through the top stream and non-matching rows flow through the ```NoMatch``` stream.
30+
31+
## First or last value
32+
33+
When you have multiple matches from your Lookup, you may want to reduce the multiple matched rows by picking either the first or the last match. You can do this using an Aggregate transformation after your Lookup.
34+
35+
In this case, an Aggregate transformation called ```PickFirst``` is used to pick the first value from the lookup matches.
36+
37+
![Lookup aggregate](media/data-flow/lookup333.png "Lookup aggregate")
38+
39+
![Lookup first](media/data-flow/lookup444.png "Lookup first")
40+
2741
## Optimizations
2842

2943
In Data Factory, Data Flows execute in scaled-out Spark environments. If your dataset can fit into worker node memory space, we can optimize your Lookup performance.
@@ -40,4 +54,5 @@ You can also specify partitioning of your data by selecting "Set Partitioning" o
4054

4155
## Next steps
4256

43-
[Join](data-flow-join.md) and [Exists](data-flow-exists.md) transformations perform similar tasks in ADF mapping data flows. Take a look at those transformations next.
57+
* [Join](data-flow-join.md) and [Exists](data-flow-exists.md) transformations perform similar tasks in ADF mapping data flows. Take a look at those transformations next.
58+
* Use a [Conditional Split](data-flow-conditional-split.md) with ```isMatch()``` to split rows on matching and non-matching values
49.7 KB
Loading
56.4 KB
Loading
14.1 KB
Loading
46.1 KB
Loading

0 commit comments

Comments
 (0)