Skip to content

Commit b878d6a

Browse files
authored
Report how many Partition-Ranges out of the configured numParts passed or failed. (#376)
* Added feature to track & report partition failures in metrics logs * Updated release notes * Fixed performance test asserts to use the right count of partition-ranges
1 parent 98a1e3e commit b878d6a

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

46 files changed

+109
-13
lines changed

RELEASE.md

Lines changed: 3 additions & 0 deletions

SIT/features/01_constant_column/cdm.fixData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 1
66
Valid Record Count: 1
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

SIT/features/01_constant_column/cdm.migrateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,5 @@ Read Record Count: 3
22
Skipped Record Count: 0
33
Write Record Count: 3
44
Error Record Count: 0
5+
Partitions Passed: 1
6+
Partitions Failed: 0

SIT/features/01_constant_column/cdm.validateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 0
66
Valid Record Count: 3
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

SIT/features/02_explode_map/cdm.fixData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 5
66
Valid Record Count: 5
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

SIT/features/02_explode_map/cdm.migrateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,5 @@ Read Record Count: 3
22
Skipped Record Count: 0
33
Write Record Count: 12
44
Error Record Count: 0
5+
Partitions Passed: 1
6+
Partitions Failed: 0

SIT/features/02_explode_map/cdm.validateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 0
66
Valid Record Count: 12
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

SIT/features/03_codec/cdm.fixData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 1
66
Valid Record Count: 1
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

SIT/features/03_codec/cdm.migrateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,3 +2,5 @@ Read Record Count: 3
22
Skipped Record Count: 0
33
Write Record Count: 3
44
Error Record Count: 0
5+
Partitions Passed: 1
6+
Partitions Failed: 0

SIT/features/03_codec/cdm.validateData.assert

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ Corrected Missing Record Count: 0
66
Valid Record Count: 3
77
Skipped Record Count: 0
88
Error Record Count: 0
9+
Partitions Passed: 1
10+
Partitions Failed: 0

0 commit comments

Comments
 (0)