Skip to content

Commit 4bbd99c

Browse files
authored
Merge pull request #309 from ldbc/include-same-day-changes-in-batches
Do not filter out entities inserted and deletes in the same batch
2 parents b2ee74d + 90a8a4f commit 4bbd99c

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

src/main/scala/ldbc/snb/datagen/transformation/transform/RawToBiTransform.scala

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,6 @@ case class RawToBiTransform(mode: BI, simulationStart: Long, simulationEnd: Long
3636
batch_id($"creationDate").as("insert_batch_id"),
3737
batch_id($"deletionDate").as("delete_batch_id")
3838
): _*)
39-
.filter($"insert_batch_id" =!= $"delete_batch_id")
4039

4140
val insertBatchPart = (tpe: EntityType, df: DataFrame, batchStart: Long, batchEnd: Long) => {
4241
df

0 commit comments

Comments
 (0)