Handle Dagster incremental partitions

[gtauzin]

Description

While DagsterPartitionedDataset expands Kedro's PartitionedDataset to fan out one node per partittion, there's no equivalent for Kedro's IncrementalDataset.

Context

This could be useful in Dagster along with a sensor to process new partitions only as soon as they are detected.

Possible Implementation

Implement a DagsterIncrementalDataset.

Possible Alternatives

It is closely related to Dagster's backfils logic but it seems to me it mostly makes sense for asset jobs. It is worth looking into it.