Skip to content

atum checkpoint with additional properties #333

@salamonpavel

Description

@salamonpavel

Background

Checkpoints can carry extra information that would be really useful for further processing and data mining.

Goal

With each checkpoints a Map[String, String] could be saved, name checkpoint's additional properties holding any data useful for the user.

Optional features

Checkpoint labels - perhaps they could be implemented as checkpoint properties with no value. To consider.
Automatic properties - some properties can be "switched on" on AtumAgent level and automatically added to each checkpoint created. Like Spark application id.
Querying checkpoints based on properties

Sub-issues

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

Projects

Status

📋 Backlog

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions