Skip to content

Incremental Upload Process is Confusing When Multiple Files of the Same Data Type Are Involved #79

Description

@forus

Definition of Same Data Type

Two or more meta files are considered the same data type if they share both the genetic_alteration_type and datatype attributes.

Common Scenario

A typical use case involves timeline data distributed across multiple files, with each file corresponding to a different event type. While the event type is not part of the data type definition, it is treated similarly to patient clinical attributes (e.g., gender) in the incremental upload process.

Problem with Current Incremental Upload Process

The incremental upload process runs a series of commands per file. As a result, the last uploaded file of a given data type can overwrite or remove data from previous files that share patients.

Proposed Fixes

A. Enable the possibility to upload multiple files at once for timeline data, instead of executing a separate Java command per file as it happens now.

B. Implement an error message when there is more than one data file of the same data type.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions