Skip to content

source-object-nesting pipeline #529

@delucchi-cmu

Description

@delucchi-cmu

Similar to the old SOAP (source-object-association-pipeline), a pipeline that attempts to match source and object partitions up to create nested light curves.

Pipeline should be kind of an intersection of catalog import and SOAP principles:

  • do something similar to "soft soap" and find all source partitions with corresponding sources for all objects in the object partition
  • for the object partition, nest the sources it contains
  • if the object partition exceeds some threshold, split further
  • write parquet files
  • create catalog files.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions