Refresh policy (automatic + manual)

[fgalan]

Automatic

Each FDA should have a refresh policy so the .parquet associated to a given baseQuery gets regenerated based on some criteria.

A possible criteria is scheduled (cron style). In the past we have used the node-schedule and we can have a look on how we did it.

This may involve a new field in the FDA object to specify how to do this refreshing.

Manual

In the API.md we have:

Regenerate FDA PUT /fdas/{fdaId}

Regenerate the FDA, fetching again the source table from DB.

Currently this operation is not implemented, but it should. I think is a good idea to have it so no matter the automatic policy we have, we can trigger a regeneration.

[fgalan]

Aditional consideration to take into account:

• How to parallelise or enqueue refresh operations in different FDAs (to not overload the server)
• Control that is a regeneration process on a given FDA is in progress no other process can be interfere with it

[JuanMartinP]

Manual refresh already working in version 0.1.0 with operation PUT /fdas/{fdaId}.

Pending automatic refresh.