Albert Data Collections

Useful functionalities and pipelines related to ALBERT's data collections.

Installation

Create a virtual environment:

python -m venv venv
source venv/bin/activate

Install dependencies:

pip install -r pyproject.toml

Configuration

Create a .env file in the project root with the required environment variables. You can use the example file as a template:

cp .env.example .env

Then edit the .env file with your actual values.

Usage

Update collections dictionary Basic method:

python main.py update_collections_dict

Complete method:

source daily_update.sh

Automatic method (cron):

sudo -u USERNAME crontab cron_config.txt