Decision Engine integration test

⚠️ (Work in progress) ⚠️

Decision Engine installation

VM setup (FermiCloud)

On FermiCloud setup your VM and make sure to include in your setup "gwms-ports" Security Group. This will allow GlideinWMS to work properly with your VM. In case you already have a VM to repurpose for DE, the Security Group can still be added to an existing VM.

Decision Engine installation

The general installation guide for Decision Engine is available here.

Install and configure Decision Engine to run the integration test.

Below there are instructions to install and configure Decision Engine to run the integration test.

Decision engine uses a PostgreSQL database back-end and Redis as message broker and cache.

You need to install first PostgreSQL, Redis, and then the Decision engine framework (decisionengine) and install and add the standard channels (decisionengine_modules).

The following instructions assume a system installation, performed as root. decisionengine will run as the decisionengine user.

Install PostgreSQL

The default postgresql installed on RH7 is 9.2 which is outdated. Suggest to remove it and install 12 instead :

1. Remove old postgresql

yum erase -y postgresql*

2. Install postgresql 12

yum install -y https://download.postgresql.org/pub/repos/yum/reporpms/EL-7-x86_64/pgdg-redhat-repo-latest.noarch.rpm
yum install -y postgresql12 postgresql12-server
# optional, also: postgresql11-devel

3. Enable postgresql

systemctl enable postgresql-12

4. Init the database

/usr/pgsql-12/bin/postgresql-12-setup initdb

5. edit /var/lib/pgsql/12/data/pg_hba.conf like the following:

[root@fermicloud371 ~]# diff  /var/lib/pgsql/12/data/pg_hba.conf~ /var/lib/pgsql/12/data/pg_hba.conf
80c80
< local   all             all                                     peer
---
> local   all             all                                     trust
82c82
< host    all             all             127.0.0.1/32            ident
---
> host    all             all             127.0.0.1/32            trust
84c84
< host    all             all             ::1/128                 ident
---
> host    all             all             ::1/128                 trust

This is setting the authentication method to trust.

6. start the database

systemctl start postgresql-12

7. create decisionengine

createdb -U postgres decisionengine

The schema and the connection will be created and configured during the Decision engine framework installation.

To use the database you have to add it to the environment

export PG_VERSION=12
export PATH="/usr/pgsql-${PG_VERSION}/bin:~/.local/bin:$PATH"

Install Decision Engine prerequisites

1. Prerequisites setup. Make sure that the required yum repositories and some required packages (python3, gcc, ...) are installed and up to date.

yum install -y http://ftp.scientificlinux.org/linux/scientific/7x/repos/x86_64/yum-conf-softwarecollections-2.0-1.el7.noarch.rpm
yum install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
# gcc, swig and make are needed for dependencies (jsonnet)
yum -y install python3 python3-pip python3-setuptools python3-wheel \
    gcc gcc-c++ make \
    python3-devel swig openssl-devel git rpm-build
python3 -m pip install --upgrade --user pip
python3 -m pip install --upgrade --user setuptools wheel setuptools-scm[toml]

# To install the modules you will also need GlideinWMS Frontend, which is in the OSG repository.
# Assuming the use of OSG 3.5 that supports both GSI and tokens, here is a brief summary of the setup:
yum install -y yum-priorities
yum install -y https://repo.opensciencegrid.org/osg/3.5/osg-3.5-el7-release-latest.rpm
# HTCondor 8.9.x or 9.x, required by GlideinWMS, is in the osg-upcoming repository. It should be enabled to find the dependency
# GlideinWMS 3.9.x is in osg-contrib. The repository should be enabled to find the dependency
# In both the following files set: enabled=1
vi /etc/yum.repos.d/osg-upcoming.repo
vi /etc/yum.repos.d/osg-contrib.repo
# Change the Epel repository priority to make sure that comes after the OSG repositories, which are 98. Make sure that epel has:
priority=99
vi /etc/yum.repos.d/epel.repo

The complete version of the GlideinWMS installation instructions is available here

A minimal GlideinWMS installation for Decision Engine is the following:

yum --enablerepo=osg-development -y install glideinwms-vofrontend-libs glideinwms-vofrontend-glidein \
    voms-clients-cpp osg-ca-certs fetch-crl vo-client glideinwms-minimal-condor glideinwms-userschedd \
    glideinwms-usercollector glideinwms-vofrontend-core glideinwms-vofrontend-httpd httpd globus-proxy-utils

Install other utilities

yum -y install fermilab-util_kx509

Install Redis

Install and start the message broker (Redis) as pod container.

yum install podman
podman run --name decisionengine-redis -p 127.0.0.1:6379:6379 -d redis:6 --loglevel warning

More details about Redis are available in this redis document.

Install Decision Engine and the standard modules

(Following instructions are for Decision Engine 2.0 pre-release)

Decision Engine RPMs are made available as release assets in GitHub.

• Decision Engine release assets.
• Decision Engine modules release assets

RPMs for Decision Engine 2.0 pre-release:

• Decision Engine RPM is available here
• Decision Engine modules RPM is available here

Install Decision Engine RPMs

yum -y install decisionengine-* decisionengine_modules-*