✨ Is2392/api project version control (ITISFoundation#2529)

* updates tables diagram

* new vc tables

* migration script for new projects_version_control tables

* review @sanderegg: removed unused file

* new utils-aiohttp helpers module

* updates snapshots app module

* adds ORMs in meta-db

* creating repo api handlers

* implements repo API handlers

* fixes bad rebase after PR ITISFoundation#2519

* removed meta_models.py

* separated also snapshots handler tests

* moved openapi_specs fixture to root conftest.py

* ORM supports pagination

* Implements get repos handler

* Normalized handlers

* prepared tests

* strict markers

* adapting handlers implementation to new core signatures

* fixes on utils_aiopg

* implemented update

* Added fixture to emulate user modifying the project

* test meta core passes

* activate snapshot handlers

* adjusts OAS for project/snapshots

* Fixes snapshots tests

* fixing checkpoints handlers

* Removes pydantic dependency

* Implements get_snapshot_contents

* updates precommit config

* Handles not-implemented errors

* fixing meta handlers

* removed wrong constraints

* fixing meta handlers tests

* webserver api version 0.6.0 → 0.7.0

* improved error handling

* changes ondelete in projcts_vc and add migration script

* fixes project deletion

* Adds echo statments for testing

* adds workbench in fixture and fixes view

* @sanderegg review: long options

* @sanderegg review: minor OAS

* @sanderegg review: set onupdate clauses and updated migration script for project_vc tables

* @sanderegg review: minor cleanup

* @GitHK review: cleanup, transations

* fixes handlers tests

* fixes aiopg_orm tests after changing page policy

* Fixes missing filter in fetch_page

* Renames meta by version_control

* Fixes dir_with_random_content fixture producing toolong paths

Author: pcrespov

.github/PULL_REQUEST_TEMPLATE.md

@@ -46,7 +46,8 @@ Add here YOUR checklist/notes to guide and monitor the progress of the case!
 
 e.g.
 
-- [ ] Did you change any service's API? Then make sure to bundle document and upgrade version (``make openapi-specs``, ``git commit ...`` and then ``make version-*``)
+- [ ] Openapi changes? ``make openapi-specs``, ``git commit ...`` and then ``make version-*``)
+- [ ] Database migration script? ``cd packages/postgres-database``, ``make setup-commit``, ``sc-pg review -m "my changes"``
 - [ ] Unit tests for the changes exist
 - [ ] Runs in the swarm
 - [ ] Documentation reflects the changes

.pre-commit-config.yaml

@@ -17,6 +17,6 @@ repos:
     hooks:
       - id: isort
   - repo: https://github.com/psf/black
-    rev: 20.8b1
+    rev: 21.7b0
     hooks:
       - id: black

Makefile

@@ -537,7 +537,7 @@ endif
 
 .PHONY: clean clean-images clean-venv clean-all clean-more
 
-_git_clean_args := -dxf -e .vscode -e TODO.md -e .venv -e .python-version
+_git_clean_args := -dx --force --exclude=.vscode --exclude=TODO.md --exclude=.venv --exclude=.python-version --exclude=*keep*
 _running_containers = $(shell docker ps -aq)
 
 .check-clean:

api/specs/webserver/openapi-projects.yaml

@@ -443,7 +443,7 @@ paths:
         - snapshot
       summary: List Snapshots
       description: Lists all snapshots taken from a given project
-      operationId: simcore_service_webserver.repos_snapshots_api_handlers.list_snapshots
+      operationId: simcore_service_webserver.version_control_handlers_snapshots.list_project_snapshots_handler
       parameters:
         - required: true
           schema:
@@ -482,7 +482,7 @@ paths:
                 title: Response List Snapshots Projects  Project Id  Snapshots Get
                 type: array
                 items:
-                  $ref: "#/components/schemas/SnapshotResource"
+                  $ref: "#/components/schemas/SnapshotItem"
         "422":
           description: Validation Error
           content:
@@ -495,7 +495,7 @@ paths:
         - snapshot
       summary: Create Snapshot
       description: Takes a snapshot of the project at this time
-      operationId: simcore_service_webserver.repos_snapshots_api_handlers.create_snapshot
+      operationId: simcore_service_webserver.version_control_handlers_snapshots.create_project_snapshot_handler
       parameters:
         - required: true
           schema:
@@ -516,7 +516,7 @@ paths:
           content:
             application/json:
               schema:
-                $ref: "#/components/schemas/SnapshotResource"
+                $ref: "#/components/schemas/SnapshotItem"
         "422":
           description: Validation Error
           content:
@@ -531,7 +531,7 @@ paths:
         - snapshot
       summary: Get Snapshot
       description: Gets commit info for a given snapshot
-      operationId: simcore_service_webserver.repos_snapshots_api_handlers.get_snapshot
+      operationId: simcore_service_webserver.version_control_handlers_snapshots.get_project_snapshot_handler
       parameters:
         - required: true
           schema:
@@ -553,7 +553,7 @@ paths:
           content:
             application/json:
               schema:
-                $ref: "#/components/schemas/SnapshotResource"
+                $ref: "#/components/schemas/SnapshotItem"
         "422":
           description: Validation Error
           content:
@@ -566,7 +566,7 @@ paths:
         - snapshot
       summary: Delete Snapshot
       description: Deletes both the commit and the project itself
-      operationId: simcore_service_webserver.repos_snapshots_api_handlers.delete_snapshot
+      operationId: simcore_service_webserver.version_control_handlers_snapshots.delete_project_snapshot_handler
       parameters:
         - required: true
           schema:
@@ -597,7 +597,7 @@ paths:
         - snapshot
       summary: Update Snapshot
       description: Updates label/name of a snapshot
-      operationId: simcore_service_webserver.repos_snapshots_api_handlers.update_snapshot
+      operationId: simcore_service_webserver.version_control_handlers_snapshots.patch_project_snapshot_handler
       parameters:
         - required: true
           schema:
@@ -694,8 +694,8 @@ components:
           description: Unique human readable display name
       description: Model to patch a snapshot resource
 
-    SnapshotResource:
-      title: SnapshotResource
+    SnapshotItem:
+      title: SnapshotItem
       required:
         - parent_uuid
         - project_uuid