Remove celery from code and address tests, lint, typing

Signed-off-by: Federico Busetti <[email protected]>

Author: febus982

.idea/bootstrap-python-fastapi.iml

@@ -21,7 +21,7 @@ and [SOLID principles](https://en.wikipedia.org/wiki/SOLID).
 This template provides out of the box some commonly used functionalities:
 
 * API Documentation using [FastAPI](https://fastapi.tiangolo.com/)
-* Async tasks execution using [Celery](https://docs.celeryq.dev/en/stable/index.html)
+* Async tasks execution using [Dramatiq](https://dramatiq.io/index.html)
 * Repository pattern for databases using [SQLAlchemy](https://www.sqlalchemy.org/) and [SQLAlchemy bind manager](https://febus982.github.io/sqlalchemy-bind-manager/stable/)
 * Database migrations using [Alembic](https://alembic.sqlalchemy.org/en/latest/) (configured supporting both sync and async SQLAlchemy engines)
 * [TODO] Producer and consumer to emit and consume events using [CloudEvents](https://cloudevents.io/) format on [Confluent Kafka](https://docs.confluent.io/kafka-clients/python/current/overview.html)
@@ -44,7 +44,7 @@ Using Docker:
 * `make containers`: Build containers
 * `docker compose run --rm dev make migrate`: Run database migrations
 * `docker compose up dev`: Run HTTP application with hot reload
-* `docker compose up celery-worker`: Run the celery worker
+* `docker compose up dramatiq-worker`: Run the dramatiq worker
 * `docker compose run --rm test`: Run test suite
 
 Locally:

.idea/misc.xml

@@ -8,7 +8,7 @@ services:
   redis:
     image: redis
 
-  dramatiq:
+  dramatiq-worker:
     build:
       dockerfile: Dockerfile
       context: .
@@ -44,8 +44,6 @@ services:
       WATCHFILES_FORCE_POLLING: true
       OTEL_SERVICE_NAME: "bootstrap-fastapi-dev"
       OTEL_EXPORTER_OTLP_ENDPOINT: "http://otel-collector:4317"
-      CELERY__broker_url: "redis://redis:6379/0"
-      CELERY__result_backend: "redis://redis:6379/1"
     ports:
       - '8000:8000'
     working_dir: "/app/src"
@@ -77,8 +75,6 @@ services:
     environment:
       OTEL_SERVICE_NAME: "bootstrap-fastapi-http"
       OTEL_EXPORTER_OTLP_ENDPOINT: "http://otel-collector:4317"
-      CELERY__broker_url: "redis://redis:6379/0"
-      CELERY__result_backend: "redis://redis:6379/1"
     ports:
       - '8001:8000'
     volumes:

README.md

@@ -11,7 +11,7 @@ and the persistence layer.
 This is a high level list of the packages in this application template:
 
 * `alembic` (database migration manager)
-* `celery_worker` (async tasks runner)
+* `dramatiq_worker` (async tasks runner)
 * `common` (some common boilerplate initialisation shared by all applications )
 * `http_app` (http presentation layer)
 * `gateways` (database connection manager, repository implementation, event emitter, etc.)
@@ -31,7 +31,7 @@ This is a high level representation of the nested layers in the application:
 flowchart TD
     subgraph "Framework & Drivers + Interface Adapters" 
         alembic
-        celery_worker
+        dramatiq_worker
         http_app
         gateways
         subgraph domains.books["Use Cases"]
@@ -52,7 +52,7 @@ flowchart TD
     end
     
     alembic ~~~ domains.books
-    celery_worker ~~~ domains.books
+    dramatiq_worker ~~~ domains.books
     http_app ~~~ domains.books
     gateways ~~~ domains.books
     
@@ -69,7 +69,7 @@ A more detailed view showing the class dependencies and the absence of cyclical
 
 ```mermaid
 flowchart TD
-    celery_worker
+    dramatiq_worker
     http_app
     subgraph gateways
       SQLAlchemyRepository
@@ -99,8 +99,8 @@ flowchart TD
       end
     end
 
-    celery_worker-->domain_boundary
-    celery_worker-->dto
+    dramatiq_worker-->domain_boundary
+    dramatiq_worker-->dto
     http_app-->domain_boundary
     http_app-->dto
     domain_boundary-->domain_logic

docker-compose.yaml

@@ -61,22 +61,22 @@ flowchart TD
       http_builder-->http_app
     end
     
-    subgraph Celery
-      celery_builder["Celery builder
+    subgraph Dramatiq
+      dramatiq_builder["Dramatiq builder
           ============
           Installs requirements for
-          Celery worker in a virtualenv"]
-      celery_app["HTTP app
+          Dramatiq worker in a virtualenv"]
+      dramatiq_app["HTTP app
         ========
-        Copies Celery worker app,
+        Copies Dramatiq worker app,
         shared logic
         and requirements
         from previous containers"]
-      celery_builder-->celery_app
+      dramatiq_builder-->dramatiq_app
     end
     
     base_builder-->http_builder
-    base_builder-->celery_builder
+    base_builder-->dramatiq_builder
     base_app-->http_app
-    base_app-->celery_app
+    base_app-->dramatiq_app
 ```

docs/architecture.md

@@ -1,12 +1,12 @@
 # Bootstrap
 
 The `bootstrap` package contains logic that is shared among the external layer
-(i.e. `http_app`, `celery_worker`, etc.).
+(i.e. `http_app`, `dramatiq_worker`, etc.).
 
 It contains the following submodules and packages (and related responsibilities):
 
 * `bootstrap.bootstrap`: The application initialisation logic (database, logging,
-  celery tasks) necessary to run the domain logic. It uses `bootstrap.config` and
+  dramatiq tasks) necessary to run the domain logic. It uses `bootstrap.config` and
   `bootstrap.di_container` subpackages. It does not contain the specific HTTP
   framework initialisation (or other frameworks such as GRPC).
 * `bootstrap.config`: The application config models, based on `BaseSettings`

docs/dockerfile.md

@@ -43,6 +43,6 @@ and can be used to bootstrap the application:
   to bootstrap the SQLAlchemy imperative mapping in `bootstrap.storage.SQLAlchemy`
   package.
 * The `domains.book._service` contains the `BookService` implementation.
-* The `domains.book._tasks` contains the implementation of celery tasks
+* The `domains.book._tasks` contains the implementation of dramatiq tasks
   for operations that can be queued without waiting for a result (e.g.
   send an email, invalidate cache).

docs/packages/bootstrap.md

@@ -0,0 +1,3 @@
+# Dramatiq worker
+
+The `dramatiq_worker` package is a small entrypoint to run Dramatiq workers.