Rethink the task management architecture

[tusmester]

Our task management architecture is built on console app agents and executors which is a bit too complicated to maintain and test. Rethink the architecture with the following points in mind:

• deployment: operators should be able to deploy the whole system or parts of it anywhere (on-prem, cloud)
• scalability: executing tasks should be scalable (being able to execute more tasks by adding more resources)
• progress indication: the current system is capable of providing real-time progress info during task execution. Keep that feature.
• logging: accessible executor and agent logs are essential.
• authentication: every element of the system should be able to work separately and connect to each other in a secure way.

Tech to check

• Azure functions in a hybrid environment
• Azure functions and SignalR?