INIT

Author: codekuu

.gitignore

@@ -0,0 +1,3 @@
+tdws.json
+/tdws
+tdws-storage

README.md

@@ -0,0 +1,37 @@
+# Temporal.io Dynamic Worker Spawner (TDWS)
+
+Temporal.io Dynamic Worker Spawner (TDWS) is a temporal worker that downloads workflows and activities from a remote git repository and loads them into the worker.
+
+## Content
+
+- [Reason for TDWS](#reason-for-tdws)
+- [How it works](#how-it-works)
+- [Configuration](#configuration)
+- [Build a module](#build-a-module)
+- [Build the TDWS binary](#build-the-tdws-binary)
+
+## Reason for TDWS
+
+We wanted a tool that could spawn a worker but use different workflows and activities based on the environment.
+Since this would require us to write a separate worker for each environment, we decided to write a tool that could spawn a worker and download the workflows and activities from a remote git repository, convert them into plugins and then load them into the worker.
+
+## How it works
+
+1. TDWS is started with a configuration file that contains the "modules" that the worker should load. A module is a git repository that contains workflows and activities. (If you don't have a git repository, you can place the modules in the storage directory that is specified in the configuration file (default is ./tdws-storage))
+2. TDWS clones the git repository and builds a plugin out of main.go in the repository.
+3. TDWS loads the plugin and calls the TdwsRegister function with the worker as an argument.
+4. The TdwsRegister function registers the workflows and activities with the worker.
+5. TDWS then starts the worker.
+
+## Configuration
+
+TDWS is configured using a configuration file. The configuration file is a json file called tdws.json, but this can be set using the TDWS_CONFIG_FILE environment variable.
+See [config.go](internal/config/config.go) for the configuration struct.
+
+## Build a module
+
+See [tdws-demo-module-go](https://github.com/codekuu/tdws-demo-module-go) for example and information.
+
+## Build the TDWS binary (Will be provided in each release in the future)
+
+`go build -o tdws cmd/tdws/main.go`

cmd/tdws/main.go

@@ -0,0 +1,18 @@
+package main
+
+import (
+	"github.com/codekuu/tdws/internal/config"
+	"github.com/codekuu/tdws/internal/download"
+	"github.com/codekuu/tdws/internal/workers"
+)
+
+func main() {
+	// Load the configuration
+	cfg := config.LoadConfig()
+
+	// Download the Workflows and Activities
+	download.WorkflowsActivities(cfg)
+
+	// Start the workers
+	workers.Start(cfg)
+}

go.mod

@@ -0,0 +1,58 @@
+module github.com/codekuu/tdws
+
+go 1.22.2
+
+require (
+	github.com/go-git/go-git/v5 v5.12.0
+	github.com/rs/zerolog v1.33.0
+	go.temporal.io/sdk v1.28.1
+)
+
+require (
+	dario.cat/mergo v1.0.0 // indirect
+	github.com/Microsoft/go-winio v0.6.1 // indirect
+	github.com/ProtonMail/go-crypto v1.0.0 // indirect
+	github.com/cloudflare/circl v1.3.7 // indirect
+	github.com/cyphar/filepath-securejoin v0.2.4 // indirect
+	github.com/davecgh/go-spew v1.1.1 // indirect
+	github.com/emirpasic/gods v1.18.1 // indirect
+	github.com/facebookgo/clock v0.0.0-20150410010913-600d898af40a // indirect
+	github.com/go-git/gcfg v1.5.1-0.20230307220236-3a3c6141e376 // indirect
+	github.com/go-git/go-billy/v5 v5.5.0 // indirect
+	github.com/gogo/protobuf v1.3.2 // indirect
+	github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
+	github.com/golang/mock v1.6.0 // indirect
+	github.com/google/uuid v1.6.0 // indirect
+	github.com/grpc-ecosystem/go-grpc-middleware v1.4.0 // indirect
+	github.com/grpc-ecosystem/grpc-gateway/v2 v2.20.0 // indirect
+	github.com/jbenet/go-context v0.0.0-20150711004518-d14ea06fba99 // indirect
+	github.com/kevinburke/ssh_config v1.2.0 // indirect
+	github.com/mattn/go-colorable v0.1.13 // indirect
+	github.com/mattn/go-isatty v0.0.19 // indirect
+	github.com/nexus-rpc/sdk-go v0.0.9 // indirect
+	github.com/pborman/uuid v1.2.1 // indirect
+	github.com/pjbgf/sha1cd v0.3.0 // indirect
+	github.com/pmezard/go-difflib v1.0.0 // indirect
+	github.com/robfig/cron v1.2.0 // indirect
+	github.com/sergi/go-diff v1.3.2-0.20230802210424-5b0b94c5c0d3 // indirect
+	github.com/skeema/knownhosts v1.2.2 // indirect
+	github.com/stretchr/objx v0.5.2 // indirect
+	github.com/stretchr/testify v1.9.0 // indirect
+	github.com/xanzy/ssh-agent v0.3.3 // indirect
+	go.temporal.io/api v1.36.0 // indirect
+	golang.org/x/crypto v0.25.0 // indirect
+	golang.org/x/exp v0.0.0-20231127185646-65229373498e // indirect
+	golang.org/x/mod v0.17.0 // indirect
+	golang.org/x/net v0.27.0 // indirect
+	golang.org/x/sync v0.7.0 // indirect
+	golang.org/x/sys v0.22.0 // indirect
+	golang.org/x/text v0.16.0 // indirect
+	golang.org/x/time v0.3.0 // indirect
+	golang.org/x/tools v0.21.1-0.20240508182429-e35e4ccd0d2d // indirect
+	google.golang.org/genproto/googleapis/api v0.0.0-20240711142825-46eb208f015d // indirect
+	google.golang.org/genproto/googleapis/rpc v0.0.0-20240711142825-46eb208f015d // indirect
+	google.golang.org/grpc v1.65.0 // indirect
+	google.golang.org/protobuf v1.34.2 // indirect
+	gopkg.in/warnings.v0 v0.1.2 // indirect
+	gopkg.in/yaml.v3 v3.0.1 // indirect
+)