RunEngine WIP

[matt-aitken]

Merging this partial RunEngine because it has some useful work and shouldn't impact the live product as the engine isn't being used anywhere yet.

• @trigger.dev/database package moved into internal-packages
• emails package moved into internal-packages
• testcontainers package is useful for writing tests with Postgres and Redis
• zod-worker extracts the ZodWorker from the webapp
• redis-worker is a worker for internal jobs built on top of Redis

Partial work on the RunEngine

• RunQueue, a modified port of MARQS with built-in concurrency tracking and some improvements to idempotency

[changeset-bot]

⚠️ No Changeset found

Latest commit: 2664c1d

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

💥 An error occurred when fetching the changed packages and changesets in this PR

Some errors occurred when validating the changesets config:
The package "@internal/run-engine" depends on the ignored package "@trigger.dev/database", but "@internal/run-engine" is not being ignored. Please add "@internal/run-engine" to the `ignore` option.
The package "@internal/testcontainers" depends on the ignored package "@trigger.dev/database", but "@internal/testcontainers" is not being ignored. Please add "@internal/testcontainers" to the `ignore` option.
The package "@internal/zod-worker" depends on the ignored package "@trigger.dev/database", but "@internal/zod-worker" is not being ignored. Please add "@internal/zod-worker" to the `ignore` option.

[matt-aitken]

Closing this in favour of a PR without the partial run engine work