[WIP] feat(deployment)!: Add spider scheduler to packaging.#4

Open

sitaowang1998 wants to merge 275 commits intojunhaoliao:docker-composefrom

sitaowang1998:spider-job-integration

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 30, 2025

refactor(config): Change custom_serialized_fields to a set and pass it directly to model_dump.
junhaoliao
committed
refactor(config): Use shared annotated Port type for port fields and drop custom port validators.
junhaoliao
committed
refactor(config): Consolidate host validation by introducing shared Host type and removing duplicated validators.
junhaoliao
committed
refactor(config): Introduce DatabaseEngine enum, use it for database.type and adjust serialization accordingly.
junhaoliao
committed
refactor(config): Replace manual non‑empty string validators with shared NonEmptyStr type.
junhaoliao
committed
refactor(config): Use PositiveFloat type for jobs_poll_delay fields in scheduler configs.
junhaoliao
committed
Refactor(config): Rename jobs_poll_delay to jobs_poll_delay_sec in scheduler configs and update references.
junhaoliao
committed
refactor(config): Replace int fields with PositiveInt and remove redundant validators.
junhaoliao
committed
refactor(config): Update optional string fields to use NonEmptyStr type.
junhaoliao
committed
docs(config): Update comment to specify specific types.
junhaoliao
committed
refactor(config): Use ZstdCompressionLevel for compression_level and remove its validator.
junhaoliao
committed
refactor(config): Replace string logging_level fields with LoggingLevel type and remove validation helpers.
junhaoliao
committed
revert jobs_poll_delay rename
junhaoliao
committed
Merge branch 'main' into pydantic-impf
junhaoliao
authored
Make ResultHandle an abstract class of the scheduler.
LinZhihao-723
committed
Rename class; Fix spider job
sitaowang1998
committed
Remove TODO
sitaowang1998
committed
Move and rename files and classes
sitaowang1998
committed
Fix lint
sitaowang1998
committed
Split the file
sitaowang1998
committed
Fix bug
sitaowang1998
committed
Bug fix
sitaowang1998
committed
Bug fix
sitaowang1998
committed
Merge branch 'spider-job-executor' into spider-job-scheduler
sitaowang1998
committed

Commits on Oct 3, 2025

Merge branch 'main' into spider-job-integration
sitaowang1998
committed

Commits on Oct 6, 2025

Add config
sitaowang1998
committed

Commits on Oct 9, 2025

Commits on Oct 10, 2025

Commits on Oct 14, 2025

Commits on Oct 15, 2025

Commits on Oct 17, 2025

Commits on Oct 18, 2025

Merge branch 'main' into bundle-mariadb
junhaoliao
authored

Commits on Oct 19, 2025

Commits on Oct 20, 2025

Commits on Oct 21, 2025

Commits on Oct 22, 2025

Commits on Oct 23, 2025

Commits on Oct 24, 2025

Commits on Oct 25, 2025

feat(log-converter): Add log-converter binary which converts unstructured text logs into KV-IR; Update log-surgeon to yscope/log-surgeon@840f262. (#1460)

authored

Commits on Oct 26, 2025

Commits on Oct 27, 2025

Commits on Oct 29, 2025

Commits on Oct 30, 2025

Commits on Oct 31, 2025

Commits on Nov 1, 2025

docs(clp-package): Rewrite S3 log compression guide to reflect new API and script features. (#1510)

authored

Commits on Nov 3, 2025

Commits on Nov 5, 2025

Commits on Nov 7, 2025

Commits on Nov 9, 2025

Commits on Nov 12, 2025

feat(webui): Reorganize layout of guided and freeform Presto UI. (#1578)
davemarco
authored

Commits on Nov 13, 2025

Commits on Nov 14, 2025

Commits on Nov 15, 2025