-
Notifications
You must be signed in to change notification settings - Fork 15
Description
Context
Slack thread (customer + internal triage):
- https://web.clearfeed.app/collections/6077?account=fb6b8016-a0a7-4415-8d9d-36ffcf3d3e77&request=1879
- https://risingwave-labs.slack.com/archives/C0846L0TZDH/p1771343093899839?thread_ts=1771248224.078289&cid=C0846L0TZDH
- https://risingwave-labs.slack.com/archives/C0846L0TZDH/p1771523030870329?thread_ts=1771248224.078289&cid=C0846L0TZDH
Related change referenced in discussion:
Current docs pages involved:
- https://github.com/risingwavelabs/risingwave-docs/blob/main/operate/manage-a-large-number-of-streaming-jobs.mdx
- https://github.com/risingwavelabs/risingwave-docs/blob/main/deploy/k8s-cluster-scaling.mdx
Problem
Users are confused about whether they must manually update all existing MVs/streaming jobs when adopting newer recommended defaults (bounded(4) for source/table and bounded(64) system adaptive).
The current docs explain adaptive strategy and per-object ALTER commands, but do not clearly provide:
- A migration playbook for clusters that were created before the new defaults.
- SQL patterns to generate bulk ALTER statements for existing relations.
- A clear split between:
- settings that affect future jobs only, and
- per-relation changes required for existing jobs.
This gap leads to repeated support questions and inconsistent operational changes.
Suggested Fix
Add a dedicated note/section in operate/manage-a-large-number-of-streaming-jobs.mdx (and cross-link from deploy/k8s-cluster-scaling.mdx) titled something like Migrate to recommended parallelism defaults.
Include:
- Recommended defaults and scope
streaming_parallelism_strategy_for_source = 'BOUNDED(4)'streaming_parallelism_strategy_for_table = 'BOUNDED(4)'adaptive_parallelism_strategy = 'BOUNDED(64)'- Explicitly state these defaults affect newly created jobs (unless altered later).
- SQL to set system defaults for future jobs
ALTER SYSTEM SET streaming_parallelism_strategy_for_source = 'BOUNDED(4)';
ALTER SYSTEM SET streaming_parallelism_strategy_for_table = 'BOUNDED(4)';
ALTER SYSTEM SET adaptive_parallelism_strategy = 'BOUNDED(64)';- SQL patterns to migrate existing relations
- Show how to inspect current parallelism and generate ALTER statements for existing relations that deviate from target values.
- Provide separate examples for source/table vs other streaming jobs where appropriate.
- Keep examples safe and explicit (generate SQL first, review, then execute).
- Operational safety notes
- Recommend staged rollout and observation window.
- Call out actor-count/capacity checks before and after changes.
- Clarify there is no single switch that force-updates all existing jobs without per-relation ALTER.
- Version-awareness note
- Mention that clusters on older versions may not have these defaults and should follow migration guidance.
This should reduce ambiguity around “existing vs future” behavior and make support guidance consistent with PR #24678 defaults.