Skip to content

Conversation

@ndr-ds
Copy link
Contributor

@ndr-ds ndr-ds commented May 2, 2025

Motivation

Our benchmarks are currently using DualStore, so it makes sense for us to add support to use it if we need it. We won't ideally need this, as the plan is to get ScyllaDB to a state that we reach the big numbers with it.

Proposal

This PR adds the linera-protocol side support for DualStore networks, as well as support for doing local linera net up --kubernetes runs with DualStore

Test Plan

Ran a local network with default params (scylladb) and DualStore, both work

Release Plan

  • Nothing to do / These changes follow the usual release cycle.

Copy link
Contributor Author

ndr-ds commented May 2, 2025

#[arg(long, default_value = "0")]
block_exporters: u32,

/// Use dual store (rocksdb and scylladb) instead of just scylladb.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you mention kubernetes in the description?

Copy link
Contributor

@ma2bd ma2bd May 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could also use separate command at some point, say, linera net start and linera net start-kubernetes.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do mention that this adds support for linera net up --kubernetes 🤔

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm talking about the comment used for --help.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah 😅 my bad

@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from f44e58c to 9b0eaf9 Compare May 5, 2025 21:00
@ndr-ds ndr-ds force-pushed the 05-02-adjust_state_hash_computation_bucket branch from e83c215 to 3143c9d Compare May 5, 2025 21:00
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from 9b0eaf9 to 236c7e0 Compare May 6, 2025 14:50
@ndr-ds ndr-ds force-pushed the 05-02-adjust_state_hash_computation_bucket branch from 3143c9d to a3d38ad Compare May 6, 2025 14:51
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch 2 times, most recently from 9c06727 to 71609f6 Compare May 6, 2025 17:34
@ndr-ds ndr-ds force-pushed the 05-02-adjust_state_hash_computation_bucket branch from a3d38ad to 63ff628 Compare May 6, 2025 17:34
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch 2 times, most recently from 7bff405 to 238f4fd Compare May 6, 2025 20:50
@ndr-ds ndr-ds changed the base branch from 05-02-adjust_state_hash_computation_bucket to graphite-base/3878 May 6, 2025 22:17
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from 238f4fd to e6759df Compare May 6, 2025 22:17
@ndr-ds ndr-ds changed the base branch from graphite-base/3878 to 05-06-recursively_create_parent_directories_when_creating_config_dir May 6, 2025 22:18
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from e6759df to 6472402 Compare May 7, 2025 17:10
@ndr-ds ndr-ds force-pushed the 05-06-recursively_create_parent_directories_when_creating_config_dir branch from d858999 to 1cfe578 Compare May 7, 2025 17:10
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from 6472402 to 5d1fcb5 Compare May 7, 2025 18:23
@ndr-ds ndr-ds force-pushed the 05-06-recursively_create_parent_directories_when_creating_config_dir branch from 1cfe578 to 2997a46 Compare May 7, 2025 19:11
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch 2 times, most recently from 5fcbbc5 to dbc4647 Compare May 9, 2025 16:57
@ndr-ds ndr-ds force-pushed the 05-06-recursively_create_parent_directories_when_creating_config_dir branch from 2997a46 to 296337d Compare May 9, 2025 16:57
Copy link
Contributor Author

ndr-ds commented May 9, 2025

Merge activity

  • May 9, 5:25 PM EDT: A user started a stack merge that includes this pull request via Graphite.
  • May 9, 5:30 PM EDT: Graphite rebased this pull request as part of a merge.
  • May 9, 5:31 PM EDT: @ndr-ds merged this pull request with Graphite.

@ndr-ds ndr-ds changed the base branch from 05-06-recursively_create_parent_directories_when_creating_config_dir to graphite-base/3878 May 9, 2025 21:28
@ndr-ds ndr-ds changed the base branch from graphite-base/3878 to main May 9, 2025 21:29
@ndr-ds ndr-ds force-pushed the 05-02-add_dual_store_support branch from dbc4647 to 908312b Compare May 9, 2025 21:30
@ndr-ds ndr-ds merged commit 12b82bc into main May 9, 2025
26 checks passed
@ndr-ds ndr-ds deleted the 05-02-add_dual_store_support branch May 9, 2025 21:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants