-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Add remote block cache #3106
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
MitchTurner
wants to merge
183
commits into
chore/protobuf-api-adatper
Choose a base branch
from
chore/add-remote-block-cache
base: chore/protobuf-api-adatper
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Add remote block cache #3106
Changes from 165 commits
Commits
Show all changes
183 commits
Select commit
Hold shift + click to select a range
90778df
Add service constructor
MitchTurner 48f1ee3
Fmt
MitchTurner 7e568ea
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 01ea0e5
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner db9d00b
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 6640d6b
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner b25b3a9
Add constructor
MitchTurner 526cac3
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 4c910b4
Get compiling
MitchTurner 19100e3
Add config, WIP test
MitchTurner d1c0031
WIP get first integ test working
MitchTurner 59e36c4
Fix client url
MitchTurner 21bcf1a
Cleanup
MitchTurner 8b0a1cb
Compare txs directly
MitchTurner 71e2163
Update CHANGELOG
MitchTurner 0ce24fe
Lint toml
MitchTurner dd99881
improve comments on cli args
MitchTurner 052bbd1
Move socket selection to test helpers and use by default
MitchTurner 0e79b26
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner ae579d1
Appease Clippy-sama
MitchTurner d4e2b48
Remove unused
MitchTurner d945fbe
Re-add import
MitchTurner e43cc0e
Rename trait, add new adapter template
MitchTurner a5e11f3
fmt
MitchTurner d7e75e1
Make clap args unique
MitchTurner 91c0e39
Include protoc installation in CI
MitchTurner 22594d2
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner 4538917
WIP debugging failing test
MitchTurner d82c4a2
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 9d9d54b
Fix integ tests by using different rpc addrs
MitchTurner 7c5e52b
Remove traces
MitchTurner a9fda8a
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner 05516e3
Remove tracing from deps
MitchTurner a65b992
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner 4bda406
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner ef3671a
Use new proto type in integ test
MitchTurner 8f2cda1
add integ tests for other endpoints
MitchTurner 3deda42
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 79969a1
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 910761c
Hide rpc behind feature
MitchTurner 154abca
Fix test
MitchTurner 7b482ff
Refactor test helpers
MitchTurner b663704
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner d17c20c
Remove unused
MitchTurner a2f0393
Appease Clippy-sama
MitchTurner 7f917ba
Fix orphaned task that was causing collisions in socket addrs
MitchTurner 051d38c
Remove spurious error traces
MitchTurner eeee635
Add missing feature contraint
MitchTurner 772dfbd
remove timeout
MitchTurner 0ff404a
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner 369acdc
WIP use proto types in storage
MitchTurner 3bc2c22
Maybe fix the Serde issue
MitchTurner 06d7220
Get compiling with new type constraints
MitchTurner 13a7e84
Fix tests
MitchTurner 0bbe62a
WIP add proto types for block w/header & txs
MitchTurner 0061ca3
WIP integrate proto block type more into tests
MitchTurner 8ff2497
WIP conversions
MitchTurner 9a083ec
get tests passing
MitchTurner 5505ba0
lint tomls
MitchTurner 3e76d06
Add changelog
MitchTurner 3a61d59
spellcheck
MitchTurner 9659d11
fix feature issues
MitchTurner edecb7e
Fix more tests, appease clippy-sama, remove warnings
MitchTurner 5bd649c
Fix import
MitchTurner e2c18c3
Fix bug in test helper, remove commented code
MitchTurner d469af7
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner 909ec75
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner 141f886
Start adding deserialization
MitchTurner c9e0708
Finish round-trip test
MitchTurner bdd40b1
Update changelog, add ignore
MitchTurner dc1f5bb
Improve documentation for buffer size
MitchTurner 5f11a9b
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner 50cd95c
Make compilation happy
MitchTurner 44b3955
Make compilation happy
MitchTurner 3192e8b
Introduce prop test
MitchTurner efcbca5
WIP
MitchTurner bb8e877
Rename script tx to be more verbose
MitchTurner 5d88f32
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner 99db222
Add txs to prop test blocks
MitchTurner 56c648c
Add msg ids
MitchTurner 709f6b8
Fill in more of script
MitchTurner b1cb80b
Add Input :)
MitchTurner 36451c4
Add todo and issue for missing types
MitchTurner 607db8f
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner caa3e33
Add more header fields
MitchTurner 6009157
Add full header stuff
MitchTurner 5110266
wip add more inputs
MitchTurner d430abf
Merge remote-tracking branch 'origin/chore/protobuf-api-adatper' into…
MitchTurner 4be7ffd
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner 986c155
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner 2b4dd0b
fix merge conflicts
MitchTurner f342944
Lint tomls
MitchTurner aa476c1
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner b89a4e3
Fix broken imports
MitchTurner 1ca5346
Fix broken imports
MitchTurner 14af75d
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner 03788f6
Fix integ tests
MitchTurner 3b5a8a6
Fix merge
MitchTurner 04ad81d
Lint tomls
MitchTurner 86eddd9
Fix spelling
MitchTurner 3009279
fix compilation
MitchTurner bd0f7c3
Cleanup from review feedback
MitchTurner 7d0a3cc
Remove unused
MitchTurner c9a4cd6
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner cd872c1
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner 5b33291
Add full round trip prop tests with all the block components
MitchTurner fa3da69
Appease Clippy-sama
MitchTurner 985f9b3
Add `aloc` to allowed spelling
MitchTurner 60d2694
add other capitalization of spelling
MitchTurner d4d273e
Cleanup a bunch of unused and confusing things
MitchTurner 0547f55
fix import
MitchTurner 69d202b
Fix it more
MitchTurner 27a9bc4
Appease Clippy-sama
MitchTurner 1515104
Ignore test in fault-proving feature
MitchTurner 74601d8
Move feature flage to ignore imports as well
MitchTurner fa63c40
Include issue with TODO
MitchTurner 5211ae4
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner 370fb5a
Merge branch 'chore/better-proto-conversion-coverage' into chore/add-…
MitchTurner d1a17ee
fix compilation
MitchTurner 88f9345
Add protobuf serialization
MitchTurner 443b0e4
Add s3 client tests
MitchTurner ba4d17f
Add basic block range test
MitchTurner 5636830
persist height information
MitchTurner b6ee334
Start adding persitance to remote storage
MitchTurner 4b0ab28
Add persisted storage for remote consistency
MitchTurner 2eff09b
Add more coverage
MitchTurner 11f0754
Fix url construction
MitchTurner 2c0a2c2
Update changelog, lint toml
MitchTurner 75a0eb0
wip integrate into fuel-core
MitchTurner 920bf74
Get client working in test
MitchTurner 29eea36
wip get test working with localstack
MitchTurner e23cf75
Add checks and cleanup to test
MitchTurner 44eb878
Lint toml
MitchTurner 54fc102
remove dummy test, add env-vars to trigger failing integ test
MitchTurner 70ef644
fm
MitchTurner 0d4dfe0
Appease Clippy-sama
MitchTurner d25c15f
Appease Clippy-sama, ensure bucket exists
MitchTurner 1c6eb7a
WIP get all integ tests passing
MitchTurner 58198e9
Merge remote-tracking branch 'origin' into chore/add-remote-block-cache
MitchTurner 1b97ed5
Finsh merging
MitchTurner 18324a7
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner ea5cbf6
Get integ test passing
MitchTurner eff8f0b
fix sync-from height stuff
MitchTurner 397bc33
Lint and appease Clippy-sama
MitchTurner c684dbc
Add more env var checks to make sure tests fail in CI
MitchTurner 361e713
Add missing env var
MitchTurner e8ff2a6
Add new integ test
MitchTurner 5fd1555
bump ci
MitchTurner 30705a6
Fix name
MitchTurner 29fb925
Remove health check
MitchTurner 765f808
Remove other health check
MitchTurner a334170
Edit CI down
MitchTurner 1709f03
Fix env vars
MitchTurner 232989c
Add better error messages
MitchTurner d3c0102
Modify client to use path style
MitchTurner bbd7c9a
Add some traces to help understand what is being run
MitchTurner dcc5078
Cleanup
MitchTurner 2e21066
remove /blocks from url path, we do not know if that will be the case
MitchTurner 94d323a
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner c0856a0
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner 01eb6f7
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner 5aa29ac
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner ac5712e
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner f56d01a
Block RPC PR Followup (#3145)
MitchTurner fea570e
Remoed semicolons
xgreenx cb0a65a
Unify db definitions, extract rpc init logic
MitchTurner 9c6eb73
Missed deps
xgreenx c2b3929
remove protoc
MitchTurner d8fcda7
wip PR changes
MitchTurner 1bdcb05
More PR changes
MitchTurner eb7f04f
Fix compilation for different features
MitchTurner 760bc0e
Add uninitialized task for rpc
MitchTurner 735ee57
fix featureless compilation
MitchTurner 538e319
separate out tests for local and s3
MitchTurner 12926ae
cleanup imports
MitchTurner a525e53
Make RPC optional
MitchTurner 7fe073f
Add no-publish option for s3
MitchTurner 3b3fa5b
Add one more s3 test
MitchTurner 8177c07
Appease Clippy-sama
MitchTurner d05ef29
Add rollback for blocks data as well
MitchTurner 549d5cc
Fix service shutdown testg
MitchTurner ccfe144
Small clean ups
xgreenx 5d16a33
Address feedback
MitchTurner File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| Add adapter for storing blocks on AWS S3 bucket |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| name: Notify Slack on Failure | ||
| description: Sends notification to Slack if job fails | ||
|
|
||
| inputs: | ||
| github_token: | ||
| description: Github Token Secret | ||
| required: true | ||
| slack_webhook: | ||
| description: Slack webhook URL | ||
| required: true | ||
|
|
||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Notify if Job Fails | ||
| uses: ravsamhq/notify-slack-action@v2 | ||
| with: | ||
| status: ${{ job.status }} | ||
| token: ${{ inputs.github_token }} | ||
| notification_title: '{workflow} has {status_message}' | ||
| message_format: '{emoji} *{workflow}* {status_message} in <{repo_url}|{repo}> : <{run_url}|View Run Results>' | ||
| footer: '' | ||
| notify_when: failure | ||
| env: | ||
| SLACK_WEBHOOK_URL: ${{ inputs.slack_webhook }} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe we can remove it now