Skip to content
Open
Show file tree
Hide file tree
Changes from 173 commits
Commits
Show all changes
183 commits
Select commit Hold shift + click to select a range
90778df
Add service constructor
MitchTurner Sep 19, 2025
48f1ee3
Fmt
MitchTurner Sep 23, 2025
7e568ea
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 23, 2025
01ea0e5
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 25, 2025
db9d00b
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 25, 2025
6640d6b
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 25, 2025
b25b3a9
Add constructor
MitchTurner Sep 25, 2025
526cac3
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 26, 2025
4c910b4
Get compiling
MitchTurner Sep 26, 2025
19100e3
Add config, WIP test
MitchTurner Sep 26, 2025
d1c0031
WIP get first integ test working
MitchTurner Sep 26, 2025
59e36c4
Fix client url
MitchTurner Sep 29, 2025
21bcf1a
Cleanup
MitchTurner Sep 29, 2025
8b0a1cb
Compare txs directly
MitchTurner Sep 29, 2025
71e2163
Update CHANGELOG
MitchTurner Sep 29, 2025
0ce24fe
Lint toml
MitchTurner Sep 29, 2025
dd99881
improve comments on cli args
MitchTurner Sep 29, 2025
052bbd1
Move socket selection to test helpers and use by default
MitchTurner Sep 29, 2025
0e79b26
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Sep 29, 2025
ae579d1
Appease Clippy-sama
MitchTurner Sep 29, 2025
d4e2b48
Remove unused
MitchTurner Sep 30, 2025
d945fbe
Re-add import
MitchTurner Sep 30, 2025
e43cc0e
Rename trait, add new adapter template
MitchTurner Sep 30, 2025
a5e11f3
fmt
MitchTurner Sep 30, 2025
d7e75e1
Make clap args unique
MitchTurner Sep 30, 2025
91c0e39
Include protoc installation in CI
MitchTurner Sep 30, 2025
22594d2
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Sep 30, 2025
4538917
WIP debugging failing test
MitchTurner Oct 1, 2025
d82c4a2
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Oct 1, 2025
9d9d54b
Fix integ tests by using different rpc addrs
MitchTurner Oct 1, 2025
7c5e52b
Remove traces
MitchTurner Oct 1, 2025
a9fda8a
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Oct 1, 2025
05516e3
Remove tracing from deps
MitchTurner Oct 1, 2025
a65b992
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Oct 1, 2025
4bda406
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Oct 1, 2025
ef3671a
Use new proto type in integ test
MitchTurner Oct 1, 2025
8f2cda1
add integ tests for other endpoints
MitchTurner Oct 1, 2025
3deda42
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Oct 2, 2025
79969a1
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Oct 2, 2025
910761c
Hide rpc behind feature
MitchTurner Oct 2, 2025
154abca
Fix test
MitchTurner Oct 2, 2025
7b482ff
Refactor test helpers
MitchTurner Oct 2, 2025
b663704
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Oct 2, 2025
d17c20c
Remove unused
MitchTurner Oct 2, 2025
a2f0393
Appease Clippy-sama
MitchTurner Oct 2, 2025
7f917ba
Fix orphaned task that was causing collisions in socket addrs
MitchTurner Oct 2, 2025
051d38c
Remove spurious error traces
MitchTurner Oct 3, 2025
eeee635
Add missing feature contraint
MitchTurner Oct 3, 2025
772dfbd
remove timeout
MitchTurner Oct 3, 2025
0ff404a
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Oct 3, 2025
369acdc
WIP use proto types in storage
MitchTurner Oct 6, 2025
3bc2c22
Maybe fix the Serde issue
MitchTurner Oct 6, 2025
06d7220
Get compiling with new type constraints
MitchTurner Oct 7, 2025
13a7e84
Fix tests
MitchTurner Oct 7, 2025
0bbe62a
WIP add proto types for block w/header & txs
MitchTurner Oct 7, 2025
0061ca3
WIP integrate proto block type more into tests
MitchTurner Oct 7, 2025
8ff2497
WIP conversions
MitchTurner Oct 7, 2025
9a083ec
get tests passing
MitchTurner Oct 8, 2025
5505ba0
lint tomls
MitchTurner Oct 8, 2025
3e76d06
Add changelog
MitchTurner Oct 8, 2025
3a61d59
spellcheck
MitchTurner Oct 8, 2025
9659d11
fix feature issues
MitchTurner Oct 8, 2025
edecb7e
Fix more tests, appease clippy-sama, remove warnings
MitchTurner Oct 8, 2025
5bd649c
Fix import
MitchTurner Oct 8, 2025
e2c18c3
Fix bug in test helper, remove commented code
MitchTurner Oct 8, 2025
d469af7
Merge branch 'chore/protobuf-api-adatper' into chore/integrate-block-…
MitchTurner Oct 13, 2025
909ec75
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner Oct 13, 2025
141f886
Start adding deserialization
MitchTurner Oct 13, 2025
c9e0708
Finish round-trip test
MitchTurner Oct 17, 2025
bdd40b1
Update changelog, add ignore
MitchTurner Oct 17, 2025
dc1f5bb
Improve documentation for buffer size
MitchTurner Oct 17, 2025
5f11a9b
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner Oct 17, 2025
50cd95c
Make compilation happy
MitchTurner Oct 17, 2025
44b3955
Make compilation happy
MitchTurner Oct 17, 2025
3192e8b
Introduce prop test
MitchTurner Oct 17, 2025
efcbca5
WIP
MitchTurner Oct 17, 2025
bb8e877
Rename script tx to be more verbose
MitchTurner Oct 18, 2025
5d88f32
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner Oct 18, 2025
99db222
Add txs to prop test blocks
MitchTurner Oct 18, 2025
56c648c
Add msg ids
MitchTurner Oct 18, 2025
709f6b8
Fill in more of script
MitchTurner Oct 18, 2025
b1cb80b
Add Input :)
MitchTurner Oct 18, 2025
36451c4
Add todo and issue for missing types
MitchTurner Oct 20, 2025
607db8f
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner Oct 20, 2025
caa3e33
Add more header fields
MitchTurner Oct 20, 2025
6009157
Add full header stuff
MitchTurner Oct 20, 2025
5110266
wip add more inputs
MitchTurner Oct 20, 2025
d430abf
Merge remote-tracking branch 'origin/chore/protobuf-api-adatper' into…
MitchTurner Oct 21, 2025
4be7ffd
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner Oct 21, 2025
986c155
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner Oct 21, 2025
2b4dd0b
fix merge conflicts
MitchTurner Oct 21, 2025
f342944
Lint tomls
MitchTurner Oct 21, 2025
aa476c1
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner Oct 21, 2025
b89a4e3
Fix broken imports
MitchTurner Oct 21, 2025
1ca5346
Fix broken imports
MitchTurner Oct 21, 2025
14af75d
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner Oct 21, 2025
03788f6
Fix integ tests
MitchTurner Oct 21, 2025
3b5a8a6
Fix merge
MitchTurner Oct 21, 2025
04ad81d
Lint tomls
MitchTurner Oct 21, 2025
86eddd9
Fix spelling
MitchTurner Oct 21, 2025
3009279
fix compilation
MitchTurner Oct 21, 2025
bd0f7c3
Cleanup from review feedback
MitchTurner Oct 21, 2025
7d0a3cc
Remove unused
MitchTurner Oct 21, 2025
c9a4cd6
Merge branch 'chore/integrate-block-aggregator' into chore/store-prot…
MitchTurner Oct 21, 2025
cd872c1
Merge branch 'chore/store-proto-types' into chore/better-proto-conver…
MitchTurner Oct 21, 2025
5b33291
Add full round trip prop tests with all the block components
MitchTurner Nov 3, 2025
fa3da69
Appease Clippy-sama
MitchTurner Nov 3, 2025
985f9b3
Add `aloc` to allowed spelling
MitchTurner Nov 3, 2025
60d2694
add other capitalization of spelling
MitchTurner Nov 3, 2025
d4d273e
Cleanup a bunch of unused and confusing things
MitchTurner Nov 3, 2025
0547f55
fix import
MitchTurner Nov 3, 2025
69d202b
Fix it more
MitchTurner Nov 3, 2025
27a9bc4
Appease Clippy-sama
MitchTurner Nov 3, 2025
1515104
Ignore test in fault-proving feature
MitchTurner Nov 3, 2025
74601d8
Move feature flage to ignore imports as well
MitchTurner Nov 3, 2025
fa63c40
Include issue with TODO
MitchTurner Nov 4, 2025
5211ae4
Merge branch 'chore/integrate-block-aggregator' into chore/add-remote…
MitchTurner Nov 4, 2025
370fb5a
Merge branch 'chore/better-proto-conversion-coverage' into chore/add-…
MitchTurner Nov 5, 2025
d1a17ee
fix compilation
MitchTurner Nov 5, 2025
88f9345
Add protobuf serialization
MitchTurner Nov 6, 2025
443b0e4
Add s3 client tests
MitchTurner Nov 6, 2025
ba4d17f
Add basic block range test
MitchTurner Nov 7, 2025
5636830
persist height information
MitchTurner Nov 7, 2025
b6ee334
Start adding persitance to remote storage
MitchTurner Nov 7, 2025
4b0ab28
Add persisted storage for remote consistency
MitchTurner Nov 7, 2025
2eff09b
Add more coverage
MitchTurner Nov 7, 2025
11f0754
Fix url construction
MitchTurner Nov 7, 2025
2c0a2c2
Update changelog, lint toml
MitchTurner Nov 10, 2025
75a0eb0
wip integrate into fuel-core
MitchTurner Nov 10, 2025
920bf74
Get client working in test
MitchTurner Nov 10, 2025
29eea36
wip get test working with localstack
MitchTurner Nov 11, 2025
e23cf75
Add checks and cleanup to test
MitchTurner Nov 11, 2025
44eb878
Lint toml
MitchTurner Nov 11, 2025
54fc102
remove dummy test, add env-vars to trigger failing integ test
MitchTurner Nov 11, 2025
70ef644
fm
MitchTurner Nov 11, 2025
0d4dfe0
Appease Clippy-sama
MitchTurner Nov 11, 2025
d25c15f
Appease Clippy-sama, ensure bucket exists
MitchTurner Nov 11, 2025
1c6eb7a
WIP get all integ tests passing
MitchTurner Nov 12, 2025
58198e9
Merge remote-tracking branch 'origin' into chore/add-remote-block-cache
MitchTurner Nov 12, 2025
1b97ed5
Finsh merging
MitchTurner Nov 12, 2025
18324a7
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 12, 2025
ea5cbf6
Get integ test passing
MitchTurner Nov 12, 2025
eff8f0b
fix sync-from height stuff
MitchTurner Nov 12, 2025
397bc33
Lint and appease Clippy-sama
MitchTurner Nov 12, 2025
c684dbc
Add more env var checks to make sure tests fail in CI
MitchTurner Nov 12, 2025
361e713
Add missing env var
MitchTurner Nov 12, 2025
e8ff2a6
Add new integ test
MitchTurner Nov 12, 2025
5fd1555
bump ci
MitchTurner Nov 12, 2025
30705a6
Fix name
MitchTurner Nov 12, 2025
29fb925
Remove health check
MitchTurner Nov 12, 2025
765f808
Remove other health check
MitchTurner Nov 12, 2025
a334170
Edit CI down
MitchTurner Nov 12, 2025
1709f03
Fix env vars
MitchTurner Nov 12, 2025
232989c
Add better error messages
MitchTurner Nov 12, 2025
d3c0102
Modify client to use path style
MitchTurner Nov 12, 2025
bbd7c9a
Add some traces to help understand what is being run
MitchTurner Nov 12, 2025
dcc5078
Cleanup
MitchTurner Nov 12, 2025
2e21066
remove /blocks from url path, we do not know if that will be the case
MitchTurner Nov 12, 2025
94d323a
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 17, 2025
c0856a0
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 17, 2025
01eb6f7
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 17, 2025
5aa29ac
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 19, 2025
ac5712e
Merge branch 'chore/protobuf-api-adatper' into chore/add-remote-block…
MitchTurner Nov 19, 2025
f56d01a
Block RPC PR Followup (#3145)
MitchTurner Nov 25, 2025
fea570e
Remoed semicolons
xgreenx Nov 25, 2025
cb0a65a
Unify db definitions, extract rpc init logic
MitchTurner Nov 25, 2025
9c6eb73
Missed deps
xgreenx Nov 25, 2025
c2b3929
remove protoc
MitchTurner Nov 25, 2025
d8fcda7
wip PR changes
MitchTurner Nov 25, 2025
1bdcb05
More PR changes
MitchTurner Nov 25, 2025
eb7f04f
Fix compilation for different features
MitchTurner Nov 26, 2025
760bc0e
Add uninitialized task for rpc
MitchTurner Nov 26, 2025
735ee57
fix featureless compilation
MitchTurner Nov 26, 2025
538e319
separate out tests for local and s3
MitchTurner Nov 26, 2025
12926ae
cleanup imports
MitchTurner Nov 26, 2025
a525e53
Make RPC optional
MitchTurner Nov 26, 2025
7fe073f
Add no-publish option for s3
MitchTurner Nov 26, 2025
3b3fa5b
Add one more s3 test
MitchTurner Nov 26, 2025
8177c07
Appease Clippy-sama
MitchTurner Nov 26, 2025
d05ef29
Add rollback for blocks data as well
MitchTurner Nov 26, 2025
549d5cc
Fix service shutdown testg
MitchTurner Nov 26, 2025
ccfe144
Small clean ups
xgreenx Nov 26, 2025
5d16a33
Address feedback
MitchTurner Nov 26, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .changes/added/3106.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Add adapter for storing blocks on AWS S3 bucket
25 changes: 25 additions & 0 deletions .github/actions/slack-notify-template/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
name: Notify Slack on Failure
description: Sends notification to Slack if job fails

inputs:
github_token:
description: Github Token Secret
required: true
slack_webhook:
description: Slack webhook URL
required: true

runs:
using: composite
steps:
- name: Notify if Job Fails
uses: ravsamhq/notify-slack-action@v2
with:
status: ${{ job.status }}
token: ${{ inputs.github_token }}
notification_title: '{workflow} has {status_message}'
message_format: '{emoji} *{workflow}* {status_message} in <{repo_url}|{repo}> : <{run_url}|View Run Results>'
footer: ''
notify_when: failure
env:
SLACK_WEBHOOK_URL: ${{ inputs.slack_webhook }}
47 changes: 39 additions & 8 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ jobs:
run: cargo install cargo-sort
- name: Run Cargo.toml sort check
run: cargo sort -w --check
- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && github.ref == 'refs/heads/master'
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand All @@ -93,7 +93,7 @@ jobs:
# ensure openssl hasn't crept into the dep tree
- name: Check if openssl is included
run: ./.github/workflows/scripts/verify_openssl.sh
- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && github.ref == 'refs/heads/master'
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down Expand Up @@ -174,8 +174,6 @@ jobs:
uses: davidB/rust-cargo-make@v1
with:
version: "0.36.4"
- name: Install Protoc
uses: arduino/setup-protoc@v3
- uses: rui314/setup-mold@v1
- uses: buildjet/cache@v3
with:
Expand All @@ -194,12 +192,45 @@ jobs:
continue-on-error: true
- name: ${{ matrix.command }} ${{ matrix.args }}
run: ${{ matrix.env }} cargo ${{ matrix.command }} ${{ matrix.args }}
- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && github.ref == 'refs/heads/master'
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
slack_webhook: ${{ secrets.SLACK_WEBHOOK_NOTIFY_BUILD }}

rpc-s3-integration-tests:
name: RPC S3 Integration Tests (w/LocalStack)
needs:
- lint-toml-files
- prevent-openssl
- rustfmt
- check-changelog
runs-on: buildjet-4vcpu-ubuntu-2204
timeout-minutes: 45
services:
localstack:
image: localstack/localstack:latest
ports:
- 4566:4566
env:
SERVICES: s3
DEBUG: 1

env:
AWS_ACCESS_KEY_ID: test
AWS_SECRET_ACCESS_KEY: test
AWS_REGION: us-east-1
RUSTFLAGS: -D warnings

steps:
- uses: actions/checkout@v4
- name: Install Rust
uses: dtolnay/rust-toolchain@master
with:
toolchain: ${{ env.RUST_VERSION }}
- name: Run RPC Integration Tests
run: cargo test --package fuel-core-tests --test integration_tests rpc --features rpc -- --test-threads=1

publish-crates-check:
runs-on: buildjet-4vcpu-ubuntu-2204
steps:
Expand Down Expand Up @@ -239,7 +270,6 @@ jobs:
- uses: dtolnay/rust-toolchain@master
with:
toolchain: ${{ env.RUST_VERSION }}
- uses: arduino/setup-protoc@v3
- uses: rui314/setup-mold@v1
- uses: buildjet/cache@v3
with:
Expand All @@ -258,6 +288,7 @@ jobs:
- cargo-verifications
- publish-crates-check
- cargo-test-kms
- rpc-s3-integration-tests
runs-on: ubuntu-latest
steps:
- run: echo "pass"
Expand Down Expand Up @@ -302,7 +333,7 @@ jobs:
publish-delay: 60000
registry-token: ${{ secrets.CARGO_REGISTRY_TOKEN }}

- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always()
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down Expand Up @@ -448,7 +479,7 @@ jobs:
asset_name: ${{ env.ZIP_FILE_NAME }}
asset_content_type: application/gzip

- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && (github.ref == 'refs/heads/master' || github.ref_type == 'tag') && matrix.job.os != 'macos-latest'
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/docker-images.yml
Original file line number Diff line number Diff line change
Expand Up @@ -290,7 +290,7 @@ jobs:
cache-from: type=registry,ref=${{ env.REGISTRY_URL }}-build-cache-debug:latest
cache-to: type=registry,ref=${{ env.REGISTRY_URL }}-build-cache-debug:latest,mode=max,image-manifest=true,oci-mediatypes=true

- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && (github.ref == 'refs/heads/master' || github.ref_type == 'tag')
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down Expand Up @@ -390,7 +390,7 @@ jobs:
cache-from: type=registry,ref=${{ env.REGISTRY_URL }}-build-cache-e2e:latest
cache-to: type=registry,ref=${{ env.REGISTRY_URL }}-build-cache-e2e:latest,mode=max,image-manifest=true,oci-mediatypes=true

- uses: FuelLabs/.github/.github/actions/slack-notify-template@master
- uses: ./.github/actions/slack-notify-template
if: always() && (github.ref == 'refs/heads/master' || github.ref_type == 'tag')
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down
Loading
Loading