-
Notifications
You must be signed in to change notification settings - Fork 49
Synchronous history backfilling #571
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 1 commit
Commits
Show all changes
78 commits
Select commit
Hold shift + click to select a range
066e74e
added initial backfill parameter/function scaffolding
cjonas9 c7a19e9
added scaffolding for ledger ingestion backfill
cjonas9 e7a1b93
expanded relevant helper functions
cjonas9 10fccc0
refactored code, made CLI arg a bool instead of int
cjonas9 ce14b81
moved major legwork to ingest folder
cjonas9 e27dee6
completed structure without backfilling logic
cjonas9 11da703
completed backfilling logic, untested code fully written
cjonas9 a855501
fixed several off-by-one issues, improved error handling
cjonas9 bb49dcc
refactored code, discovered monotonicity constract in storage backend
cjonas9 32ee4ce
working implemetnation, not tested robustly or on testnet
cjonas9 749da32
fixed bug with backwards to forwards transition if starting from empt…
cjonas9 0214ae2
patched bug in empty DB case
cjonas9 4bf5abd
large refactoring
cjonas9 885c220
minor refactoring/bud ID
cjonas9 cf02b2e
changed to errors.wrap, cleaned up code
cjonas9 1499ef2
major refactoring; design made pointer-receiver oriented
cjonas9 965b479
added context timeout for main function
cjonas9 b09a526
further refactoring and edge case guarding
cjonas9 c440592
handled rare/unlikely forwards backfill, already written up to tip case
cjonas9 7537872
handled extremely rare division by zero case
cjonas9 c31a468
refactored; fixed history_retention>available ledgers bug; fixed prog…
cjonas9 7b9ffa7
minor: fixed accidental integer division rounding bug
cjonas9 02978e2
Merge remote-tracking branch 'origin/main' into synchronous-history-b…
cjonas9 397f581
abstracted ingestion/chunk filling to service.go, debugging service s…
cjonas9 91f0c73
service start post-backfill working
cjonas9 5e25abf
patched verification bug
cjonas9 d67d37c
Merge branch 'main' into synchronous-history-backfilling
cjonas9 c4241ed
updated git latest ledger test interface
cjonas9 7e733c9
repaired service test following startService refactor
cjonas9 484f360
added backfill gap detection unit test
cjonas9 3bdc240
increased robustness, fixed post-backfill ingestion bug
cjonas9 e9470d9
added buggy integration test
cjonas9 612f33f
integration test bones working
cjonas9 954b6ef
added several integration tests
cjonas9 e4f0ca1
fixed linter + error messages
cjonas9 508a7f1
Merge branch 'main' into synchronous-history-backfilling
cjonas9 89a4edc
minor style improvements
cjonas9 efc3585
timing code added
cjonas9 1830382
added config for timing
cjonas9 c330809
minor timerlog addition
cjonas9 636223b
repaired integration tests, changed backfill config params, added LCM…
cjonas9 621037f
added stale DB edge case error message, integration tests now test li…
cjonas9 7f69666
integration test debugging
cjonas9 01e316c
working robust integration tests, not flaky
cjonas9 e524b04
fixed race in tests, refactored backfill and changed empty DB behavior
cjonas9 9da6f4b
linter fixes and refactoring
cjonas9 7c669e6
refactored to reduce cyclomatic complexity
cjonas9 eb7639d
linter duration multiplication fix
cjonas9 e6addaf
added nolint for funcorder linter directive in test.go
cjonas9 9148fb4
Merge branch 'main' into synchronous-history-backfilling
cjonas9 069348d
fixed minor integration test infra bug
cjonas9 c12256e
clean/restructured code, decreased excessive logging
cjonas9 604cbf5
minor comment update
cjonas9 8f5c8b3
removed daemon logging, linter fixes
cjonas9 df347bc
removed integration test hardcoded captive core binary path
cjonas9 66e3c5c
delete accidentally committed toml
cjonas9 815095f
optimized backfill, improved names/comments, removed dead code
cjonas9 0f9d318
Merge branch 'synchronous-history-backfilling' of https://github.com/…
cjonas9 9914db0
return backend directly
cjonas9 0499d2d
reduced memory footprint of gapless check, minor test patches
cjonas9 729867e
linter: fixed casting danger, lll
cjonas9 f0169ed
getLedgerCountInRange minor improvement, service naming in Start() li…
cjonas9 e85a091
linter lll
cjonas9 43e38ee
optimized InsertEvents
cjonas9 b106492
bounds setting improvements, minor cosmetic changes
cjonas9 3ce449d
improved operator documentation/help and linter errors, removed pass-…
cjonas9 4f59e3a
fixed bounds-setting edge case
cjonas9 5d9570d
undid events changes
cjonas9 723bd0c
Merge branch 'main' into synchronous-history-backfilling
cjonas9 438e757
changed method receiver names
cjonas9 7805f02
removed timeout configurability
cjonas9 c8488c4
changed function name + linter error
cjonas9 7b15443
reduced state, improved warnings/errors
cjonas9 bc4bf00
changed backend close failure logging to use WithError
cjonas9 348278d
linter
cjonas9 721c780
simplified branching logic and resolved nits
cjonas9 da37199
changed if-else if-else to switch
cjonas9 2a66cdc
moved backfill logging completion line outside of conditional
cjonas9 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.