feat(cat-voices): database migration (#3585)

* docs: capture initial times

* chore: remove cacheDocument

* turn off logging

* chore: use debugPrint instead of logger

* feat: bulk documents save

* batching sync

* chore: move exact ref resoling to getDocumentData instead of index

* fix: DocumentRepository

* chore: simplify getting documents data

* remove getAllDocumentsRefs and getCachedDocumentsRefs from DocumentRepository. Index is only available in DocumentDataRemoteSource

* chore: update docs

* simplified document index endpoint

* remove randomness from LocalCatGateway

* indexing by batch size

* wip: filtering by types

* Rework filtering refs + checking all refs if already cached in parallel

* docs

* update indexing.csv

* update indexing csv

* chore: cleanup

* trailing new line

* chore

* move performance tab to docs

* bulk saving typed docs in parallel

* chore: revert hardcoded timestamp

* chore: typos

* split _sync into smaller functions + add documentation

* little refactor

* fix: analyzer

* initial v2 tables

* wip

* wip

* feat: database migration

* chore: cleanup

* bump batch size

* cleanup

* chore: remove defensive content decoding

* spelling

* test on platform

* chore: update build scripts

* more migration test data

* clean up constructors

* cleanup

* fix: template tests

* fix: spelling

* fix code-generator earthly target

* use logger in migration + wrap in transaction

* chore: move migration transaction level higher

Author: damian-molinski

catalyst_voices/Earthfile

@@ -32,12 +32,14 @@ code-generator:
 
     LET gen_code_path = lib/generated/api
     LET local_gen_code_path = packages/internal/catalyst_voices_repositories/lib/generated/api/
+    LET local_gen_db_code_path = packages/internal/catalyst_voices_repositories/test/src/database/migration/catalyst_database/generated/
 
     WORKDIR packages/internal/catalyst_voices_repositories
 
     WORKDIR /frontend
 
     RUN melos l10n
+    RUN melos build-db-migration
     RUN melos build-runner
     RUN melos build-runner-repository
 
@@ -58,6 +60,11 @@ code-generator:
                                           -o -name "*.drift.dart" \))
            SAVE ARTIFACT $generated_file AS LOCAL $generated_file
         END
+
+        # Save database migration generated files
+        WORKDIR packages/internal/catalyst_voices_repositories/test/src/database/migration/catalyst_database
+        SAVE ARTIFACT generated/* AS LOCAL $local_gen_db_code_path
+        WORKDIR /frontend
     ELSE
        SAVE ARTIFACT .
     END