Skip to content

Add cli dump mark success option#423

Merged
ctrl-schaff merged 13 commits into1.1.xfrom
add-cli-dump-mark-success-option
Nov 13, 2025
Merged

Add cli dump mark success option#423
ctrl-schaff merged 13 commits into1.1.xfrom
add-cli-dump-mark-success-option

Conversation

@ctrl-schaff
Copy link
Copy Markdown
Contributor

Adds the ability to mark a dump as successful from the biothings-cli tool. Enables the ability for setting up the dump files manually and then confirming the successful dump on the backend. Useful for larger dumps if you accidentally remove the dump trigger

Creates a commands module to store the command logic in one location.
Moves much settings configuration into the config submodule in commands
Attempts to create a clear logically distinction between cli logic and
hub logic
Moves the operations_mode decorator into the new module. Adds another
decorator for checking the python system path and adding any paths
specified in our designated .pth file. This applies for any file that
might need access to the hub-parsers
@ctrl-schaff ctrl-schaff changed the base branch from master to 1.1.x October 27, 2025 21:54
@ctrl-schaff
Copy link
Copy Markdown
Contributor Author

export BTCLI_DEBUG=1; biothings-cli dataplugin dump -m
[16:16:55] DEBUG    Inferring singular advanced plugin from directory structure
           DEBUG    Popen(['git', 'version'], cwd=/home/schaffjr/workspace/plugin-development/pending.api/plugins/nodenorm, stdin=None, shell=False, universal_newlines=False)
           DEBUG    Popen(['git', 'version'], cwd=/home/schaffjr/workspace/plugin-development/pending.api/plugins/nodenorm, stdin=None, shell=False, universal_newlines=False)
           WARNING  Found stale datasource 'nodenorm', marking upload status as 'canceled'
           DEBUG    Assistant Plugin Name: nodenorm
                    Assistant Plugin Path: /home/schaffjr/workspace/plugin-development/pending.api/plugins/nodenorm
                    Data Plugin Folder: /home/schaffjr/workspace/plugin-development/pending.api/plugins/nodenorm
           DEBUG    For plugin "nodenorm", selecting loader class "AdvancedPluginLoader"
           INFO     Registering 'nodenorm' to dump manager
           INFO     Attempting to load module nodenorm
           DEBUG    Found a class based on BaseDumper: '<class 'nodenorm.dumper.NodeNormDumper'>'
           DEBUG    Found classes to register: [<class 'nodenorm.dumper.NodeNormDumper'>]
           INFO     Registering 'nodenorm' to upload manager(s)
           INFO     Attempting to load module nodenorm
           WARNING  nodenorm module discovered in sys.modules
           DEBUG    Found a class based on BaseSourceUploader: '<class 'nodenorm.uploader.NodeNormUploader'>'
           DEBUG    Found classes to register: [<class 'nodenorm.uploader.NodeNormUploader'>]
           DEBUG    Creating new NodeNormDumper instance
           WARNING  Marking dump as successful without running the dumper
           INFO     Done!
           INFO     Success! 🚀

@ctrl-schaff ctrl-schaff merged commit c94eced into 1.1.x Nov 13, 2025
12 of 13 checks passed
@ctrl-schaff ctrl-schaff deleted the add-cli-dump-mark-success-option branch November 13, 2025 22:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant