Skip to content

Conversation

@JoeZiminski
Copy link
Member

@JoeZiminski JoeZiminski commented Sep 11, 2025

This PR adds the option to encrypt the RClone config file containing SSH, AWS or GDrive connection information (e.g. private key, passwords, access tokens). The main changes are:

  1. SSH, AWS and GDrive RClone configs are now stored in separate .conf files (previously, the RClone default to store everything in RClone's rclone.conf was used. This is still kept for local_filesystem for backwards compatibility.
  2. There is now an option during set up connections (via Python API or TUI) to encrpy the config file. Doing so will encrypt the file using the operating systems credential manager.

This required quite a lot of refactoring to the setup connection functions (API and TUI) as well as the internal calls to rclone. Now, these calls are wrapped in some functionality that handles unencrypting the rclone config if required.

Tests and documentation have been updated.

This implementation is okay but there is still room for improvement. However, as this PR is pretty big and we just need to get this out, these are reversed for the future (#636).

@JoeZiminski JoeZiminski changed the title Refactor SSH connection to make adding passwords easier. Add password for SSH, AWS and GDrive config Sep 12, 2025
@JoeZiminski JoeZiminski marked this pull request as draft September 29, 2025 16:15
@JoeZiminski JoeZiminski force-pushed the add_password_to_rclone_config_for_aws_gdrive branch from 53a5a05 to 274fe29 Compare October 2, 2025 18:08
@JoeZiminski JoeZiminski mentioned this pull request Oct 7, 2025
@JoeZiminski JoeZiminski changed the base branch from main to refactor_ssh_connection October 7, 2025 21:46
@JoeZiminski JoeZiminski force-pushed the add_password_to_rclone_config_for_aws_gdrive branch 3 times, most recently from 44af5de to 5c21724 Compare November 1, 2025 01:25
Base automatically changed from refactor_ssh_connection to main November 3, 2025 15:30
@JoeZiminski JoeZiminski force-pushed the add_password_to_rclone_config_for_aws_gdrive branch from 350ac89 to 0c2c1b2 Compare November 3, 2025 15:43
@JoeZiminski JoeZiminski marked this pull request as ready for review November 3, 2025 21:39
Copy link

Copilot AI commented Nov 20, 2025

@JoeZiminski I've opened a new pull request, #637, to work on those changes. Once the pull request is ready, I'll request review from you.

JoeZiminski and others added 9 commits November 20, 2025 15:25
* Initial plan

* Fix typo: 'ecrypted' → 'encrypted' in test docstring

Co-authored-by: JoeZiminski <[email protected]>

---------

Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: JoeZiminski <[email protected]>
….com:neuroinformatics-unit/datashuttle into add_password_to_rclone_config_for_aws_gdrive
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 45 out of 45 changed files in this pull request and generated 14 comments.

Comments suppressed due to low confidence (1)

datashuttle/tui/screens/setup_ssh.py:219

  • Except block directly handles BaseException.
        except BaseException:

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants