-
Notifications
You must be signed in to change notification settings - Fork 40
feat: BI-6373 Pydantic connector settings #1445
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
d73ab54 to
2b4f33d
Compare
| from dl_api_lib.app_settings import ( | ||
| ControlApiAppSettingsOS, | ||
| ControlApiAppTestingsSettings, | ||
| DeprecatedControlApiAppSettingsOS, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
DON'T MERGE till green e2e
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR migrates connector settings from a deprecated attrs-based configuration system to a new Pydantic-based settings framework. The migration removes fallback mechanisms and simplifies the connector settings architecture.
Changes:
- Removed deprecated connector settings classes and their fallback functions across all connectors
- Updated connector settings to use Pydantic models inheriting from
ConnectorSettings - Changed connector settings dictionaries to use string keys (connection type values) instead of
ConnectionTypeenum keys - Removed unused dependencies and imports related to the old settings system
Reviewed changes
Copilot reviewed 103 out of 103 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| lib/dl_maintenance/dl_maintenance/api/common.py | Simplified connector settings loading by returning empty dict instead of using deprecated loader |
| lib/dl_file_uploader_worker_lib/dl_file_uploader_worker_lib/settings.py | Removed deprecated connector settings classes and fallback functions |
| lib/dl_file_uploader_worker_lib/dl_file_uploader_worker_lib_tests/conftest.py | Updated fixtures to use new Pydantic settings with string-keyed dictionaries |
| lib/dl_core/dl_core/connectors/settings/registry.py | Removed deprecated settings registry infrastructure |
| lib/dl_core/dl_core/connectors/settings/primitives.py | Removed deprecated settings helper functions |
| lib/dl_core/dl_core/connectors/settings/mixins.py | Removed deprecated settings mixins |
| lib/dl_core/dl_core/services_registry/top_level.py | Updated service registry to use string-keyed connector settings |
| lib/dl_connector_*/core/settings.py | Migrated all connector-specific settings from attrs to Pydantic models |
| lib/dl_connector_bundle_chs3/chs3_base/core/settings.py | Migrated FileS3 connector settings to Pydantic with nested root settings |
| lib/dl_configs/dl_configs/connectors_settings.py | Removed entire file containing deprecated base classes |
| lib/dl_configs/dl_configs/settings_loaders/loader_env.py | Removed deprecated connector settings loader function |
| lib/dl_api_lib/dl_api_lib/app_settings.py | Added ConnectorsSettingsMixin to new settings classes |
| app/dl_data_api/dl_data_api/app.py | Updated to load connectors settings directly from app settings instead of using separate loader |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
No description provided.