Skip to content

Commit e9f84ae

Browse files
kunaljubcepotiuk
andauthored
Moving yandex provider to new provider structure (apache#46525)
* Moving yandex provider to new provider structure * fixup! Moving yandex provider to new provider structure --------- Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
1 parent d469ce7 commit e9f84ae

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

69 files changed

+541
-1678
lines changed

.github/boring-cyborg.yml

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -304,10 +304,7 @@ labelPRBasedOnFilePath:
304304
- providers/weaviate/**
305305

306306
provider:yandex:
307-
- providers/src/airflow/providers/yandex/**/*
308-
- docs/apache-airflow-providers-yandex/**/*
309-
- providers/tests/yandex/**/*
310-
- providers/tests/system/yandex/**/*
307+
- providers/yandex/**
311308

312309
provider:ydb:
313310
- providers/ydb/**

Dockerfile.ci

Lines changed: 3 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -930,17 +930,12 @@ function check_boto_upgrade() {
930930
echo
931931
echo "${COLOR_BLUE}Upgrading boto3, botocore to latest version to run Amazon tests with them${COLOR_RESET}"
932932
echo
933-
# shellcheck disable=SC2086
934-
${PACKAGING_TOOL_CMD} uninstall ${EXTRA_UNINSTALL_FLAGS} aiobotocore s3fs yandexcloud opensearch-py || true
935-
# We need to include few dependencies to pass pip check with other dependencies:
936-
# * oss2 as dependency as otherwise jmespath will be bumped (sync with alibaba provider)
937-
# * cryptography is kept for snowflake-connector-python limitation (sync with snowflake provider)
938933
set -x
939934
# shellcheck disable=SC2086
940-
${PACKAGING_TOOL_CMD} install ${EXTRA_INSTALL_FLAGS} --upgrade boto3 botocore \
941-
"oss2>=2.14.0" "cryptography<43.0.0" "opensearch-py"
935+
${PACKAGING_TOOL_CMD} uninstall ${EXTRA_UNINSTALL_FLAGS} aiobotocore s3fs || true
936+
# shellcheck disable=SC2086
937+
${PACKAGING_TOOL_CMD} install ${EXTRA_INSTALL_FLAGS} --upgrade boto3 botocore
942938
set +x
943-
pip check
944939
}
945940

946941
function check_downgrade_sqlalchemy() {

dev/moving_providers/move_providers.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -134,7 +134,11 @@ def _do_stuff(
134134
if from_path.exists():
135135
shutil.move(from_path, to_path)
136136
console.print(f"\n[yellow]Moved {from_path} -> {to_path}\n")
137-
if remove_empty_parent_dir and len([path for path in from_path.parent.iterdir()]) == 0:
137+
if (
138+
remove_empty_parent_dir
139+
and from_path.exists()
140+
and len([path for path in from_path.parent.iterdir()]) == 0
141+
):
138142
console.print(f"\n[yellow]Removed also empty parent dir {from_path.parent}\n")
139143
from_path.parent.rmdir()
140144
return

docs/apache-airflow-providers-yandex/changelog.rst

Lines changed: 0 additions & 25 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/commits.rst

Lines changed: 0 additions & 492 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/configurations-ref.rst

Lines changed: 0 additions & 18 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/connections/yandexcloud.rst

Lines changed: 0 additions & 95 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/index.rst

Lines changed: 0 additions & 110 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/installing-providers-from-sources.rst

Lines changed: 0 additions & 18 deletions
This file was deleted.

docs/apache-airflow-providers-yandex/operators/dataproc.rst

Lines changed: 0 additions & 37 deletions
This file was deleted.

0 commit comments

Comments
 (0)