Release 0.30.0 (#124)

* Documentation improvement (#80)

* Documentation improvement

* GitPython is not required anymore (#83)

Installation docs upgrade

* Documentation improvement (#80)

* Documentation improvement

* GitPython is not required anymore (#83)

Installation docs upgrade

* feat: looker integration for compile and deploy, new command: bi

* tests fix, looker git with ssh

* chore: organizing imports, removed not used variables

* chore: dbt2looker as extra dependency, mypy errors fix, bi-git-key-path option instead of key-path

* chore: formatting, types-requests dependency for mypy

* refactor: refactoring bi, removing bi command, fix tests, moving bi flags to bi.yml instead of call option

* Fix after rebase

* Fix after rebase

* Fix after rebase

* Fix after rebase

* Airbyte integration (#86)

* [DATA-366] Update datahub package and add dbt extra (#79)

Co-authored-by: Piotr Sierkin <[email protected]>

* Documentation improvement (#80)

* Added IAP Airbyte authorization with service account file

Co-authored-by: Piotr Sierkin <[email protected]>
Co-authored-by: Piotr Pękala <[email protected]>
Co-authored-by: Pawel Pinkos <[email protected]>
Co-authored-by: Pawel Jurkiewicz <[email protected]>
Co-authored-by: pawelpinkos <[email protected]>

* Service account OIDC ID token in deploy command (#91)

* Added possibility to pass platform-agnostic service account OIDC ID token to deploy command

* Added changelog information

* added 'source freshness' command to dbt compile

* Bump copier (#93)

* [DATA-366] Update datahub package and add dbt extra (#79)

* feat: update datahub package and add dbt extra

* fix: replace datahub requirements

* fix: pre-commit coma

Co-authored-by: Piotr Sierkin <[email protected]>

* Documentation improvement (#80)

* Documentation improvement

* dp compile default environment has been set to local

* GitPython is not required anymore (#83)

Installation docs upgrade

* chore: bump datahub (#84)

Co-authored-by: Piotr Sierkin <[email protected]>

* [DATA-366] Update datahub package and add dbt extra (#79)

* feat: update datahub package and add dbt extra

* fix: replace datahub requirements

* fix: pre-commit coma

Co-authored-by: Piotr Sierkin <[email protected]>

* Documentation improvement (#80)

* Documentation improvement

* GitPython is not required anymore (#83)

Installation docs upgrade

* chore: bump packages except copier

* fix: package name

* chore: add specific version for pyyaml

* fix: misspelling

* chore: test docs

* chore: test

* test

* test

* test

* test

* test

* test

* chore: bump packages

* chore: add renovate

* chore: bump copier

* chore: update exception

* fix: update by removing not existing flag

* chore: update tests

* feat: update schema on manifest to v7

* chore: bump packages

* chore: delete renovate

* chore: bump python version

* chore: remove junk

* chore: bring back old exception

* chore: add matrix to tox

* chore: add new require and classifier

* trigger

* chore(docs): update badge and changelog

* chore(docs): replace old extension

* chore: add description

* chore(docs): add old suffix and envops

* chore(docs): update changelog

* chore(docs): update changelog

* chore(docs): update copier

* chore: pinup version for dbt2looker

* chore(docs): update changelog

* chore: replace var for more meaningful

Co-authored-by: Piotr Sierkin <[email protected]>
Co-authored-by: Piotr Pękala <[email protected]>

* chore: downgrade version to properly prepare release

* chore(docs): fix date in changelog

* BI deployment is disabled when config is missing (#95)

* DATA-629: Added Airbyte configuration documentation (#97)

* feat: disable sync bucket (#102)

* chore: add flag to turn off bucket syncing with artefacts

* chore: replace default value

* chore(docs): updat changelog

* fix: add readthedocs config file

* chore: repair failing tests

* feat: add test for sync_bucket

* chore(docs): cosmetic changes in changelog

* chore: rename `sync-bucket` to `disable-bucket-sync`

* chore(docs): update with flag

* chore: replace `sync_bucket` with `disable_bucket_sync`

* chore: update name for `_bucket_sync`

---------

Co-authored-by: Piotr Sierkin <[email protected]>

* Fix failing readthedocs builds (#104)

* Removed sphinx action from prepare-release pipeline (#105)

* Bump werkzeug from 2.2.2 to 2.2.3 (#106)

* Bump werkzeug from 2.2.2 to 2.2.3

Bumps [werkzeug](https://github.com/pallets/werkzeug) from 2.2.2 to 2.2.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](pallets/werkzeug@2.2.2...2.2.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* bump codeclimate-action to 4.0.0

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Pawel Jurkiewicz <[email protected]>

* Airbyte fix creating multiple connections (#109)

* Fixing tests.

* Fix failing test.

* Remove redundant line.

* Add info about fix to CHANGELOG.md.

* Add workspace_id entry to config.

* Get rid of walrus operator & add test for missing workspace id.

* Fix wrong connection id in Airflow ingestion task.

* Fix typo in test name.

* Add fetching default workspace if not available in config.

* Increasign test coverage.

* Update workspace_id configuration description.

* Bumping Python version to 3.8 in prepare-release workflow.

* Pin pydantic version (#112)

* Pin Pydantic version until Copier fixes their dependency.

* Add info to changelog.

* Upgrade dbt to 1.5.4 (#114)

* Upgrade dbt to 1.5.4

* Fixing imports for publish.py

* Update of dbt_schema_version

* Updating manifest.json for tests

* Fix manifest for testing

* Fixing manifest cntd.

* Fixing manifest cntd.

* Replace example-project with exampleproject

* Adding tutorial for upgrading manifest in tests cntd.

* Fixing typos in the docs

* Version fixes before release

---------

Co-authored-by: Michal Rudko <[email protected]>

* Databricks generate job (#116)

* new feature

* small fixes

* dbt databricks factory requirement

* python 3.9 onwards

* testing

* linting

* annotations fix

* linting

* no docs

* linting

* update docs

* testing

* tests with databricks

* testenv

* Upgrade pyyaml

* Dbt glue (#118)

* DBT glue

* DBT glue

* DBT glue

* DBT glue

* Dbt glue with spark (#120)

* Dbt glue with spark

* Fixing dp cli

* Dbt upgtade (#122)

* Dbt upgrade to 1.7

* Dbt upgrade to 1.7

* Fixing dp cli

* Upgrade versions

* Upgrade versions

* FIX #124  - Bump version and CHANGELOG for release 0.30.0

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Piotr Pękala <[email protected]>
Co-authored-by: Pawel Pinkos <[email protected]>
Co-authored-by: Piotr Sierkin <[email protected]>
Co-authored-by: Piotr Sierkin <[email protected]>
Co-authored-by: Pawel Jurkiewicz <[email protected]>
Co-authored-by: pawelpinkos <[email protected]>
Co-authored-by: github-actions <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jakub Szafran <[email protected]>
Co-authored-by: jszafran <[email protected]>
Co-authored-by: michalrudko <[email protected]>
Co-authored-by: Michal Rudko <[email protected]>
Co-authored-by: ptutak-getindata <[email protected]>

Author: 12 people

CHANGELOG.md

@@ -2,6 +2,8 @@
 
 ## [Unreleased]
 
+## [0.30.0] - 2023-12-08
+
 ## [0.29.0] - 2023-12-08
 
 ## [0.28.0] - 2023-12-08
@@ -278,7 +280,9 @@
 -   Draft of `dp init`, `dp create`, `dp template new`, `dp template list` and `dp dbt`
 -   Draft of `dp compile` and `dp deploy`
 
-[Unreleased]: https://github.com/getindata/data-pipelines-cli/compare/0.29.0...HEAD
+[Unreleased]: https://github.com/getindata/data-pipelines-cli/compare/0.30.0...HEAD
+
+[0.30.0]: https://github.com/getindata/data-pipelines-cli/compare/0.29.0...0.30.0
 
 [0.29.0]: https://github.com/getindata/data-pipelines-cli/compare/0.28.0...0.29.0
 

data_pipelines_cli/__init__.py

@@ -5,4 +5,4 @@
 pipelines.
 """
 
-version = "0.29.0"
+version = "0.30.0"

setup.cfg

@@ -1,5 +1,5 @@
 [bumpversion]
-current_version = 0.29.0
+current_version = 0.30.0
 
 [bumpversion:file:setup.py]
 

setup.py

@@ -13,16 +13,16 @@
     "types-PyYAML==6.0.12.2",
     "copier==7.0.1",
     "Jinja2==3.1.2",
-    "fsspec==2022.11.0",
+    "fsspec==2023.12.1",
     "packaging==21.3",
     "colorama==0.4.5",
     "dbt-core==1.7.3",
     "pydantic<2",
 ]
 
 EXTRA_FILESYSTEMS_REQUIRE = {
-    "gcs": ["gcsfs==2022.11.0"],
-    "s3": ["s3fs==2022.11.0"],
+    "gcs": ["gcsfs==2023.12.1"],
+    "s3": ["s3fs==2023.12.1"],
 }
 
 EXTRA_REQUIRE = {
@@ -42,7 +42,7 @@
     ],
     # ---
     "docker": ["docker==6.0.1"],
-    "datahub": ["acryl-datahub[dbt]==0.10.4"],
+    "datahub": ["acryl-datahub[dbt]==0.12.0.5"],
     "git": ["GitPython==3.1.29"],
     "looker": ["dbt2looker==0.11.0"],
     "tests": [
@@ -55,8 +55,8 @@
         "gcp-storage-emulator==2022.6.11",
         "GitPython==3.1.29",
         "types-requests==2.28.11.5",
-        "gcsfs==2022.11.0",
-        "s3fs==2022.11.0",
+        "gcsfs==2023.12.1",
+        "s3fs==2023.12.1",
     ],
     "docs": [
         "sphinx==5.3.0",
@@ -72,7 +72,7 @@
 
 setup(
     name="data_pipelines_cli",
-    version="0.29.0",
+    version="0.30.0",
     description="CLI for data platform",
     long_description=README,
     long_description_content_type="text/markdown",