Updated demo gifs in readme and docs

Author: ravi-databricks

README.md

@@ -59,7 +59,7 @@ In practice, a single generic pipeline reads the Dataflowspec and uses it to orc
 | Liquid cluster support | Bronze, Bronze Quarantine, Silver tables|
 | [DLT-META CLI](https://databrickslabs.github.io/dlt-meta/getting_started/dltmeta_cli/) |  ```databricks labs dlt-meta onboard```, ```databricks labs dlt-meta deploy``` |
 | Bronze and Silver pipeline chaining | Deploy dlt-meta pipeline with ```layer=bronze_silver``` option using Direct publishing mode |
-| [create_sink](https://docs.databricks.com/aws/en/dlt-ref/dlt-python-ref-sink) API support |Supported formats:external ```delta table```, ```kafka```.Bronze, Silver layers|
+| [create_sink](https://docs.databricks.com/aws/en/dlt-ref/dlt-python-ref-sink) API support |Supported formats:```external delta table , kafka``` Bronze, Silver layers|
 | [Databricks Asset Bundles](https://docs.databricks.com/aws/en/dev-tools/bundles/) | Supported
 | [DLT-META UI](https://github.com/databrickslabs/dlt-meta/tree/main/lakehouse_app#dlt-meta-lakehouse-app-setup) | Uses Databricks Lakehouse DLT-META App
 
@@ -138,38 +138,37 @@ If you want to run existing demo files please follow these steps before running
     dlt_meta_home=$(pwd)
     export PYTHONPATH=$dlt_meta_home
     ```
+![onboardingDLTMeta.gif](docs/static/images/onboardingDLTMeta.gif)
+
+
 7. Run onboarding command:
     ```commandline
     databricks labs dlt-meta onboard
     ```
-![onboardingDLTMeta.gif](docs/static/images/onboardingDLTMeta.gif)
-
 
-Above commands will prompt you to provide onboarding details. If you have cloned dlt-meta git repo then accept defaults which will launch config from demo folder.
+The command will prompt you to provide onboarding details. If you have cloned the dlt-meta repository, you can accept the default values which will use the configuration from the demo folder.
 ![onboardingDLTMeta_2.gif](docs/static/images/onboardingDLTMeta_2.gif)
 
-
-- Goto your databricks workspace and located onboarding job under: Workflow->Jobs runs
+Above onboard cli command will:
+1. Push code and data to your Databricks workspace
+2. Create an onboarding job
+3. Display a success message: ```Job created successfully. job_id={job_id}, url=https://{databricks workspace url}/jobs/{job_id}```
+4. Job URL will automatically open in your default browser.
 
 ### depoly using dlt-meta CLI:
 
-- Once onboarding jobs is finished deploy `bronze` and `silver` DLT using below command
+- Once onboarding jobs is finished deploy Lakeflow Declarative Pipeline using below command
 - ```commandline
      databricks labs dlt-meta deploy
   ```
-- - Above command will prompt you to provide dlt details. Please provide respective details for schema which you provided in above steps
-- - Bronze DLT
-
-![deployingDLTMeta_bronze.gif](docs/static/images/deployingDLTMeta_bronze.gif)
+The command will prompt you to provide pipeline configuration details.
 
+![deployingDLTMeta_bronze_silver.gif](docs/static/images/deployingDLTMeta_bronze_silver.gif)
 
-- Silver DLT
-- - ```commandline
-       databricks labs dlt-meta deploy
-    ```
-- - Above command will prompt you to provide dlt details. Please provide respective details for schema which you provided in above steps
-
-![deployingDLTMeta_silver.gif](docs/static/images/deployingDLTMeta_silver.gif)
+Above deploy cli command will:
+1. Deploy Lakeflow Declarative pipeline with dlt-meta configuration like ```layer```, ```group```, ```dataflowSpec table details``` etc to your databricks workspace
+2. Display message: ```dlt-meta pipeline={pipeline_id} created and launched with update_id={pipeline_update_id}, url=https://{databricks workspace url}/#joblist/pipelines/{pipeline_id}```
+3. Pipline URL will automatically open in your defaul browser.
 
 
 ## More questions

docs/content/getting_started/dltmeta_cli.md

@@ -65,32 +65,32 @@ draft: false
  ```shell 
     databricks labs dlt-meta onboard
 ``` 
--  Above command will prompt you to provide onboarding details.
-- If you have cloned dlt-meta git repo then accepting defaults will launch config from [demo/conf](https://github.com/databrickslabs/dlt-meta/tree/main/demo/conf) folder.
-- You can create onboarding files e.g onboarding.json, data quality and silver transformations and put it in conf folder as show in [demo/conf](https://github.com/databrickslabs/dlt-meta/tree/main/demo/conf)
+- The command will prompt you to provide onboarding details. If you have cloned the dlt-meta repository, you can accept the default values which will use the configuration from the demo folder.
 
 ![onboardingDLTMeta_2.gif](/images/onboardingDLTMeta_2.gif)
 
-![onboardingDLTMeta.gif](/images/onboardingDLTMeta.gif)
+- Above onboard cli command will:
+   1. Push code and data to your Databricks workspace
+   2. Create an onboarding job
+   3. Display a success message: ```Job created successfully. job_id={job_id}, url=https://{databricks workspace url}/jobs/{job_id}```
+   4. Job URL will automatically open in your default browser.
+
 
 - Once onboarding jobs is finished deploy `bronze` and `silver` DLT using below command
 
-## Dataflow DLT Pipeline: 
+## DLT-META Lakeflow Declarative Pipeline: 
 
-#### Deploy Bronze DLT
+#### Deploy ```Bronze``` and ```Silver``` layer into single pipeline
  ```shell 
         databricks labs dlt-meta deploy
    ```
-- Above command will prompt you to provide dlt details. Please provide respective details for schema which you provided in above steps
+- Above command will prompt you to provide pipeline details. Please provide respective details for schema which you provided in above steps
 
-![deployingDLTMeta_bronze.gif](/images/deployingDLTMeta_bronze.gif)
+![deployingDLTMeta_bronze_silver.gif](/images/deployingDLTMeta_bronze_silver.gif)
 
-#### Deploy Silver DLT
- ```shell 
-        databricks labs dlt-meta deploy
-```
-- - Above command will prompt you to provide dlt details. Please provide respective details for schema which you provided in above steps
+- Above deploy cli command will:
+   1. Deploy Lakeflow Declarative pipeline with dlt-meta configuration like ```layer```, ```group```, ```dataflowSpec table details``` etc to your databricks workspace
+   2. Display message: ```dlt-meta pipeline={pipeline_id} created and launched with update_id={pipeline_update_id}, url=https://{databricks workspace url}/#joblist/pipelines/{pipeline_id}```
+   3. Pipline URL will automatically open in your defaul browser.
 
-![deployingDLTMeta_silver.gif](/images/deployingDLTMeta_silver.gif)
 
-- Goto your databricks workspace and located onboarding job under: Workflow->Jobs runs

docs/content/releases/_index.md

@@ -4,9 +4,27 @@ date: 2021-08-04T14:50:11-04:00
 weight: 80
 draft: false
 ---
+# v0.0.10
+## Enhancements
+- Added apply_changes_from_snapshot support in silver layer [PR](https://github.com/databrickslabs/dlt-meta/pull/187)
+- Added UI using databricks lakehouse app for onboarding/deploy commands [PR](https://github.com/databrickslabs/dlt-meta/pull/168)
+- Added support for non-Delta as sinks(delta, kafka) [PR](https://github.com/databrickslabs/dlt-meta/pull/157)
+- Added quarantine support in silver layer for data quality rules [PR](https://github.com/databrickslabs/dlt-meta/pull/191)
+- Added support for table comments, column comments, and cluster_by [PR](https://github.com/databrickslabs/dlt-meta/pull/91)
+- Added catalog support for sourceDetails and targetDetails [PR](https://github.com/databrickslabs/dlt-meta/issues/173)
+- Added DBDemos for dlt-meta [PR](https://github.com/databrickslabs/dlt-meta/issues/183)
+- Added YAML support for onboarding [PR](https://github.com/databrickslabs/dlt-meta/issues/184)
+- Fixed issue cluster by not working with bronze append only table [PR](https://github.com/databrickslabs/dlt-meta/issues/197)
+- Fixed issue view name containing period when using DPM [PR](https://github.com/databrickslabs/dlt-meta/issues/169)
+- Fixed issue CLI onboarding overwrite option always set to True [PR](https://github.com/databrickslabs/dlt-meta/issues/163)
+- Fixed issue Silver DLT not creating based on passed database [PR](https://github.com/databrickslabs/dlt-meta/issues/160)
+- Fixed issue PyPI download stats display [PR](https://github.com/databrickslabs/dlt-meta/issues/200)
+- Fixed issue Silver Data Quality not working [PR](https://github.com/databrickslabs/dlt-meta/issues/156)
+- Fixed issue Removed DPM flag check inside dataflowpipeline [PR](https://github.com/databrickslabs/dlt-meta/issues/177)
+- Fixed issue Updated dlt-meta demos into Delta Live Tables Notebook github [PR](https://github.com/databrickslabs/dlt-meta/issues/158)
 
 # v0.0.9
-## Enhancement
+## Enhancements
 - Added  apply_changes_from_snapshot api support in bronze layer: [PR](https://github.com/databrickslabs/dlt-meta/pull/124)
 - Added dlt append_flow api support for silver layer: [PR](https://github.com/databrickslabs/dlt-meta/pull/63)
 - Added support for file metadata columns for autoloader: [PR](https://github.com/databrickslabs/dlt-meta/pull/56)
@@ -27,7 +45,7 @@ draft: false
 - Fixed issue Onboarding with multiple partition columns errors out: [PR](https://github.com/databrickslabs/dlt-meta/pull/134)
 
 # v0.0.8
-## Enhancement
+## Enhancements
 - Added dlt append_flow api support: [PR](https://github.com/databrickslabs/dlt-meta/pull/58)
 - Added dlt append_flow api support for silver layer: [PR](https://github.com/databrickslabs/dlt-meta/pull/63)
 - Added support for file metadata columns for autoloader: [PR](https://github.com/databrickslabs/dlt-meta/pull/56)
@@ -45,14 +63,14 @@ draft: false
 
 
 # v0.0.7
-## Enhancement
+## Enhancements
 ### 1. Mismatched Keys: Update read_dlt_delta() with key "source_database" instead of "database" [#33](https://github.com/databrickslabs/dlt-meta/pull/33)
 ### 2. Create dlt-meta cli documentation #45 
 - Readme and docs to include above features
 
 
 # v0.0.6
-## Enhancement
+## Enhancements
 ### 1. Migrate to create_streaming_table api from create_streaming_live_table [#37](https://github.com/databrickslabs/dlt-meta/pull/39)
 #### Updates 
 - Readme and docs to include above features