updated docs, readme for:

1.Updating feature table with latest api names
2.Updated docs readme for metadata prep info
3.Updated docs cli readme to add dev requirements

Author: ravi-databricks

README.md

@@ -53,14 +53,15 @@ In practice, a single generic pipeline reads the Dataflowspec and uses it to orc
 | Custom transformations | Bronze, Silver layer accepts custom functions|
 | Data Quality Expecations Support | Bronze, Silver layer |
 | Quarantine table support | Bronze layer |
-| [apply_changes](https://docs.databricks.com/en/delta-live-tables/python-ref.html#cdc) API support | Bronze, Silver layer | 
-| [apply_changes_from_snapshot](https://docs.databricks.com/en/delta-live-tables/python-ref.html#change-data-capture-from-database-snapshots-with-python-in-delta-live-tables) API support | Bronze layer|
+| [create_auto_cdc_flow](https://docs.databricks.com/aws/en/dlt-ref/dlt-python-ref-apply-changes) API support | Bronze, Silver layer | 
+| [create_auto_cdc_from_snapshot_flow](https://docs.databricks.com/aws/en/dlt-ref/dlt-python-ref-apply-changes-from-snapshot) API support | Bronze layer|
 | [append_flow](https://docs.databricks.com/en/delta-live-tables/flows.html#use-append-flow-to-write-to-a-streaming-table-from-multiple-source-streams) API support | Bronze layer|
 | Liquid cluster support | Bronze, Bronze Quarantine, Silver tables|
 | [DLT-META CLI](https://databrickslabs.github.io/dlt-meta/getting_started/dltmeta_cli/) |  ```databricks labs dlt-meta onboard```, ```databricks labs dlt-meta deploy``` |
 | Bronze and Silver pipeline chaining | Deploy dlt-meta pipeline with ```layer=bronze_silver``` option using Direct publishing mode |
-| [DLT Sinks](https://docs.databricks.com/aws/en/delta-live-tables/dlt-sinks) |Supported formats:external ```delta table```, ```kafka```.Bronze, Silver layers|
+| [create_sink](https://docs.databricks.com/aws/en/dlt-ref/dlt-python-ref-sink) API support |Supported formats:external ```delta table```, ```kafka```.Bronze, Silver layers|
 | [Databricks Asset Bundles](https://docs.databricks.com/aws/en/dev-tools/bundles/) | Supported
+| [DLT-META UI](https://github.com/databrickslabs/dlt-meta/tree/main/lakehouse_app#dlt-meta-lakehouse-app-setup) | Uses Databricks Lakehouse DLT-META App
 
 ## Getting Started
 

docs/content/getting_started/dltmeta_cli.md

@@ -5,20 +5,58 @@ weight: 7
 draft: false
 ---
 
-### pre-requisites:
-- [Databricks CLI](https://docs.databricks.com/en/dev-tools/cli/tutorial.html)
-- Once you install Databricks CLI, authenticate your current machine to a Databricks Workspace:
-   
-   ```commandline
-   databricks auth login --host WORKSPACE_HOST
-   ```
+### Prerequisites:
 - Python 3.8.0 +
-##### Steps:
-1. ``` git clone https://github.com/databrickslabs/dlt-meta.git ```
-2. ``` cd dlt-meta ```
-3. ``` python -m venv .venv ```
-4. ```source .venv/bin/activate ```
-5. ``` pip install databricks-sdk ```
+- [Databricks CLI](https://docs.databricks.com/en/dev-tools/cli/tutorial.html)
+
+### Steps:
+1. Install and authenticate Databricks CLI:
+    ```commandline
+    databricks auth login --host WORKSPACE_HOST
+    ```
+
+2. Install dlt-meta via Databricks CLI:
+    ```commandline
+    databricks labs install dlt-meta
+    ```
+
+3. Clone dlt-meta repository:
+    ```commandline
+    git clone https://github.com/databrickslabs/dlt-meta.git
+    ```
+
+4. Navigate to project directory:
+    ```commandline
+    cd dlt-meta
+    ```
+
+5. Create Python virtual environment:
+    ```commandline
+    python -m venv .venv
+    ```
+
+6. Activate virtual environment:
+    ```commandline
+    source .venv/bin/activate
+    ```
+
+7. Install required packages:
+    ```commandline
+    # Core requirements
+    pip install "PyYAML>=6.0" setuptools databricks-sdk
+
+    # Development requirements
+    pip install flake8==6.0 delta-spark==3.0.0 pytest>=7.0.0 coverage>=7.0.0 pyspark==3.5.5
+
+    # Integration test requirements
+    pip install "typer[all]==0.6.1"
+    ```
+
+8. Set environment variables:
+    ```commandline
+    dlt_meta_home=$(pwd)
+    export PYTHONPATH=$dlt_meta_home
+    ```
 
 ![onboardingDLTMeta.gif](/images/onboardingDLTMeta.gif)
 

docs/content/getting_started/metadatapreperation.md

@@ -64,8 +64,7 @@ The `onboarding.json` file contains links to [silver_transformations.json](https
 | silver_transformation_json | Silver table sql transformation json path |
 | silver_data_quality_expectations_json_{env} | Silver table data quality expectations json file path
 | silver_append_flows | Silver table append flows json. e.g.`"silver_append_flows":[{"name":"customer_bronze_flow", 
-| silver_apply_changes_from_snapshot | Silver apply changes from snapshot Json e.g. Mandatory fields: keys=["userId"], scd_type=`1` or `2` optional fields: track_history_column_list=`[col1]`, track_history_except_column_list=`[col2]` | 
-"create_streaming_table": false,"source_format": "cloudFiles", "source_details": {"source_database": "APP","source_table":"CUSTOMERS", "source_path_dev": "tests/resources/data/customers", "source_schema_path": "tests/resources/schema/customer_schema.ddl"},"reader_options": {"cloudFiles.format": "json","cloudFiles.inferColumnTypes": "true","cloudFiles.rescuedDataColumn": "_rescued_data"},"once": true}]`|
+| silver_apply_changes_from_snapshot | Silver apply changes from snapshot Json e.g. Mandatory fields: keys=["userId"], scd_type=`1` or `2` optional fields: track_history_column_list=`[col1]`, track_history_except_column_list=`[col2]`|