You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+57-16Lines changed: 57 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ After [installation](#install-ucx), ensure to [trigger](#ensure-assessment-run-c
8
8
so that you'll be able to [scope the migration](docs/assessment.md) and execute the [group migration workflow](#group-migration-workflow).
9
9
10
10
The [README notebook](#readme-notebook), which can be found in the installation folder contains further instructions and explanations of the different ucx workflows & dashboards.
11
-
Once the migration is scoped, you can start executing the [table migration workflow](#table-migration-workflow).
11
+
Once the migration is scoped, you can start with the [table migration process](#Table-Migration).
12
12
13
13
More workflows, like notebook code migration are coming in future releases.
14
14
@@ -269,7 +269,7 @@ Databricks CLI will confirm a few options:
269
269
# Migration process
270
270
271
271
On the high level, the steps in migration process start with the [assessment workflow](#assessment-workflow),
272
-
followed by [group migration](#group-migration-workflow), [table migration workflow](#table-migration-workflow),
272
+
followed by [group migration](#group-migration-workflow), [table migration process](#Table-Migration),
273
273
finalised with the [code migration](#code-migration-commands). It can be described as:
274
274
275
275
```mermaid
@@ -369,7 +369,7 @@ Databricks SQL warehouses, Delta Live Tables, Jobs, MLflow experiments, MLflow r
369
369
SQL Alerts, Token and Password usage permissions that are set on the workspace level, Secret scopes, Notebooks,
370
370
Directories, Repos, and Files.
371
371
372
-
Once done with the group migration, proceed to [table migration workflow](#table-migration-workflow).
372
+
Once done with the group migration, proceed to [table migration process](#Table-Migration).
373
373
374
374
Use [`validate-groups-membership` command](#validate-groups-membership-command) for extra confidence.
375
375
If you don't have matching account groups, please run [`create-account-groups` command](#create-account-groups-command).
@@ -536,7 +536,48 @@ We also add a `upgraded_from_workspace_id` property to the upgraded object, to i
536
536
537
537
The upgrade process can be triggered using the `migrate-tables`[UCX command](#migrate-tables-command)
538
538
539
-
Or by running the "Migrate Tables" workflow deployed to the workspace.
539
+
Or by running the table migration workflows deployed to the workspace.
migrate-tables -- 2nd, optional \n table migrated here \n will be excluded in ctas workflow --> mt_serde_inplace_wf
578
+
migrate-tables -- 3rd --> mt_ctas_wf
579
+
```
580
+
540
581
541
582
#### Step 4: Odds and Ends
542
583
The following steps can be used to repair/amend the metastore after the upgrade process.
@@ -809,7 +850,7 @@ the metastore id of the metastore you want to assign to the workspace.
809
850
810
851
# Table migration commands
811
852
812
-
These commands are vital part of [table migration workflow](#table-migration-workflow) process and require
853
+
These commands are vital part of [table migration process](#Table-Migration) process and require
813
854
the [assessment workflow](#assessment-workflow) and
814
855
[group migration workflow](#group-migration-workflow) to be completed.
815
856
See the [migration process diagram](#migration-process) to understand the role of the table migration commands in
@@ -923,7 +964,7 @@ workflows. Once migration is complete, this service principal should be unprovis
923
964
On Azure, it creates a principal with `Storage Blob Data Contributor` role assignment on every storage account using
924
965
Azure Resource Manager APIs.
925
966
926
-
This command is one of prerequisites for the [table migration workflow](#table-migration).
967
+
This command is one of prerequisites for the [table migration process](#table-migration).
927
968
928
969
[[back to top](#databricks-labs-ucx)]
929
970
@@ -1015,7 +1056,7 @@ multiple runs of the table migration workflow, you can use the [`revert-migrated
1015
1056
to revert the tables that were migrated in the previous run. You can also skip the tables that you don't want to migrate
1016
1057
using the [`skip` command](#skip-command).
1017
1058
1018
-
This command is one of prerequisites for the [table migration workflow](#table-migration-workflow).
1059
+
This command is one of prerequisites for the [table migration process](#Table-Migration).
1019
1060
1020
1061
Once you're done with table migration, proceed to the [code migration](#code-migration-commands).
1021
1062
@@ -1044,7 +1085,7 @@ Once you're done with table migration, proceed to the [code migration](#code-mig
1044
1085
databricks labs ucx create-catalogs-schemas
1045
1086
```
1046
1087
After [`create-table-mapping` command](#create-table-mapping-command) is executed, you can run this command to have the required UC catalogs and schemas created.
1047
-
This command is supposed to be run before migrating tables to UC using [table migration workflow](#table-migration-workflow).
1088
+
This command is supposed to be run before migrating tables to UC using [table migration process](#Table-Migration).
**Requires Databricks Account Administrator privileges.** This command uploads the workspace config to all workspaces
1218
1259
in the account where `ucx` is installed. This command is necessary to create an immutable default catalog mapping for
1219
-
[table migration](#table-migration-workflow) process and is the prerequisite
1260
+
[table migration](#Table-Migration) process and is the prerequisite
1220
1261
for [`create-table-mapping` command](#create-table-mapping-command).
1221
1262
1222
1263
If you cannot get account administrator privileges in reasonable time, you can take the risk and
@@ -1287,7 +1328,7 @@ This command is useful for administrators who want to ensure that the groups hav
1287
1328
used to debug issues related to group membership. See [group migration](docs/local-group-migration.md) and
1288
1329
[group migration](#group-migration-workflow) for more details.
1289
1330
1290
-
Valid group membership is important to ensure users has correct access after legacy table ACL is migrated in [table migration workflow](#table-migration-workflow)
1331
+
Valid group membership is important to ensure users has correct access after legacy table ACL is migrated in [table migration process](#Table-Migration)
0 commit comments