File tree Expand file tree Collapse file tree 5 files changed +14
-9
lines changed Expand file tree Collapse file tree 5 files changed +14
-9
lines changed Original file line number Diff line number Diff line change @@ -36,3 +36,8 @@ include::partial$cdm-validation-steps.adoc[]
36
36
== Perform large-field guardrail violation checks
37
37
38
38
include::partial$cdm-guardrail-checks.adoc[]
39
+
40
+ [[cdm-next-steps]]
41
+ == Next steps
42
+
43
+ For advanced operations, see documentation at the repository https://github.com/datastax/cassandra-data-migrator.
Original file line number Diff line number Diff line change 9
9
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
10
10
--conf spark.cdm.feature.guardrail.colSizeInKB=10000 \
11
11
--master "local[*]" --driver-memory 25G --executor-memory 25G \
12
- --class com.datastax.cdm.job.GuardrailCheck cassandra-data-migrator-4 .x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
12
+ --class com.datastax.cdm.job.GuardrailCheck cassandra-data-migrator-5 .x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
13
13
----
Original file line number Diff line number Diff line change @@ -2,15 +2,15 @@ Read the prerequisites below before using the Cassandra Data Migrator.
2
2
3
3
* Install or switch to Java 11.
4
4
The Spark binaries are compiled with this version of Java.
5
- * Select a single VM to run this job and install https://archive.apache.org/dist/spark/spark-3.5.2 /[Spark 3.5.2 ] there.
6
- No cluster is necessary.
7
- * Optionally, install https://maven.apache.org/download.cgi[Maven] 3.9.x if you want to build the JAR for local development.
5
+ * Select a single VM to run this job and install https://archive.apache.org/dist/spark/spark-3.5.3 /[Spark 3.5.3 ] there.
6
+ No cluster is necessary and is recommended for most one-time migrations however cluster mode is also supported for complex migrations .
7
+ * Optionally, install https://maven.apache.org/download.cgi[Maven] ` 3.9.x` if you want to build the JAR for local development.
8
8
9
9
Run the following commands to install Apache Spark:
10
10
11
11
[source,bash]
12
12
----
13
- wget https://archive.apache.org/dist/spark/spark-3.5.2 /spark-3.5.2 -bin-hadoop3-scala2.13.tgz
13
+ wget https://archive.apache.org/dist/spark/spark-3.5.3 /spark-3.5.3 -bin-hadoop3-scala2.13.tgz
14
14
15
- tar -xvzf spark-3.5.2 -bin-hadoop3-scala2.13.tgz
15
+ tar -xvzf spark-3.5.3 -bin-hadoop3-scala2.13.tgz
16
16
----
Original file line number Diff line number Diff line change 6
6
./spark-submit --properties-file cdm.properties \
7
7
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
8
8
--master "local[*]" --driver-memory 25G --executor-memory 25G \
9
- --class com.datastax.cdm.job.DiffData cassandra-data-migrator-x.y.z .jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
9
+ --class com.datastax.cdm.job.DiffData cassandra-data-migrator-5.x.x .jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
10
10
----
11
11
12
12
The {cstar-data-migrator} validation job reports differences as `ERROR` entries in the log file.
@@ -41,6 +41,6 @@ spark.cdm.autocorrect.mismatch false|true
41
41
42
42
[IMPORTANT]
43
43
====
44
- The {cstar-data-migrator} validation job never deletes records from the target cluster .
44
+ The {cstar-data-migrator} validation job never deletes records from the source or target clusters .
45
45
The job only adds or updates data on the target cluster.
46
46
====
Original file line number Diff line number Diff line change @@ -17,7 +17,7 @@ This is the full set of configurable settings.
17
17
./spark-submit --properties-file cdm.properties \
18
18
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
19
19
--master "local[*]" --driver-memory 25G --executor-memory 25G \
20
- --class com.datastax.cdm.job.Migrate cassandra-data-migrator-x.y.z .jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
20
+ --class com.datastax.cdm.job.Migrate cassandra-data-migrator-x.x.x .jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
21
21
----
22
22
23
23
[TIP]
You can’t perform that action at this time.
0 commit comments