File tree Expand file tree Collapse file tree 1 file changed +1
-21
lines changed Expand file tree Collapse file tree 1 file changed +1
-21
lines changed Original file line number Diff line number Diff line change @@ -17,27 +17,7 @@ tar -xvzf <spark downloaded file name>
17
17
# Steps:
18
18
19
19
1 . sparkConf.properties file needs to be configured as applicable for the environment
20
- > A sample Spark conf file configuration can be found here: ` astra-spark-migration-ranges/src/resources/sparkConf.properties `
21
-
22
- ```
23
- Example of the conf file is below: -
24
- spark.migrate.source.isAstra false
25
- spark.migrate.source.host <host contact point>
26
- spark.migrate.source.username <username>
27
- spark.migrate.source.password <password>
28
- spark.migrate.source.read.consistency.level LOCAL_QUORUM
29
- spark.migrate.source.keyspaceTable test.a1
30
-
31
- spark.migrate.destination.isAstra true
32
- spark.migrate.destination.scb file:///aaa/bbb/secure-connect-enterprise.zip
33
- spark.migrate.destination.username <astra-client-id>
34
- spark.migrate.destination.password <astra-client-secret>
35
- spark.migrate.destination.read.consistency.level LOCAL_QUORUM
36
- spark.migrate.destination.keyspaceTable test.a2
37
- spark.migrate.destination.autocorrect.missing false
38
- spark.migrate.destination.autocorrect.mismatch false
39
- ```
40
-
20
+ > A sample Spark conf file configuration can be [ found here] ( ./src/resources/sparkConf.properties )
41
21
2 . Place the conf file where it can be accessed while running the job via spark-submit.
42
22
3 . Generate a fat jar (` migrate-0.x.jar ` ) using command ` mvn clean package `
43
23
4 . Run the 'Data Migration' job using ` spark-submit ` command as shown below:
You can’t perform that action at this time.
0 commit comments