@@ -13,37 +13,63 @@ You can access the connector in two different ways:
13131 . From
1414 our [ Maven Central repository] ( https://repo1.maven.org/maven2/com/google/cloud/spark/bigtable ) .
15152 . Through a public GCS bucket, located
16- at ` gs://spark-lib/bigtable/spark-bigtable_2.12-<version>.jar ` .
16+ at ` gs://spark-lib/bigtable/spark-bigtable_2.13-<version>.jar ` or ` gs://spark-lib/bigtable/spark-bigtable_2. 12-<version>.jar` .
1717
1818In Java and Scala applications, you can use different dependency management
1919tools (e.g., Maven, sbt, or Gradle) to access the
20- connector ` com.google.cloud.spark.bigtable:spark-bigtable_2.12:<version> ` (
21- current ` <version> ` is ` 0.3.0 ` ) and package it inside your application JAR using
22- libraries such as Maven Shade Plugin. For PySpark applications, you can use
23- the ` --jars ` flag to pass the GCS address of the connector when submitting it.
20+ connector ` com.google.cloud.spark.bigtable:spark-bigtable_2.13:<version> ` or
21+ ` com.google.cloud.spark.bigtable:spark-bigtable_2.12:<version> ` (current
22+ ` <version> ` is ` 0.4.0 ` ) and package it inside your application JAR
23+ using libraries such as Maven Shade Plugin. For PySpark applications, you can
24+ use the ` --jars ` flag to pass the GCS address of the connector when submitting
25+ it.
2426
2527For Maven, you can add the following snippet to your ` pom.xml ` file:
2628
2729``` xml
30+ <!-- If you are using scala 2.13 -->
31+ <dependency >
32+ <groupId >com.google.cloud.spark.bigtable</groupId >
33+ <artifactId >spark-bigtable_2.13</artifactId >
34+ <version >0.4.0</version >
35+ </dependency >
36+ ```
37+
38+ ``` xml
39+ <!-- If you are using scala 2.12 -->
2840<dependency >
2941 <groupId >com.google.cloud.spark.bigtable</groupId >
3042 <artifactId >spark-bigtable_2.12</artifactId >
31- <version >0.3 .0</version >
43+ <version >0.4 .0</version >
3244</dependency >
3345```
3446
3547For sbt, you can add the following to your ` build.sbt ` file:
3648
3749```
38- libraryDependencies += "com.google.cloud.spark.bigtable" % "spark-bigtable_2.12" % "0.3.0"
50+ // for scala 2.13
51+ libraryDependencies += "com.google.cloud.spark.bigtable" % "spark-bigtable_2.13" % "0.4.0"
52+ ```
53+
54+ ```
55+ // for scala 2.12
56+ libraryDependencies += "com.google.cloud.spark.bigtable" % "spark-bigtable_2.12" % "0.4.0"
3957```
4058
4159Finally, you can add the following to your ` build.gradle ` file when using
4260Gradle:
4361
4462```
63+ // for scala 2.13
64+ dependencies {
65+ implementation group: 'com.google.cloud.bigtable', name: 'spark-bigtable_2.13', version: '0.4.0'
66+ }
67+ ```
68+
69+ ```
70+ // for scala 2.12
4571dependencies {
46- implementation group: 'com.google.cloud.bigtable', name: 'spark-bigtable_2.12', version: '0.3 .0'
72+ implementation group: 'com.google.cloud.bigtable', name: 'spark-bigtable_2.12', version: '0.4 .0'
4773}
4874```
4975
@@ -92,10 +118,11 @@ You need the following depending on the environments you choose to use:
92118
93119### Supported Spark versions
94120
95- The connector supports the following Spark versions ** with Scala 2.12 ** :
121+ The connector supports the following Spark versions:
96122
97123| Scala version | Spark versions | Spark Application Languages |
98124| ---------------| -----------------------------------| ---------------------------------------------------------|
125+ | 2.13 | 3.1.x, 3.2.x, 3.4.x, 3.5.x | Java, Scala, PySpark (` .py ` files or Jupyter notebooks) |
99126| 2.12 | 2.4.8, 3.1.x, 3.2.x, 3.4.x, 3.5.x | Java, Scala, PySpark (` .py ` files or Jupyter notebooks) |
100127
101128## Main features
@@ -306,7 +333,7 @@ objects to the following function:
306333
307334``` scala
308335bigtableRDD.writeRDD(
309- rdd : RDD [RowMutationEntry ],
336+ rdd : RDD [RowMutationEntry ],
310337 tableId : String ,
311338 bigtableSparkConf : BigtableSparkConf
312339)
@@ -326,7 +353,7 @@ corresponding to the options you want to set in your workflow. You can use the
326353` BigtableSparkConfBuilder ` class to create an instance of this class:
327354
328355``` scala
329- val bigtableSparkConf : BigtableSparkConf =
356+ val bigtableSparkConf : BigtableSparkConf =
330357 new BigtableSparkConfBuilder ()
331358 .setProjectId(someProjectId)
332359 .setInstanceId(someInstanceId)
0 commit comments