Skip to content

Commit 7ca424d

Browse files
PolberPolber
authored
[yaml] add mysql, oracle, postgres and sql server providers (#33124)
* [yaml] add JDBC docs Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> * Address comments Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> * remove baseDescription Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> * fix spotless Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> * fix failing tests Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> * remove hikari testImplementation for JDBCIO Signed-off-by: Jeffrey Kinard <jeff@thekinards.com> --------- Signed-off-by: Jeffrey Kinard <jeff@thekinards.com>
1 parent 0dc2c24 commit 7ca424d

18 files changed

+854
-161
lines changed

‎sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerReadSchemaTransformProvider.java‎

Lines changed: 23 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -76,40 +76,34 @@ public String description() {
7676
+ "\n"
7777
+ "Example configuration for performing a read using a SQL query: ::\n"
7878
+ "\n"
79-
+ " pipeline:\n"
80-
+ " transforms:\n"
81-
+ " - type: ReadFromSpanner\n"
82-
+ " config:\n"
83-
+ " instance_id: 'my-instance-id'\n"
84-
+ " database_id: 'my-database'\n"
85-
+ " query: 'SELECT * FROM table'\n"
79+
+ " - type: ReadFromSpanner\n"
80+
+ " config:\n"
81+
+ " instance_id: 'my-instance-id'\n"
82+
+ " database_id: 'my-database'\n"
83+
+ " query: 'SELECT * FROM table'\n"
8684
+ "\n"
8785
+ "It is also possible to read a table by specifying a table name and a list of columns. For "
8886
+ "example, the following configuration will perform a read on an entire table: ::\n"
8987
+ "\n"
90-
+ " pipeline:\n"
91-
+ " transforms:\n"
92-
+ " - type: ReadFromSpanner\n"
93-
+ " config:\n"
94-
+ " instance_id: 'my-instance-id'\n"
95-
+ " database_id: 'my-database'\n"
96-
+ " table: 'my-table'\n"
97-
+ " columns: ['col1', 'col2']\n"
88+
+ " - type: ReadFromSpanner\n"
89+
+ " config:\n"
90+
+ " instance_id: 'my-instance-id'\n"
91+
+ " database_id: 'my-database'\n"
92+
+ " table: 'my-table'\n"
93+
+ " columns: ['col1', 'col2']\n"
9894
+ "\n"
9995
+ "Additionally, to read using a <a href=\"https://cloud.google.com/spanner/docs/secondary-indexes\">"
10096
+ "Secondary Index</a>, specify the index name: ::"
10197
+ "\n"
102-
+ " pipeline:\n"
103-
+ " transforms:\n"
104-
+ " - type: ReadFromSpanner\n"
105-
+ " config:\n"
106-
+ " instance_id: 'my-instance-id'\n"
107-
+ " database_id: 'my-database'\n"
108-
+ " table: 'my-table'\n"
109-
+ " index: 'my-index'\n"
110-
+ " columns: ['col1', 'col2']\n"
98+
+ " - type: ReadFromSpanner\n"
99+
+ " config:\n"
100+
+ " instance_id: 'my-instance-id'\n"
101+
+ " database_id: 'my-database'\n"
102+
+ " table: 'my-table'\n"
103+
+ " index: 'my-index'\n"
104+
+ " columns: ['col1', 'col2']\n"
111105
+ "\n"
112-
+ "### Advanced Usage\n"
106+
+ "#### Advanced Usage\n"
113107
+ "\n"
114108
+ "Reads by default use the <a href=\"https://cloud.google.com/spanner/docs/reads#read_data_in_parallel\">"
115109
+ "PartitionQuery API</a> which enforces some limitations on the type of queries that can be used so that "
@@ -118,12 +112,10 @@ public String description() {
118112
+ "\n"
119113
+ "For example: ::"
120114
+ "\n"
121-
+ " pipeline:\n"
122-
+ " transforms:\n"
123-
+ " - type: ReadFromSpanner\n"
124-
+ " config:\n"
125-
+ " batching: false\n"
126-
+ " ...\n"
115+
+ " - type: ReadFromSpanner\n"
116+
+ " config:\n"
117+
+ " batching: false\n"
118+
+ " ...\n"
127119
+ "\n"
128120
+ "Note: See <a href=\""
129121
+ "https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.html\">"

‎sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerWriteSchemaTransformProvider.java‎

Lines changed: 6 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -84,14 +84,12 @@ public String description() {
8484
+ "\n"
8585
+ "Example configuration for performing a write to a single table: ::\n"
8686
+ "\n"
87-
+ " pipeline:\n"
88-
+ " transforms:\n"
89-
+ " - type: ReadFromSpanner\n"
90-
+ " config:\n"
91-
+ " project_id: 'my-project-id'\n"
92-
+ " instance_id: 'my-instance-id'\n"
93-
+ " database_id: 'my-database'\n"
94-
+ " table: 'my-table'\n"
87+
+ " - type: ReadFromSpanner\n"
88+
+ " config:\n"
89+
+ " project_id: 'my-project-id'\n"
90+
+ " instance_id: 'my-instance-id'\n"
91+
+ " database_id: 'my-database'\n"
92+
+ " table: 'my-table'\n"
9593
+ "\n"
9694
+ "Note: See <a href=\""
9795
+ "https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.html\">"

0 commit comments

Comments
 (0)