Skip to content

Commit ebecc7d

Browse files
albertshaualbertshau
authored
Merge pull request #51 from vladhlinskiy/feature/CDAP-15519-reference-doc-updates
CDAP-15519 Reference doc updates
2 parents 8903da9 + 937ab7e commit ebecc7d

File tree

6 files changed

+154
-19
lines changed

6 files changed

+154
-19
lines changed

‎mssql-plugin/docs/SqlServer-batchsink.md‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,8 @@ Data Types Mapping
8888
| DATE | date | |
8989
| DATETIME | timestamp | |
9090
| DATETIME2 | timestamp | |
91-
| DATETIMEOFFSET | string | |
91+
| DATETIMEOFFSET | string | DATETIMEOFFSET string literal in the following format: |
92+
| | | "2019-06-24 16:19:15.8010000 +03:00" |
9293
| DECIMAL | decimal | |
9394
| FLOAT | double | |
9495
| IMAGE | bytes | |
@@ -126,6 +127,7 @@ Data Types Mapping
126127
| | | such as "POINT(3 40 5 6)". |
127128
| GEOGRAPHY | string | Values of this type can be set from Well Known Text strings, |
128129
| | | such as "POINT(3 40 5 6)". |
130+
| TIMESTAMP | | TIMESTAMP data type is not supported for the sink |
129131

130132

131133
Example

‎mysql-plugin/docs/Mysql-batchsink.md‎

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -58,6 +58,42 @@ connections.
5858
**SQL_MODE:** Override the default SQL_MODE session variable used by the server.
5959

6060

61+
Data Types Mapping
62+
----------
63+
64+
| MySQL Data Type | CDAP Schema Data Type | Comment |
65+
| ------------------------------ | --------------------- | -------------------------------------------------- |
66+
| BIT | boolean | |
67+
| TINYINT | int | |
68+
| BOOL, BOOLEAN | boolean | |
69+
| SMALLINT | int | |
70+
| MEDIUMINT | double | |
71+
| INT,INTEGER | int | |
72+
| BIGINT | long | |
73+
| FLOAT | float | |
74+
| DOUBLE | double | |
75+
| DECIMAL | decimal | |
76+
| DATE | date | |
77+
| DATETIME | timestamp | |
78+
| TIMESTAMP | timestamp | |
79+
| TIME | time | |
80+
| YEAR | date | |
81+
| CHAR | string | |
82+
| VARCHAR | string | |
83+
| BINARY | bytes | |
84+
| VARBINARY | bytes | |
85+
| TINYBLOB | bytes | |
86+
| TINYTEXT | string | |
87+
| BLOB | bytes | |
88+
| TEXT | string | |
89+
| MEDIUMBLOB | bytes | |
90+
| MEDIUMTEXT | string | |
91+
| LONGBLOB | bytes | |
92+
| LONGTEXT | string | |
93+
| ENUM | string | |
94+
| SET | string | |
95+
96+
6197
Example
6298
-------
6399
Suppose you want to write output records to "users" table of MySQL database named "prod" that is running on "localhost",

‎mysql-plugin/docs/Mysql-batchsource.md‎

Lines changed: 42 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -74,6 +74,42 @@ connections.
7474
**SQL_MODE:** Override the default SQL_MODE session variable used by the server.
7575

7676

77+
Data Types Mapping
78+
----------
79+
80+
| MySQL Data Type | CDAP Schema Data Type | Comment |
81+
| ------------------------------ | --------------------- | -------------------------------------------------- |
82+
| BIT | boolean | |
83+
| TINYINT | int | |
84+
| BOOL, BOOLEAN | boolean | |
85+
| SMALLINT | int | |
86+
| MEDIUMINT | double | |
87+
| INT,INTEGER | int | |
88+
| BIGINT | long | |
89+
| FLOAT | float | |
90+
| DOUBLE | double | |
91+
| DECIMAL | decimal | |
92+
| DATE | date | |
93+
| DATETIME | timestamp | |
94+
| TIMESTAMP | timestamp | |
95+
| TIME | time | |
96+
| YEAR | date | |
97+
| CHAR | string | |
98+
| VARCHAR | string | |
99+
| BINARY | bytes | |
100+
| VARBINARY | bytes | |
101+
| TINYBLOB | bytes | |
102+
| TINYTEXT | string | |
103+
| BLOB | bytes | |
104+
| TEXT | string | |
105+
| MEDIUMBLOB | bytes | |
106+
| MEDIUMTEXT | string | |
107+
| LONGBLOB | bytes | |
108+
| LONGTEXT | string | |
109+
| ENUM | string | |
110+
| SET | string | |
111+
112+
77113
Example
78114
------
79115
Suppose you want to read data from MySQL database named "prod" that is running on "localhost" port 3306,
@@ -96,9 +132,9 @@ Password: "root"
96132
For example, if the 'id' column is a primary key of type int and the other columns are
97133
non-nullable varchars, output records will have this schema:
98134

99-
| field name | type |
100-
| -------------- | ------------------- |
101-
| id | int |
102-
| name | string |
103-
| email | string |
104-
| phone | string |
135+
| field name | type |
136+
| -------------- | ------------------- |
137+
| id | int |
138+
| name | string |
139+
| email | string |
140+
| phone | string |

‎netezza-plugin/docs/Netezza-batchsink.md‎

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,36 @@ Properties
3636
**Connection Arguments:** A list of arbitrary string key/value pairs as connection arguments. These arguments
3737
will be passed to the JDBC driver as connection arguments for JDBC drivers that may need additional configurations.
3838

39+
40+
Data Types Mapping
41+
----------
42+
43+
| Netezza Data Type | CDAP Schema Data Type | Comment |
44+
| ------------------------------ | --------------------- | -------------------------------------------------- |
45+
| BOOLEAN | boolean | |
46+
| BYTEINT | int | |
47+
| CHAR | string | |
48+
| DATE | date | |
49+
| NUMERIC, DECIMAL | decimal | |
50+
| FLOAT(1-6) | float | Floating point number with precision of 6 or less |
51+
| FLOAT(7-15) | double | Floating point number with precision of 7 - 15 |
52+
| REAL | float | Equivalent to FLOAT(6) |
53+
| DOUBLE PRECISION | double | |
54+
| INTEGER | int | |
55+
| SMALLINT | int | |
56+
| BIGINT | long | |
57+
| NCHAR | string | |
58+
| NVARCHAR | string | |
59+
| TIME | time | |
60+
| TIMETZ, TIME WITH TIME ZONE | string | Time with time zone string literal in the |
61+
| | | following format: "13:24:16+03" |
62+
| TIMESTAMP | timestampt | |
63+
| VARCHAR | string | |
64+
| INTERVAL | string | |
65+
| VARBINARY | bytes | |
66+
| ST_GEOMETRY | bytes | |
67+
68+
3969
Example
4070
-------
4171
Suppose you want to write output records to "users" table of Netezza database named "prod" that is running on "localhost",

‎netezza-plugin/docs/Netezza-batchsource.md‎

Lines changed: 37 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,37 @@ back from the query. However, it must match the schema that comes back from the
5151
except it can mark fields as nullable and can contain a subset of the fields.
5252

5353

54+
Data Types Mapping
55+
----------
56+
57+
| Netezza Data Type | CDAP Schema Data Type | Comment |
58+
| ------------------------------ | --------------------- | -------------------------------------------------- |
59+
| BOOLEAN | boolean | |
60+
| BYTEINT | int | |
61+
| CHAR | string | |
62+
| DATE | date | |
63+
| NUMERIC, DECIMAL | decimal | |
64+
| FLOAT(1-6) | float | Floating point number with precision of 6 or less |
65+
| FLOAT(7-15) | double | Floating point number with precision of 7 - 15 |
66+
| REAL | float | Equivalent to FLOAT(6) |
67+
| DOUBLE PRECISION | double | |
68+
| INTEGER | int | |
69+
| SMALLINT | int | |
70+
| BIGINT | long | |
71+
| NCHAR | string | |
72+
| NVARCHAR | string | |
73+
| TIME | time | |
74+
| TIMETZ, TIME WITH TIME ZONE | string | |
75+
| | | |
76+
| TIMESTAMP | timestampt | |
77+
| VARCHAR | string | |
78+
| INTERVAL | string | |
79+
| VARBINARY | bytes | |
80+
| ST_GEOMETRY | bytes | |
81+
82+
83+
84+
5485
Example
5586
------
5687
Suppose you want to read data from Netezza database named "prod" that is running on "localhost" port 5480,
@@ -73,9 +104,9 @@ Password: "testpwsd"
73104
For example, if the 'id' column is a primary key of type int and the other columns are
74105
non-nullable varchars, output records will have this schema:
75106

76-
| field name | type |
77-
| -------------- | ------------------- |
78-
| id | int |
79-
| name | string |
80-
| email | string |
81-
| phone | string |
107+
| field name | type |
108+
| -------------- | ------------------- |
109+
| id | int |
110+
| name | string |
111+
| email | string |
112+
| phone | string |

‎postgresql-plugin/docs/Postgres-batchsource.md‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -77,9 +77,9 @@ Password: "postgres"
7777
For example, if the 'id' column is a primary key of type int and the other columns are
7878
non-nullable varchars, output records will have this schema:
7979

80-
| field name | type |
81-
| -------------- | ------------------- |
82-
| id | int |
83-
| name | string |
84-
| email | string |
85-
| phone | string |
80+
| field name | type |
81+
| -------------- | ------------------- |
82+
| id | int |
83+
| name | string |
84+
| email | string |
85+
| phone | string |

0 commit comments

Comments
 (0)