Commit 30fd958
authored
feat(bigquery): add GEOGRAPHY type support for BigQuery I/O (#36121)
* feat(bigquery): add GEOGRAPHY type support for BigQuery I/O
Add support for BigQuery GEOGRAPHY type which works with Well-Known Text (WKT) format. The change includes:
- Adding GEOGRAPHY to type mappings in bigquery_tools and bigquery_schema_tools
- Implementing GeographyType logical type in schemas.py
- Adding comprehensive tests for GEOGRAPHY type conversion and schema integration
* fixed tests
* tests
* fixed tests
* fixes language_type
* fixed logical type
* urns
* add BQ IT
* yapf
* feat(bigquery): add project handling and test improvements
- Add _get_project method to handle project billing in BigQuery source
- Update tests to explicitly specify project parameter
- Fix geography test data formats and simplify test cases
- Add temporary storage location for file load tests
* lint
* format
* removed GeographyType for now
* restore schemas.py
* added uses_gcp_java_expansion_service1 parent 6562b5b commit 30fd958
File tree
6 files changed
+841
-4
lines changed- sdks/python/apache_beam/io/gcp
6 files changed
+841
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1029 | 1029 | | |
1030 | 1030 | | |
1031 | 1031 | | |
| 1032 | + | |
| 1033 | + | |
| 1034 | + | |
| 1035 | + | |
| 1036 | + | |
| 1037 | + | |
| 1038 | + | |
| 1039 | + | |
| 1040 | + | |
| 1041 | + | |
1032 | 1042 | | |
1033 | 1043 | | |
1034 | 1044 | | |
| |||
1164 | 1174 | | |
1165 | 1175 | | |
1166 | 1176 | | |
| 1177 | + | |
| 1178 | + | |
| 1179 | + | |
1167 | 1180 | | |
1168 | 1181 | | |
1169 | 1182 | | |
| |||
0 commit comments