Commit 6e6e425
[SPARK-51468][SQL] Revert "From json/xml should not change collations in the given schema"
### What changes were proposed in this pull request?
After removing session-level collation (#49772) we can also revert the PR that changed the behavior of `from_json` and `from_xml` expressions to use json and not sql type representation under the hood (#48750).
### Why are the changes needed?
Now that we don't have correctness problems with session level collation, using `sql` instead of `json` will lead to smaller and more efficient type representation.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing unit tests.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #50234 from stefankandic/revertFromJsonChange.
Authored-by: Stefan Kandic <stefan.kandic@databricks.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
(cherry picked from commit 0094f44)
Signed-off-by: Max Gekk <max.gekk@gmail.com>1 parent d5bcdd4 commit 6e6e425
File tree
5 files changed
+4
-4
lines changed- sql
- api/src/main/scala/org/apache/spark/sql
- connect/common/src/test/resources/query-tests/queries
5 files changed
+4
-4
lines changedLines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6901 | 6901 | | |
6902 | 6902 | | |
6903 | 6903 | | |
6904 | | - | |
| 6904 | + | |
6905 | 6905 | | |
6906 | 6906 | | |
6907 | 6907 | | |
| |||
7773 | 7773 | | |
7774 | 7774 | | |
7775 | 7775 | | |
7776 | | - | |
| 7776 | + | |
7777 | 7777 | | |
7778 | 7778 | | |
7779 | 7779 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | | - | |
| 40 | + | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
| |||
Binary file not shown.
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | | - | |
| 40 | + | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
| |||
Binary file not shown.
0 commit comments