Commit 3aa0ab7
Fix: SparkAscii nullability to depend on input nullability (#19531)
Closes #19169
## Rationale for this change:
The current implementation of `SparkAscii` UDF uses the default
`is_nullable` which always returns true. This is incorrect because the
output should only be nullable if the input argument is nullable. This
change implements proper null propagation behavior by using
`return_field_from_args` .
## Changes in PR:
- Implemented return_field_from_args for SparkAscii to properly compute
output nullability based on input argument nullability
- Changed `return_type` to `return internal_err!` since
`return_field_from_args` is now used (following the pattern used by
other Spark functions like ilike, concat, elt)
- Added unit tests verifying the nullability behavior:
- Output is nullable when input is nullable
- Output is non-nullable when input is non-nullable
## Test Coverage:
Yes, tests are included to verify the change.
## User-facing Changes:
No user-facing changes.
Co-authored-by: Jefffrey <[email protected]>1 parent 36df145 commit 3aa0ab7
1 file changed
+58
-6
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
19 | | - | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
20 | 21 | | |
21 | | - | |
| 22 | + | |
22 | 23 | | |
23 | | - | |
24 | | - | |
| 24 | + | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
75 | 76 | | |
76 | 77 | | |
77 | 78 | | |
78 | | - | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
79 | 87 | | |
80 | 88 | | |
81 | 89 | | |
82 | 90 | | |
83 | 91 | | |
84 | 92 | | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
0 commit comments