Commit 7129321
### Rationale for this change
In #25324 a fix is introduced for the python HadoopFileSystem, but it does not work if you use `from_uri()`, as it is passed to the underlying C++ implementation of the options parsing. The "default" case is not handled as in the python case, as the whole "hdfs://default" is passed to the underlying hdfs library, that expect "default" to search in `$HADOOP_CONF_DIR/core-site.xml`.
### What changes are included in this PR?
Handle the `HadoopFileSystem.from_uri()` (or `FileSystem.from_uri()` when using `hdfs://default:xxx`) special HDFS URIs.
### Are these changes tested?
There are no specific tests for this feature, but existing HDFS CI jobs pass.
### Are there any user-facing changes?
Not exactly, but the documentation is honored for the `from_uri()` case.
* GitHub Issue: #47560
Lead-authored-by: Diego Sevilla Ruiz <[email protected]>
Co-authored-by: Antoine Pitrou <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
1 parent 37c87db commit 7129321
1 file changed
+7
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
363 | 363 | | |
364 | 364 | | |
365 | 365 | | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
366 | 369 | | |
367 | | - | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
368 | 374 | | |
369 | 375 | | |
370 | 376 | | |
| |||
0 commit comments