Skip to content

[Python] pyarrow.fs.HadoopFileSystem.from_uri - retrieve options from core-site.xml or hdfs-site.xml if available (variation of #25324) #47560

@dsevilla

Description

@dsevilla

Describe the bug, including details regarding any error messages, version, and platform.

In #25324, the options from core-site or hdfs-site.xml are retreived only if used from HadoopFileSystem explicitly, but it fails both with:

FileSystem.form_uri('hdfs://default:0/xxx')

and even with

HadoopFileSystem.from_uri('hdfs://default:0/xxx')

I offered a pull request that initially I stated it fixed #25324, but I will add that it fixes this issue also.

Component(s)

Python

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions