>>> ex = pa.Table.from_pydict({"A": ["A"], "B": ["B"], "C": ["C"]})
>>> csv = pa.dataset.CsvFileFormat(pa.csv.ParseOptions(delimiter=">"))
>>> pa.dataset.write_dataset(ex, path, format=csv, partitioning=pa.dataset.DirectoryPartitioning(pa.schema({"A": pa.string()})))
>>>
But I specified delimiter as ">", but csv file still written with "," delimiter.
Describe the bug, including details regarding any error messages, version, and platform.
Output dataset contains:
But I specified delimiter as ">", but csv file still written with "," delimiter.
Component(s)
C++, Python