Support for sep. metadata in csv files

[DestBro]

Right now when you try to parse this kind of csv it will throw exception.

[koperagen]

I'd recommend readCsv(..., skipLines = 1)
sep=; directive doesn't seem to be a standard CSV
https://superuser.com/questions/773644/what-is-the-sep-metadata-you-can-add-to-csvs
Wonder if we should support it. It it common in your experience?

[DestBro]

In my last two jobs that I had, we dealt with CSV files, exports, reports. Most of the time costumers complained when opening these CSV files in MC Excel that they are not formatted properly and produce wrong columns (It was a bit annoying, I'm not a Microsoft employee to deal with Excel issues), MC Excel understands sep=; and can open these CSV files.
Our CSV pipelines export files by default with the "sep" metadata, I don't know what I can say more

[DestBro]

I don't think it will impact any existing functionality, it should be backward compatible, and will make the tool more pragmatic

[koperagen]

Most of the time costumers complained when opening these CSV files in MC Excel that they are not formatted properly and produce wrong columns (It was a bit annoying, I'm not a Microsoft employee to deal with Excel issues), MC Excel understands sep=; and can open these CSV files.
Our CSV pipelines export files by default with the "sep" metadata

This is useful to know, thank you. Since it's a part of your pipeline and not occasional file found in the wild, i actually think this might be a good addition

[Jolanrensen]

Might also be a good idea to report this use case to Deephaven as that is the library we use to parse CSV under the hood :)