BSON integration

[CLOVIS-AI]

Hey!

I'm working a JsonPath implementation for BSON (MongoDB's wire format).

The implementation is centered around the method:

inline fun <reified T : Any?> Bson.select(path: BsonPath): Sequence<T>

The implementation is mainly targeting users who have large BSON payloads but are only interested in a few fields (a typical example is a the output of a query plan). Since my BSON implementation is lazily-parsed, JsonPath offers significant performance benefits in this situation as opposed to parsing the entire payload.

Still, in a more general case, I think there is value in integrating this system with Arrow Optics and this library. Potentially, this would allow JsonPath expressions from this library to also work on BSON data, and the other way around.

However, I am not very familiar with Optics so I'm not sure what the best way forward would be. What do you think?

[nomisRev]

Hey @CLOVIS-AI,

Thank you for creating the issue! Awesome you're creating a similar DSL for BSON with Optics.

I think it's certainly possible to design such a common API/DSL, but it would come with some sacrifices such as not exposing the intermediate underlying types in paths. I've considered doing this for different JSON libraries in this project since the paths are agnostic of the serialiser/deserialiser used if people prefer i.e. Jackson or Moshi.