ABRiS 5.0.0

The main improvements in this version are

• Improved compatibility with Spark 3.0 and 3.1
• Compatibility with Spark-Avro 2.4 and newer
• When converting to Avro, Abris uses spark-avro methods when possible

The changes are mostly internal, and the user interface of the library was not changed from version 4. There might be some changes in the behavior since conversion to Avro is now handled by spark-avro methods directly. But this is desired since we don't want to differ from the spark-avro library in this - Abris aims to just add an additional layer of support for confluent schema format and schema registry support.

Tickets

• making FromAvroConfig and ToAvroConfig classes serializable by @yokhan-dukhin in #229
• Abris #230 improve exception message and comments by @cerveada in #231
• Abris #237 add Spark 3.1 profile and automatic test config by @cerveada in #238
• Abris #242 remove dependency on confluent naming strategy code by @cerveada in #243
• Abris #240 use spark avro encoder writer by @cerveada in #241
• Abris #246 support for multiple spark avro by @cerveada in #247
• Abris #159 add developer api annotations by @cerveada in #251

New Contributors

• @yokhan-dukhin made their first contribution in #229

Full Changelog: v4.2.0...v5.0.0