radar-output 2.3.1

Changes since version 2.3.0:

• Use more memory-efficient deduplication, using MD5 hashes instead of full line contents
• Simplify some Kotlin code
• If a FileNotFoundException is thrown (usually because of file corruption), open a new output file instead.

radar-output 2.3.0

Changes since version 2.2.1:

• Improved output path formatting with a full formatting engine #528. This adds formatting variables ${time:TIME-FORMAT}, ${key:myField.mySubfield} and ${value:myField.mySubfield}. More formatter plugins can be added to the classpath and added to configuration paths.factory.properties.plugins in addition to the plugins fixed time key value.
• Output paths may be formatted individually per topic, via configuration topics.myTopicName.pathProperties.format.
• Bumped dependencies

Full Changelog: v2.2.1...v2.3.0

radar-output 2.2.1

Changes since version 2.2.0:

• Updated dependencies

radar-output 2.2.0

Changes since version 2.1.0.1:

• Use Kotlin coroutines for parallelism instead of Java streams (#524). This may decrease processing time by 30%.
• Made tree listings more efficient for large datasets. This may decrease listing time from a few minutes to a few seconds.
• Bumped dependencies
• Fixed ARM64 docker image
• Ensure all resources are closed.
• Ensure all OkHttp connection errors and leaks are logged.
• Introduced KtLint for style checking
• Made HTTP timeouts configurable with s3.(connect|write|read)Timeout and azure.(connect|response|write|read)Timeout

radar-output-restructure 2.1.0.1

Changes since version 2.1.0:

• Fixes Jackson DoS CVE #520

radar-output-restructure 2.1.0

Changes since version 2.0.2:

• Added support for Avro key to be user ID string and or a subset of observation key.
• Make field parsing case-insensitive
• Make field parsing resolve optional types
• Bumped dependencies

radar-output-restructure 2.0.2

Changes since 2.0.1:

• Bumped dependencies (fixes vulnerabilities #517 #516 #515 #514 #512 and silences #513).

radar-output-restructure 2.0.1

Changes since version 2.0.0:

• Critical: Updated Log4J to fix CVE-2021-44228.
• Updated dependencies and gradle, including Java 17 and Kotlin 1.6.

radar-output-restructure 2.0.0

Changes since version 1.2.1:

• Remove HDFS code and dependencies: #213
• Add retry functionality for S3: #212.

radar-output-restructure 1.2.1

Changes since version 1.2.0:

• Fixed release workflow
• Fixed initialisation lateinit exception on ResourceConfig.sourceType