Skip to content

Releases: PastorGL/datacooker-etl

Release 5.5.0

22 Oct 11:53

Choose a tag to compare

Partition functions:

  • In-language per-partition cursors/generators/reducers
  • A slew of new Java classpath-provided functions to manipulate with Records Objects

Full Changelog: release-5.0.0...release-5.5.0

Release 5.0.0

29 Apr 13:18

Choose a tag to compare

Major language overhaul:

  • Generalized input and output scopes for all operators where it makes sense (previously JOIN and UNION scopes were allowed only in SELECT)
  • Multiple input-output scope pairs are now supported in same operators; wildcard semantics is now extended
  • ALTER operator completely overhauled to support fine-grained DS modifications (each sub-clause made usable on its own)

Code base of datacooker-dist merged into main tree:

  • JDBC and S3 storage adapters
  • Support chain of transforms in-between

Other notable changes:

  • API and SQL engine separated from commons into their own modules
  • Input and output scopes have explicit API declarations matching with Pluggables' metadata
  • All kinds of Java Pluggables now use this unified API and have same lifecycle
  • Rewritten TDL documentation
  • Updated documentation generator to expose all metadata about Pluggables, along with REPL

Release 4.4.0: PARTITION, CREATE FUNCTION and Co.

05 Feb 12:17

Choose a tag to compare

  • Support PARTITION specifier for DS in all SELECT-like contexts.
  • Enhanced ANALYZE with partition stats.
  • Added language-level Functions.
  • Optimized language grammar and parsing.

Release 4.3.0

10 Jan 13:49

Choose a tag to compare

release-4.3.0

OBJ_HASHCODE

Release 4.2.0

22 Aug 12:10
1cd28df

Choose a tag to compare

TDL Procedures (and Procedure libraries).

Release 4.1.0

19 Aug 04:14
821d6b3

Choose a tag to compare

Updated to Java 17 / Spark 3.5 / EMR 7.2

Last version for Java 11

13 Aug 14:51

Choose a tag to compare

release-4.0.0

fix seriesMath NORMALIZE and get rid of (unneeded now) percentileFilter

Release 3.9.0

27 Oct 17:19

Choose a tag to compare

Data Set Lineage feature addition

Release 3.8.5

16 Oct 09:20

Choose a tag to compare

Rework of logging and execution modes refinement

Release 3.8.0

11 Aug 15:41

Choose a tag to compare

Remote REPL and QOL enhancements