forked from apache/wayang
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathRELEASE_NOTES
More file actions
104 lines (83 loc) · 3.23 KB
/
RELEASE_NOTES
File metadata and controls
104 lines (83 loc) · 3.23 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
==============================================================
Apache Wayang (incubating) 1.1.0
==============================================================
This is a minor release of Apache Wayang (incubating).
Based on this release the project aims to move out of incubation.
This release supports the following new features:
general:
- migration to Java 17
- migration to junit5 for tests
- better explain & json utils
api-sql:
- sort operator
- cross joins
- joins with multiple equals conditions
- search arguments in filter WHERE clauses
- '+/-' algebra in filter statements
- calcite rules for more optimized SQL trees
- better support for sql-types for java udfs
- better serializability for java-based platforms
wayang-basic:
- Parquet source operator
- LinearSVC operator
- LogisticRegression operator
- DecisionTreeRegression operator with time series
- GoogleCloudStorageSource operator
- NN Batch normalisation
- NN Convolutions
- NN MSE loss
api-python:
- Parquet source operator
wayang-api-scala-java:
- api for deep learning
==============================================================
Apache Wayang (incubating) 1.0.0
==============================================================
This is a major release of Apache Wayang (incubating).
Based on this release the projects wants to continue the path towards becoming an
Apache TLP.
This release supports the following new features:
- Support for Tensorflow Java as a platform (Note: this platform is compatible with Apple's Silicon's chip only with the right arm-based java version)
- Support for Kafka source/sink
- Python API
- MultiContext for federated data processing
- Explain utility for displaying execution plans
- Abstracted cost model to be pluggable
- Retired Java 8/Scala 2.11
- Added Join operator for JDBC and Postgres platforms
- Support for any JDBC-supported database
- Added ML4all abstraction
Several bug fixes are also included:
- Aligned Flink versions
- Fixed CardinalityRepository to sample measured cardinalities
- Copied cost models for different configurations
==============================================================
Apache Wayang (incubating) 0.7.1
==============================================================
This is a patch/bugfix release of Apache Wayang (incubating).
This release supports the following frameworks:
- This patch version fixes a problem in the artifact gpg encrypting key.
Previous updates that are included in this release:
- Apache Flink v1.7.1
- Apache Giraph v1.2.0-hadoop2
- GraphChi v0.2.2 (only available with scala 11.x)
- Java Streams (version depends on the java version)
- JDBC-Template
- Postgres v9.4.1208 (Implementation JDBC-Template)
- Apache Spark v3.1.2 (scala 2.12) and v2.4.8 (scala 2.11)
- SQLite3 v3.8.11.2 (implementation JDBC-Template)
NOTE: depending on the scala version the list of the supported platforms available
could be different.
New Features
------------
[WAYANG-34] Terasort
[WAYANG-IDE] Recognition of Scala code in IDE
[WAYANG-8] Inclusion of Python as platform of processing
[WAYANG-211] JVM-platform inside of Python-API
Grep Benchmark
Test classes and operators for Flink
Support for S3 files locations
Initial version of the SQL API and suppport for joins
Basic SQL support
Incompatible changes
--------------------