You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/changelog/0.3.0.rst
+44-42Lines changed: 44 additions & 42 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,55 +1,52 @@
1
1
0.3.0 (2025-12-15)
2
2
==================
3
3
4
-
Release of Data.SyncMaster 0.3.0 brings up Iceberg support and Spark-on-K8s support,
5
-
as well as some UX improvements.
4
+
Release of Data.SyncMaster 0.3.0 brings up support for Iceberg and Spark-on-K8s.
6
5
7
6
Breaking Changes
8
7
----------------
9
8
10
-
- Allow using SyncMaster worker image as ``spark.kubernetes.container.image``. (:issue:`295`)
11
-
12
-
Worker container command should be changed from ``--queues 123-myqueue`` to ``worker --queues 123-myqueue``.
9
+
- Worker container command should be changed from ``--queues 123-myqueue`` to ``worker --queues 123-myqueue`` (:issue:`295`).
13
10
14
-
- Introduce ``config.yml`` file which is used to store settings of all components - server, scheduler, worker, frontend (:issue:`289`).
11
+
- Application should be configured via ``config.yml`` file (:issue:`289`).
15
12
16
-
This is the main way to configure application now. It's still possible to use environment variables, but it is not recommended for security reasons.
13
+
It's still possible to use environment variables instead. But it is not recommended for security reasons, as docker/k8s envs can be read by other users.
17
14
18
-
This also implies:
15
+
Other notable changes:
19
16
* Environment variable ``SYNCMASTER__ENTRYPOINT__SUPERUSERS`` is renamed to ``SYNCMASTER__SUPERUSERS``.
20
-
* Logging format is configured explicitly via ``config.yml`` instead of having a set of preset configuration files.
17
+
* Logging format is configured explicitly via ``config.yml`` instead of having few predefined configuration files.
21
18
22
-
- Move ``server.session`` middleware settings to ``auth`` block.
19
+
- Moved ``server.session`` middleware settings to ``auth`` block (:issue:`304`).
23
20
Also rename some fields in ``auth.keycloak`` settings block.
24
21
25
-
Before:
22
+
.. dropdown:: Before vs after
26
23
27
-
.. code:: yaml
24
+
Before:
28
25
29
-
auth:
30
-
provider: ...
31
-
keycloak:
32
-
server_url: ...
33
-
redirect_url: ...
26
+
.. code:: yaml
34
27
35
-
server:
36
-
session:
37
-
enabled: true
38
-
secret_key: ...
28
+
auth:
29
+
provider: ...
30
+
keycloak:
31
+
server_url: ...
32
+
redirect_url: ...
39
33
40
-
Now:
34
+
server:
35
+
session:
36
+
enabled: true
37
+
secret_key: ...
41
38
42
-
.. code:: yaml
39
+
Now:
43
40
44
-
auth:
45
-
provider:
46
-
keycloak:
47
-
api_url: ...
48
-
ui_callback_url: ...
49
-
cookie:
50
-
secret_key: (:issue:`304`)
41
+
.. code:: yaml
51
42
52
-
- Make S3 connection ``region`` a mandatory option.
43
+
auth:
44
+
provider:
45
+
keycloak:
46
+
api_url: ...
47
+
ui_callback_url: ...
48
+
cookie:
49
+
secret_key: ...
53
50
54
51
55
52
Features
@@ -59,18 +56,22 @@ Features
59
56
60
57
Iceberg connection currently supports only Iceberg REST Catalog with S3 warehouse.
61
58
62
-
- Allow passing default Spark session config via worker settings:
59
+
- Allow using SyncMaster worker image as ``spark.kubernetes.container.image``. (:issue:`295`)
0 commit comments