Skip to content

Commit 631cb1d

Browse files
committed
[DOP-11905] Prepare for release
1 parent 4796345 commit 631cb1d

File tree

6 files changed

+29
-22
lines changed

6 files changed

+29
-22
lines changed

docs/changelog/0.10.1.rst

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
0.10.1 (2024-02-05)
2+
===================
3+
4+
Features
5+
--------
6+
7+
- Add support of ``Incremental Strategies`` for ``Kafka`` connection:
8+
9+
.. code-block:: python
10+
11+
reader = DBReader(
12+
connection=Kafka(...),
13+
source="topic_name",
14+
hwm=AutoDetectHWM(name="some_hwm_name", expression="offset"),
15+
)
16+
17+
with IncrementalStrategy():
18+
df = reader.run()
19+
20+
This lets you resume reading data from a Kafka topic starting at the last committed offset from your previous run. (:github:pull:`202`)
21+
- Add ``has_data``, ``raise_if_no_data`` methods to ``DBReader`` class. (:github:pull:`203`)
22+
- Updare VMware Greenplum connector from ``2.1.4`` to ``2.3.0``. This implies:
23+
* Greenplum 7.x support
24+
* `Kubernetes support <https://docs.vmware.com/en/VMware-Greenplum-Connector-for-Apache-Spark/2.3/greenplum-connector-spark/configure.html#k8scfg>`_
25+
* New read option `gpdb.matchDistributionPolicy <https://docs.vmware.com/en/VMware-Greenplum-Connector-for-Apache-Spark/2.3/greenplum-connector-spark/options.html#distpolmotion>`_
26+
which allows to match each Spark executor with specific Greenplum segment, avoiding redundant data transfer between Greenplum segments
27+
* Allows overriding `Greenplum optimizer parameters <https://docs.vmware.com/en/VMware-Greenplum-Connector-for-Apache-Spark/2.3/greenplum-connector-spark/options.html#greenplum-gucs>`_ in read/write operations (:github:pull:`208`)
28+
- ``Greenplum.get_packages()`` method now accepts optional arg ``package_version`` which allows to override version of Greenplum connector package. (:github:pull:`208`)

docs/changelog/index.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,7 @@
44

55
DRAFT
66
NEXT_RELEASE
7+
0.10.1
78
0.10.0
89
0.9.5
910
0.9.4

docs/changelog/next_release/202.feature.rst

Lines changed: 0 additions & 14 deletions
This file was deleted.

docs/changelog/next_release/203.feature.rst

Lines changed: 0 additions & 1 deletion
This file was deleted.

docs/changelog/next_release/208.feature.1.rst

Lines changed: 0 additions & 6 deletions
This file was deleted.

docs/changelog/next_release/208.feature.2.rst

Lines changed: 0 additions & 1 deletion
This file was deleted.

0 commit comments

Comments
 (0)