Skip to content

Commit 0ab2bbe

Browse files
nikhil-ctdsnikhil-ctds
authored
Luna Streaming 3.1.4.6 (#159)
1 parent a6bf57b commit 0ab2bbe

File tree

1 file changed

+153
-0
lines changed

1 file changed

+153
-0
lines changed

‎Luna_Streaming_3.1_Release_Notes.md

Lines changed: 153 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,159 @@ both methods follow the same packaging patterns.
7575

7676
# Releases
7777

78+
## Luna Streaming Distribution 3.1 4.6
79+
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 12th September 2024 plus the changes specific to Luna Streaming & important security updates.
80+
81+
### Most notable commits
82+
83+
* [43249a0](https://github.com/datastax/pulsar/commit/43249a0) Add vi/vim to luna 31 images (#310)
84+
* [b0c3ffb](https://github.com/datastax/pulsar/commit/b0c3ffb) [improve][broker] Part 2 of PIP-370: add metrics "pulsar_replication_disconnected_count" (#23213)
85+
* [ada390b](https://github.com/datastax/pulsar/commit/ada390b) [improve][broker] Phase 1 of PIP-370 support disable create topics on remote cluster through replication (#23169)
86+
* [751aea3](https://github.com/datastax/pulsar/commit/751aea3) AS-4027: add string write function (#308)
87+
* [7b7d335](https://github.com/datastax/pulsar/commit/7b7d335) [fix][log] Do not print warn log when concurrently publishing and switching ledgers (#23209)
88+
* [8ad5249](https://github.com/datastax/pulsar/commit/8ad5249) [fix][client] the nullValue in msgMetadata should be true by default (#22372)
89+
* [959f80b](https://github.com/datastax/pulsar/commit/959f80b) [improve][client] Don't print info logs for each schema loaded by client (#23206)
90+
* [336d5d6](https://github.com/datastax/pulsar/commit/336d5d6) [improve][broker] Improve pulsar_topic_load_failed metric to record correct failed time (#23199)
91+
* [c29f36a](https://github.com/datastax/pulsar/commit/c29f36a) [improve][broker] Optimize high CPU usage when consuming from topics with ongoing txn (#23189)
92+
* [7047c2c](https://github.com/datastax/pulsar/commit/7047c2c) [fix] [broker] Topic can never be loaded up due to broker maintains a failed topic creation future (#23184)
93+
* [8d7f750](https://github.com/datastax/pulsar/commit/8d7f750) [fix][broker] Skip reading entries from closed cursor. (#22751)
94+
* [ae7a71c](https://github.com/datastax/pulsar/commit/ae7a71c) [improve] [broker] Optimize performance for checking max topics when the topic is a system topic (#23185)
95+
* [6c6f6bf](https://github.com/datastax/pulsar/commit/6c6f6bf) [improve][broker] Should notify bundle ownership listener onLoad event when ServiceUnitState start (ExtensibleLoadManagerImpl only)
96+
* [69064c3](https://github.com/datastax/pulsar/commit/69064c3) [improve][broker] Support customized shadow managed ledger implementation (#23179)
97+
* [b463ba4](https://github.com/datastax/pulsar/commit/b463ba4) [fix][test] Fix flaky SubscriptionSeekTest.testSeekIsByReceive (#23170)
98+
* [e3b9cdc](https://github.com/datastax/pulsar/commit/e3b9cdc) [feat] Add scripts for updating BK RocksDB ini files (#23178)
99+
* [42e9157](https://github.com/datastax/pulsar/commit/42e9157) [fix][client] Copy orderingKey to retry letter topic and DLQ messages and fix bug in copying (#23182)
100+
* [ef00bb2](https://github.com/datastax/pulsar/commit/ef00bb2) [fix] DLQ to handle bytes key properly (#23172)
101+
* [bb6c14f](https://github.com/datastax/pulsar/commit/bb6c14f) [fix][broker] Fix shadow topics cannot be consumed when the entry is not cached (#23147)
102+
* [c228b5d](https://github.com/datastax/pulsar/commit/c228b5d) [improve] [broker] Avoid subscription fenced error with consumer.seek whenever possible (#23163)
103+
* [b8aa905](https://github.com/datastax/pulsar/commit/b8aa905) [fix][client] Create the retry producer async (#23157)
104+
* [bdfc591](https://github.com/datastax/pulsar/commit/bdfc591) [fix][client] Fix for early hit `beforeConsume` for MultiTopicConsumer (#23141)
105+
* [b04b905](https://github.com/datastax/pulsar/commit/b04b905) [improve][proxy] Reuse authentication instance in pulsar-proxy (#23113)
106+
* [b46125e](https://github.com/datastax/pulsar/commit/b46125e) [improve] [client]Add new ServiceUrlProvider implementation: SameAuthParamsAutoClusterFailover (#23129)
107+
* [68db449](https://github.com/datastax/pulsar/commit/68db449) [fix] [broker] Let Pending ack handler can retry to init when encounters a metadata store error (#23153)
108+
* [b3d47d2](https://github.com/datastax/pulsar/commit/b3d47d2) [fix][broker] Fix 'Disabled replicated subscriptions controller' logic and logging (#23142)
109+
* [e16a0e2](https://github.com/datastax/pulsar/commit/e16a0e2) [improve][broker] Explicitly close LB internal topics when playing a follower (ExtensibleLoadManagerImpl only) (#23144)
110+
* [6cfacf2](https://github.com/datastax/pulsar/commit/6cfacf2) [fix] [broker] Fix compatibility issues for PIP-344 (#23136)
111+
* [62fbcc9](https://github.com/datastax/pulsar/commit/62fbcc9) [improve][client] Add maxConnectionsPerHost and connectionMaxIdleSeconds to PulsarAdminBuilder (#22541)
112+
* [5149aef](https://github.com/datastax/pulsar/commit/5149aef) [improve][misc] Upgrade jersey to 2.41 (#22290)
113+
* [2455b1e](https://github.com/datastax/pulsar/commit/2455b1e) [fix][broker] Fix the bug that elected leader thinks it's a follower (#23138)
114+
* [fcb4809](https://github.com/datastax/pulsar/commit/fcb4809) [improve][fn] Add support for overriding additionalJavaRuntimeArguments with PF_additionalJavaRuntimeArguments env (#23130)
115+
* [be739ab](https://github.com/datastax/pulsar/commit/be739ab) [fix][client] Fix timeout handling in Pulsar Admin client (#23128)
116+
* [9eca32d](https://github.com/datastax/pulsar/commit/9eca32d) [fix][fn] Make python install dependencies from requirements.txt (#20174)
117+
* [13b6669](https://github.com/datastax/pulsar/commit/13b6669) [improve][misc] Optimize TLS performance by omitting extra buffer copies (#23115)
118+
* [fcd02df](https://github.com/datastax/pulsar/commit/fcd02df) [improve][broker] Reduce the CPU pressure from the transaction buffer in rolling restarts (#23062)
119+
* [ef1eacc](https://github.com/datastax/pulsar/commit/ef1eacc) [improve][broker] Support to specify auth-plugin, auth-parameters and tls-enable arguments when init cluster metadata (#23087) (#23126)
120+
* [f598675](https://github.com/datastax/pulsar/commit/f598675) [improve][misc] Improve AES-GCM cipher performance (#23122)
121+
* [26e63e1](https://github.com/datastax/pulsar/commit/26e63e1) [fix][broker] Handle the case when `getOwnedServiceUnits` fails gracefully (#23119)
122+
* [156ce19](https://github.com/datastax/pulsar/commit/156ce19) [fix][broker]A failed consumer/producer future in ServerCnx can never be removed (#23123)
123+
* [d2a8e86](https://github.com/datastax/pulsar/commit/d2a8e86) [fix][broker] Fix authenticate order in AuthenticationProviderList (#23111)
124+
* [415f283](https://github.com/datastax/pulsar/commit/415f283) [fix][broker] type cast on exceptions in exceptionally can lead to lost calls (#23117)
125+
* [b0a40f4](https://github.com/datastax/pulsar/commit/b0a40f4) [fix][broker] fix exception may hidden and result in stuck when topic loading (#23102)
126+
* [85150dc](https://github.com/datastax/pulsar/commit/85150dc) [fix] [broker] fix replicated namespaces filter in filterAndUnloadMatchedNamespaceAsync (#23100)
127+
* [e322642](https://github.com/datastax/pulsar/commit/e322642) [improve][broker]Reuse method getAvailableBrokersAsync (#23099)
128+
* [5631b66](https://github.com/datastax/pulsar/commit/5631b66) [fix][client] TransactionCoordinatorClient support retry (#23081)
129+
130+
### `lunastreaming-all` distribution
131+
<details><summary>Sinks</summary>
132+
133+
| Name | Description | Version | File |
134+
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
135+
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.12 | cassandra-enhanced-pulsar-sink-1.6.12-nar.nar |
136+
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 3.2.0 | pulsar-io-cloud-storage-3.2.0.nar |
137+
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.6 | pulsar-io-data-generator-3.1.4.6.nar |
138+
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.4.6 | pulsar-io-elastic-search-3.1.4.6.nar |
139+
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.4.6 | pulsar-io-http-3.1.4.6.nar |
140+
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.4.6 | pulsar-io-jdbc-clickhouse-3.1.4.6.nar |
141+
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.4.6 | pulsar-io-jdbc-mariadb-3.1.4.6.nar |
142+
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.4.6 | pulsar-io-jdbc-openmldb-3.1.4.6.nar |
143+
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.4.6 | pulsar-io-jdbc-postgres-3.1.4.6.nar |
144+
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.4.6 | pulsar-io-jdbc-sqlite-3.1.4.6.nar |
145+
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.6 | pulsar-io-kafka-3.1.4.6.nar |
146+
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.6 | pulsar-io-kinesis-3.1.4.6.nar |
147+
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.1.14 | pulsar-snowflake-connector-0.1.14.nar |
148+
</details>
149+
<details><summary>Sources</summary>
150+
151+
| Name | Description | Version | File |
152+
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
153+
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.2.9 | pulsar-cassandra-source-2.2.9.nar |
154+
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.6 | pulsar-io-data-generator-3.1.4.6.nar |
155+
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.4.6 | pulsar-io-debezium-mongodb-3.1.4.6.nar |
156+
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.4.6 | pulsar-io-debezium-mssql-3.1.4.6.nar |
157+
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.4.6 | pulsar-io-debezium-mysql-3.1.4.6.nar |
158+
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.4.6 | pulsar-io-debezium-oracle-3.1.4.6.nar |
159+
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.4.6 | pulsar-io-debezium-postgres-3.1.4.6.nar |
160+
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.6 | pulsar-io-kafka-3.1.4.6.nar |
161+
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.6 | pulsar-io-kinesis-3.1.4.6.nar |
162+
</details>
163+
<details><summary>Proxy extensions</summary>
164+
165+
| Name | Description | Version | File |
166+
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
167+
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.0.1 | pulsar-kafka-proxy-3.1.0.1.nar |
168+
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
169+
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
170+
</details>
171+
<details><summary>Protocol handlers</summary>
172+
173+
| Name | Description | Version | File |
174+
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
175+
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
176+
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.0.1 | pulsar-protocol-handler-kafka-3.1.0.1.nar |
177+
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
178+
</details>
179+
<details><summary>CLI extensions</summary>
180+
181+
| Name | Description | Version | File |
182+
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
183+
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.2.5 | pulsar-cassandra-admin-2.2.5-nar.nar |
184+
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4 | pulsar-jms-admin-5.0.4-nar.nar |
185+
</details>
186+
<details><summary>Filters</summary>
187+
188+
| Name | Description | Version | File |
189+
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
190+
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4 | pulsar-jms-5.0.4-nar.nar |
191+
</details>
192+
<details><summary>Functions</summary>
193+
194+
| Name | Description | Version | File |
195+
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
196+
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.1.9 | pulsar-ai-tools-3.1.9.nar |
197+
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9 | pulsar-transformations-3.1.9.nar |
198+
</details>
199+
200+
201+
### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
202+
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.
203+
204+
205+
### Builtin connectors
206+
207+
- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
208+
- pulsar-cassandra-source-2.2.9.nar
209+
- pulsar-io-cloud-storage-2.10.0.nar
210+
- pulsar-io-debezium-mongodb-3.1.4.6.nar
211+
- pulsar-io-jdbc-sqlite-3.1.4.6.nar
212+
- pulsar-io-kinesis-3.1.4.6.nar
213+
- pulsar-io-data-generator-3.1.4.6.nar
214+
- pulsar-io-elastic-search-3.1.4.6.nar
215+
- pulsar-io-jdbc-clickhouse-3.1.4.6.nar
216+
- pulsar-io-debezium-oracle-3.1.4.6.nar
217+
- pulsar-io-jdbc-openmldb-3.1.4.6.nar
218+
- pulsar-io-jdbc-postgres-3.1.4.6.nar
219+
- pulsar-io-debezium-mssql-3.1.4.6.nar
220+
- pulsar-io-debezium-mysql-3.1.4.6.nar
221+
- pulsar-io-jdbc-mariadb-3.1.4.6.nar
222+
- pulsar-io-debezium-postgres-3.1.4.6.nar
223+
- pulsar-io-http-3.1.4.6.nar
224+
- pulsar-io-kafka-3.1.4.6.nar
225+
- pulsar-snowflake-connector-0.1.13.nar
226+
- pulsar-protocol-handler-kafka-3.1.0.1.nar
227+
- starlight-rabbitmq-2.10.1.0.nar
228+
- pulsar-kafka-proxy-3.1.0.1.nar
229+
- pulsar-jms-3.1.0-nar.nar
230+
78231
## Luna Streaming Distribution 3.1 4.5
79232
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 26th August 2024 plus the changes specific to Luna Streaming & important security updates.
80233

0 commit comments

Comments
 (0)