Releases: kaufland-ecommerce/esque
Version 1.0.0a2
Release Notes
What's New
- Proto ans Struct Message Support: Added deserialization support for keys and values of proto messages in a Kafka topic.
- Python Version Update: Minimum supported Python version is now 3.9, extending support up to version 3.12.
- Pre-commit Hook Update: Configuration for pre-commit hooks has been updated.
- Docker Enhancements: Updated Docker and Docker Compose files.
- Dependency Updates: Refreshed dependency packages in
pyproject.toml. - Tox Testing Update: Tox configuration now tests across Python versions 3.9, 3.10, 3.11, and 3.12.
- Output Standardization: The
stdoutparameter has been removed; output defaults to stdout. - Documentation Refresh: Updated README documentation to reflect recent changes.
- JSON Deserialization: Added support for JSON deserialization of
Decimaldata types. - Pyproject version dependency: Removing pyproject.toml dependency for version
Breaking Changes
- Esque
consumeCommand Update: Theconsumecommand has been updated. Users must now specify the data type of topic messages using the-sflag. Supported types include:"s" (str), "b" (binary), "a" (avro), "p" (proto), "struct".
Version 0.6.0
Version 0.5.2
- Update the README with installation instructions for apple silicon devices
- Update python dependency constraints for poetry
Version 0.5.1
Simple bug fix in stdout, where from_context was used instead of to_context
Version 0.5.0
Dependency upgrades:
- attrs 1.4.0 -> 1.4.1
- avro-python3 1.10.0 -> 1.10.2
- bandit 1.7.0 -> 1.7.4
- Black 19.3b0 -> 22.6.0 (update needed to be compatible with click >=8.0.0)
- certifi 2021.5.30 -> 2022.6.15
- charset-normalizer 2.0.4 -> 2.1.0
- click 7.1.2 -> 8.1.3 (autocompletion parameter changed to shell_complete)
- colorama 0.4.4 -> 0.4.5
- confluent-kafka 1.7.0 -> 1.9.0
- decopath 1.4.8 -> 1.4.10
- fastavro 1.4.4 -> 1.5.4
- gitdb 4.0.7 -> 4.0.9
- gitpython 3.1.20 -> 3.1.27
- idea 3.2 -> 3.3
- makefun 1.11.3 -> 1.14.0
- more-itertools 8.10.0 -> 8.13.0
- packaging 21.0 -> 21.3
- pbr 5.6.0 -> 5.9.0
- py 1.10.0 -> 1.11.0
- pyparsing 2.4.7 -> 3.0.9
- pytest-cases 3.6.4 -> 3.6.13
- requests 2.26.0 -> 2.28.1
- smmap 4.0.0 -> 5.0.0
- stevedore 3.3.0 -> 4.0.0
- typing-extensions 3.10.0.0 -> 4.3.0
- urllib3 1.26.6 -> 1.26.11
Version 0.4.1
- Extended the timeout when fetching cluster metadata to 20 seconds
- Extended the timeout when creating the python-kafka client to 30 seconds
Version 0.4.0
- Introduced new
iomodule to replace old consumer logic - Restructured the
cli.commandsmodule into sub packages/modules for better overview - Removed old client/consumer logic
- Lazily instantiate admin clients to improve responsiveness of some commands
- Reintroduced the
esque transfercommand to transfer data from one topic to another - Added the
esque iocommand for more advanced use cases that are not covered by the options provided with the
esque consume,esque produceandesque transfercommands. - Added more information to
esque create topicto show you what will be created before you approve it. - Added more information to
esque pingto also show timings from client to server and from server to client.
Breaking changes
esque consume --avro --stdout now json serializes the avro data into the message key and value objects which in turn
are always strings. Therefore, attributes of key or value objects will not be directly accessible on the root structure.
However, as a workaround, you could for example pipe the data through jq '.key | fromjson' to decode the json objects
again.
esque ping now does not create a new topic all the time but uses a topic called esque-ping with random message
key to distinguish ping messages from different users.
The files and file structure in the directories that were created by esque consume and required by esque produce
has changed. Directories that were previously created with esque consume won't work with esque produce anymore.
Version 0.3.1
- Added the
delete topicscommand that enables deleting more than one topic - Modified the existing
delete topiccommand to accept only a single topic entry - Refactored the topic deletion logic to improve performance
Version 0.3.0
- Remove pykafka dependency
- Include a partial fix for #32 (topics are now displayed, output is still not optimal)
- Minor performance improvements
Version 0.2.9
Added --binary flag to produce and consume