Skip to content

Releases: kaufland-ecommerce/esque

Version 1.0.0a2

11 Mar 11:14
d17e0bc

Choose a tag to compare

Version 1.0.0a2 Pre-release
Pre-release

Release Notes

What's New

  • Proto ans Struct Message Support: Added deserialization support for keys and values of proto messages in a Kafka topic.
  • Python Version Update: Minimum supported Python version is now 3.9, extending support up to version 3.12.
  • Pre-commit Hook Update: Configuration for pre-commit hooks has been updated.
  • Docker Enhancements: Updated Docker and Docker Compose files.
  • Dependency Updates: Refreshed dependency packages in pyproject.toml.
  • Tox Testing Update: Tox configuration now tests across Python versions 3.9, 3.10, 3.11, and 3.12.
  • Output Standardization: The stdout parameter has been removed; output defaults to stdout.
  • Documentation Refresh: Updated README documentation to reflect recent changes.
  • JSON Deserialization: Added support for JSON deserialization of Decimal data types.
  • Pyproject version dependency: Removing pyproject.toml dependency for version

Breaking Changes

  • Esque consume Command Update: The consume command has been updated. Users must now specify the data type of topic messages using the -s flag. Supported types include: "s" (str), "b" (binary), "a" (avro), "p" (proto), "struct".

Version 0.6.0

23 Aug 11:54
18449ec

Choose a tag to compare

What's Changed

Full Changelog: v0.5.2...v0.6.0

Version 0.5.2

02 Mar 12:24
9598db7

Choose a tag to compare

  • Update the README with installation instructions for apple silicon devices
  • Update python dependency constraints for poetry

Version 0.5.1

08 Aug 08:19
22c0236

Choose a tag to compare

Simple bug fix in stdout, where from_context was used instead of to_context

Version 0.5.0

05 Aug 08:58
1b7f036

Choose a tag to compare

Dependency upgrades:

  • attrs 1.4.0 -> 1.4.1
  • avro-python3 1.10.0 -> 1.10.2
  • bandit 1.7.0 -> 1.7.4
  • Black 19.3b0 -> 22.6.0 (update needed to be compatible with click >=8.0.0)
  • certifi 2021.5.30 -> 2022.6.15
  • charset-normalizer 2.0.4 -> 2.1.0
  • click 7.1.2 -> 8.1.3 (autocompletion parameter changed to shell_complete)
  • colorama 0.4.4 -> 0.4.5
  • confluent-kafka 1.7.0 -> 1.9.0
  • decopath 1.4.8 -> 1.4.10
  • fastavro 1.4.4 -> 1.5.4
  • gitdb 4.0.7 -> 4.0.9
  • gitpython 3.1.20 -> 3.1.27
  • idea 3.2 -> 3.3
  • makefun 1.11.3 -> 1.14.0
  • more-itertools 8.10.0 -> 8.13.0
  • packaging 21.0 -> 21.3
  • pbr 5.6.0 -> 5.9.0
  • py 1.10.0 -> 1.11.0
  • pyparsing 2.4.7 -> 3.0.9
  • pytest-cases 3.6.4 -> 3.6.13
  • requests 2.26.0 -> 2.28.1
  • smmap 4.0.0 -> 5.0.0
  • stevedore 3.3.0 -> 4.0.0
  • typing-extensions 3.10.0.0 -> 4.3.0
  • urllib3 1.26.6 -> 1.26.11

Version 0.4.1

25 Nov 10:17
073a43c

Choose a tag to compare

  • Extended the timeout when fetching cluster metadata to 20 seconds
  • Extended the timeout when creating the python-kafka client to 30 seconds

Version 0.4.0

18 Oct 10:10
0b779fc

Choose a tag to compare

  • Introduced new io module to replace old consumer logic
  • Restructured the cli.commands module into sub packages/modules for better overview
  • Removed old client/consumer logic
  • Lazily instantiate admin clients to improve responsiveness of some commands
  • Reintroduced the esque transfer command to transfer data from one topic to another
  • Added the esque io command for more advanced use cases that are not covered by the options provided with the
    esque consume, esque produce and esque transfer commands.
  • Added more information to esque create topic to show you what will be created before you approve it.
  • Added more information to esque ping to also show timings from client to server and from server to client.

Breaking changes

esque consume --avro --stdout now json serializes the avro data into the message key and value objects which in turn
are always strings. Therefore, attributes of key or value objects will not be directly accessible on the root structure.
However, as a workaround, you could for example pipe the data through jq '.key | fromjson' to decode the json objects
again.

esque ping now does not create a new topic all the time but uses a topic called esque-ping with random message
key to distinguish ping messages from different users.

The files and file structure in the directories that were created by esque consume and required by esque produce
has changed. Directories that were previously created with esque consume won't work with esque produce anymore.

Version 0.3.1

28 May 15:07
12a65ee

Choose a tag to compare

  • Added the delete topics command that enables deleting more than one topic
  • Modified the existing delete topic command to accept only a single topic entry
  • Refactored the topic deletion logic to improve performance

Version 0.3.0

30 Mar 14:31
ab10987

Choose a tag to compare

  • Remove pykafka dependency
  • Include a partial fix for #32 (topics are now displayed, output is still not optimal)
  • Minor performance improvements

Version 0.2.9

14 Jan 15:27
a04ccf4

Choose a tag to compare

Added --binary flag to produce and consume