1.2.0

Changes (since 1.2.0)

• Add: KAFNUS_NGSI_GRAPHQL_OUTPUT_TOPIC_BY_SERVICE option (false by default) to compose topic for http sink connector (#180)
• Add: KAFNUS_NGSI_GRAPHQL_GRAFO_SUFFIX option (empty by default) to compose grafo for http sink connector
• Add: fiware-datamodel header propagation (#190)
• Add: staging flag to graphql mutations (#208)
• Fix: change from fixed mongo prefix to new custom SMT prefix: move MongoDB namespace prefix handling from Kafnus NGSI to Kafka Connect MongoNamespacePrefix SMT (#185)
• Fix: adapt producers and sinks for the new Header Router (send headers without building target_table) (#182)
• Fix: remove encoding of special characters and add env var KAFNUS_NGSI_MONGO_PREFIX as a configurable MongoDB prefix global parameter (#178)
• Fix: compose grafo with service: prefix + service + suffix without separators (could be included into prefix o suffix)
• Fix: shutdown procedure
• Fix: handle of QUEUE_FULL and pause queue when full (#199)
• Upgrade dep @confluentinc/kafka-javascript from 1.5.0 to 1.8.0
• Upgrade dep ajv from 1.17.1 to 1.18.0 due to CVE-2025-69873

1.1.0

Changes (since 1.0.0)

• Add: backpressure handling (#159)
• Add: single global producer (#159)
• Add: safe shutdown procedure (#159)
• Add health endpoint and documentation (#157)
• Add: use service as prefix for outputTopic sgtr_http (#163)
• Add: configuration for include service in grafo (graphql) (#163)
• Add: admin endpoint for logLevel and metrics (new env var KAFNUS_NGSI_ADMIN_PORT) (#147, #150)
• Add: configuration for grafo version (graphql)
• Fix: standardize topic output names with prefix and suffix (#164)
• Fix: upsert mode in mutable sink and add tests (#156)
• Fix: graphql: add config option graphql.slugUri (disabled by default) to ensure ids are sluged for use in URIs (#152)

1.0.0

Initial release, including:

• Feature: full NGSIv2 processing pipeline with Kafnus NGSI processor and Kafka Connect integration (#9, #29, #55, #104)
• Feature: dynamic topic routing based on fiware-service and servicePath (#9, #29, #55)
• Feature: multiple data flows supported: historic, lastdata, mutable, errors, mongo, http (#9, #43, #104)
• Feature: structured logging with levels FATAL, ERROR, WARN, INFO, DEBUG (#35)
• Feature: end-to-end automated tests with Pytest + Testcontainers (#9, #37, #43, #61)
• Feature: Prometheus metrics and Grafana dashboards for Kafka lag, connector status, and errors (#9, #55)
• Feature: Docker Compose deployment with modular images (#31, #36, #72, #80)
• Feature: CI/CD GitHub Actions for end-to-end test automation (#34, #39, #91)
• Feature: added error sink support for HTTP (#125) and Mongo (#130) flows
• Fix: package naming issues in Node.js connector (#44, #45)
• Fix: internal notification payloads (#51)
• Fix: end-to-end test issues including Kafka version and port handling (#76, #77, #91)
• Fix: error handling in HTTP flow (#100, #97)
• Fix: minor fixes in README, docs, scaling docs, Dockerfile, certificates (#1, #32, #60, #70, #75, #80, #81)
• Fix: handling of native JSON and NGSI types (#37, #43, #42, #96)
• Fix: race condition in tests and ensure system readiness on startup (#120, #124)
• Hardening: removed Mosquitto references and reduced envelope messages (#69, #75)
• Fix: resolved multiple test issues including schema cleanup at startup, DLQ partition handling, and improved connector checks before test execution (#135)
• Hardening: improved documentation for scaling, architecture, and test scenarios (#52, #70, #101)
• Hardening: added metadata handling and validation for Mongo and HTTP flows (#98, #99, #104)
• Hardening: improved GitHub Actions logs and workflows (#39, #41)
• Upgrade kafka-javascript dep from 1.4.0 to 1.5.0 (#106)
• Upgrade Orion Docker image and Kafka version in docker-compose workflows (#127, #128)
• Change: updated output topics for HTTP flow and Mongo flow (#110, #111)