v2.0.1

Important notes

• Removed NiFi-Registry as it is now deprecated, as detailed here: https://lists.apache.org/thread/3gs4nl28yngsdmxd6xglzmbh5jqbscl3 , users are now instructed to backup their ETL workflows via Git/GitEA (available to deploy locally), they can manually back these up and/or use the GitRegistryFlow context service within NiFi to manage them.

• major script and processor cleanups for easier customization

• improvements to security scripts to deal with permissions post generation

• docker deployment cleanups and simplification

• added Helm chart for OpenSearch & OpenSearch dashboards along with configs

• improved documentation to cover recent changes, detailed processor outline, moved old workflows documentation to new legacy workflows section.

• updated demo workflows so that they are consistent with recent processor updates/changes

TO DO

• add new workflow screenshots
• Helmify core-stack
• finalise integration-testing for available workflows

What's Changed

• Cleanups by @vladd-bit in #55
• Nifi 2 8 0 by @vladd-bit in #60
• Bump nltk from 3.9.2 to 3.9.3 in /nifi in the pip group across 1 directory by @dependabot[bot] in #61

Full Changelog: v2.0.0...v2.0.1

v2.0.0

Main notes:

This is the first NiFi release that uses NiFi 2.x.
Breaking changes:

• repo structure
• security certificates settings
• env settings
• services

PLEASE BACK UP your repos before updating.

What's Changed

• Nifi 2.0 by @vladd-bit in #30
• Nifi 2.0 script & workflow updates by @vladd-bit in #31
• Bump github/codeql-action from 3 to 4 by @dependabot[bot] in #33
• Bump actions/checkout from 4 to 5 by @dependabot[bot] in #32
• Nifi 2.0 improvements by @vladd-bit in #34
• Nifi 2.0 improvements by @vladd-bit in #35
• Bump keras from 3.11.3 to 3.12.0 in /nifi in the pip group across 1 directory by @dependabot[bot] in #36
• Nifi 2.0 improvements by @vladd-bit in #37
• Nifi 2.0 improvements by @vladd-bit in #38
• Nifi 2.0 docs by @vladd-bit in #39
• Docs: security section re-structuring. by @vladd-bit in #40
• Nifi 2.0 docs by @vladd-bit in #41
• Docs: removed recurisve include. by @vladd-bit in #42
• Docs: updated main (prerequisities), deployment + troubleshooting sec… by @vladd-bit in #43
• Docs v2 by @vladd-bit in #44
• Workflow testing by @vladd-bit in #45
• Bump actions/checkout from 5 to 6 by @dependabot[bot] in #46
• Types by @vladd-bit in #48
• Updated Nifi+Nifi-registry to 2.7.0. by @vladd-bit in #49
• Bump actions/checkout from 4 to 6 by @dependabot[bot] in #52
• Bump actions/setup-python from 5 to 6 by @dependabot[bot] in #51
• Bump actions/cache from 4 to 5 by @dependabot[bot] in #50
• Bump bokeh from 3.8.0 to 3.8.2 in /nifi in the pip group across 1 directory by @dependabot[bot] in #53
• Bump wheel from 0.45.1 to 0.46.2 in /nifi in the pip group across 1 directory by @dependabot[bot] in #54
• ETL Tests by @vladd-bit in #47
• Bump actions/setup-java from 4 to 5 by @dependabot[bot] in #56
• Processors update by @vladd-bit in #57
• NiFi scripts: lazy cerner blob decompression possible fix. by @vladd-bit in #58
• GHA: release docker image tag fix. by @vladd-bit in #59

New Contributors

• @dependabot[bot] made their first contribution in #33

Full Changelog: v1.2.8...v2.0.0

TO DO:

• feature: base processor class and processor implementation(s)
• docs: update workflow documentation
• docs(optional): add migration guides
• feature(optional): make core services (NiFi/ES/Postgres) scalable

v1.2.8

What's Changed

• Apple silicon by @vladd-bit in #26
• changes made for sqllite annotation manager by @adam-sutton-1992 in #24
• Fix all broken links in readthedocs and fix all warnings by @alhendrickson in #27
• Fix MedCat Trainer using supervisord in version 2.22.0 by @alhendrickson in #28
• CU-8699g0f70 Rename master branch to main by @alhendrickson in #29

New Contributors

• @alhendrickson made their first contribution in #27

This is likely the last release of NiFi 1.x . The rest of them will bug fix/maintenance releases only.

Full Changelog: v1.2.7...v1.2.8

v1.2.7

Full Changelog: v1.2.6...v1.2.7

v1.2.6

What's Changed

• CU-33nkxtg add sample scripts with geolocation for ES demos by @adam-sutton-1992 in #25

New Contributors

• @adam-sutton-1992 made their first contribution in #25

Full Changelog: v1.2.5...v1.2.6

Notable changes (may break compatibility with older style delpoyments):
- removed all traces of groovy scripts.
- this may be the last release containing version 1.2.x of NiFi, future releases will move to version NiFi 2.x ( all python scripts and corresponding workflows will be updated)

v1.2.5

Changelog:

• NiFi updated to v1.25.0
• Some annotation manager script &db updates.
• JupyterHub now updated to support latest version of MedCAT

Full Changelog: v1.2.4...v1.2.5

v1.2.4

Changelog:

• NiFi updated to 1.24.0
• added doc de-id sample workflow
• changed NiFi to mount scripts/templates/schemas folder(s)
• added more util script(s) around json to -> flowfile attribute mapping

Full Changelog: v1.2.3...v1.2.4

v1.2.3

Full Changelog: v1.2.2...v1.2.3

v1.2.2

Changes:

• NiFi updated to 1.23.2
• NiFi script updates
• improved documentation
• Jupyter-Hub updated to v4

Full Changelog: v1.2.1...v1.2.2

v1.2.1

What's Changed

• NiFi updated to 1.22.0
• Added Elasticsearch Filebeat logging service
• BUG: errors when documents are too short or no annotations are returned. by @richardbeare in #21
• BUG: Some corner cases when no annotations are returned caused crashes. by @richardbeare in #22

New Contributors

• @richardbeare made their first contribution in #21

Full Changelog: v1.2.0...v1.2.1