Skip to content

Releases: neo4j-contrib/neo4j-streams

Neo4j-Streams Release 3.4.1 and Kafka Connect Plugin Release 1.0.0

23 Jan 13:02
@jexp jexp
3.4.1
0a565e4

Choose a tag to compare

View all tags
Neo4j-Streams Release 3.4.1 and Kafka Connect Plugin Release 1.0.0

We're excited about the new release. Big thanks to @conker84 from our partner Larus IT for all the hard work of building this integration.

Thanks to your feedback the Neo4j extension saw a number of fixed issues and more testing in the field, please continue to try it for different use-cases and let us know how well it works for you. Special thanks to @lju-lazarevic and @sarmbruster

Kafka Connect Plugin Release 1.0.0

Finally the Neo4j Kafka integration is available as Connect Plugin. We provide the sink functionality which will also be available on Confluent Hub.
We provide the ability to test the plugin locally with the docker compose setup we provided.

For more details see the docs

New Procedure

We added a new procedure to receive events from a topic and use them in your Cypher statement. That's useful both for testing and also for consuming events directly as part of another workflow.

We describe how to use it in the procedure documentation.

Batching

To allow better control of batching, we added a configuration parameter, batch.size that together with the Kafka setting max.poll.records allows to consume events in bulk(batch)

Bugfixes & Enhancements

Loading

First Release Neo4j Kafka Integration Plugin

27 Nov 13:22
@jexp jexp
v3.4.0
b3d4a11

Choose a tag to compare

View all tags
First Release Neo4j Kafka Integration Plugin

In the past year we got a lot of questions for an integration of Neo4j with Apache Kafka and other streaming data solutions. So a few weeks ago, with the help of our Italian partners LARUS (esp @conker84) and our colleague @sarmbruster, we started to work on a first integration.

Today we want to make this available in a first release under an Apache License for you to try out and test. It works with Neo4j from 3.4.x and Kafka from 0.10.x.

It offers three capabilities:

  1. a procedure to quickly send data to kafka
  2. a neo4j producer as a change data capture (CDC) source to transmit change events to downstream systems
  3. a neo4j consumer to turn Kafka messages into graph structures using templated Cypher statements

Just graph the attached JAR, drop it into your $NEO4J_HOME/plugins directory and add a config like:

kafka.zookeeper.connect=localhost:2181
kafka.bootstrap.servers=localhost:9092
# and
streams.procedures.enabled=true
# or
streams.source.enabled=true
streams.source.topic.nodes.<topic-name>=PATTERN
# or
streams.sink.enabled=true
streams.sink.topic.cypher.<topic-name>=CYPHER-QUERY

You can find the details in the documentation: https://neo4j-contrib.github.io/neo4j-streams

We also published a more detailed Blog post on Medium about it.

We would love you to test it out and give us feedback, either here as GitHub issues or by answering our short survey.

Loading