Skip to content
This repository was archived by the owner on Oct 2, 2018. It is now read-only.

Distributed SensorHub

Jump to bottom
Sensia Software edited this page Sep 23, 2015 · 7 revisions

Thoughts on Distributed Implementation

Some ideas about what's needed to make SensorHub fully deployable accross multiple servers

  • Storage implementation(s) leveraging tech such as HDFS, Accumulo, etc.
  • Gateway to distributed event management (e.g. KAFKA)
  • Extended module functionality can be provided via a proxy module that mirrors a module located on a remote sensorhub instance

KAFKA

In order to support high performance computing on cloud infrastructure, we're planning to develop an implementation of IEventDispatcher that connects to a KAFKA cluster. This will be encapsulated in a SensorHub module that registers itself with the EventManager singleton.

This implementation will:

  • Be configurable in terms of what local events are forwarded to the KAFKA cluster (at the minimum by specifying a list of modules IDs)

  • Register with local event producers for which we wish to forward events

  • Discover all available topic on the KAFKA cluster and make these topic availables for subscription on the local SensorHub instance

  • Accept method calls to register local listeners (i.e. via registerListener(String topic, IEventListener listener)

Clone this wiki locally