Skip to content

Latest commit

 

History

History
26 lines (21 loc) · 809 Bytes

File metadata and controls

26 lines (21 loc) · 809 Bytes

Release: Initial Demo

Distributed Log Aggregation System - Initial demo release Date: 2025-11-16

Highlights

  • Functional demo of ingestion → Kafka → consumer → PostgreSQL → search
  • Batched ingestion, Kafka durability, prepared DB statements, trigram index for fast search
  • Docker Compose setup for local development
  • run.sh for quick local demo

Quickstart

  1. docker compose up -d
  2. Initialize DB schema (see README)
  3. chmod +x run.sh && ./run.sh

Known limitations

  • No TLS/auth for Kafka/Postgres (dev-only)
  • Simple caching in search service
  • Single-node Kafka (bitnami) for convenience

Roadmap

  • Add Kubernetes manifest + Helm chart
  • Replace Postgres search with Elasticsearch for scale
  • Add metrics + Grafana dashboard
  • Add CI tests & GitHub Actions