Skip to content

radar-output-restructure version 1.0.0
Compare
Choose a tag to compare
@blootsvoets blootsvoets released this 26 May 10:46
v1.0.0
b168d12
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Changes since radar-hdfs-restructure version 0.6.0:

  • Added storage drivers for S3 API input and output
  • Storage is more consistent to configure
  • Changed synchronisation and accounting to be handled with Redis
    • With more consistent locking
    • Faster write times
    • Redis is required.
  • Added integration tests
  • Configurable automatic deletion after a threshold amount of time, to avoid storage filling up.
  • Reprocesses files that were modified after the last processed modification time.
  • Customizable time bin format
Assets 3
Loading