hydro_deploy_integration v0.15.0

New Features

• add Location::bind_single_client for bidi single client
• DemuxMap, use in hydro_deploy_integration

Bug Fixes

• compilation on non-Unix [ci-full]
• [ci-full] fix ci issues
  • run docs/website on pr
• use bash by default on windows
• build website with nightly
• increase test timeout to 45m
• run docs with nightly
• make rustfmt use native line endings instead of unix
• fix compile-fail nightly stderr outputs
• add the ability to include [ci-full] into the body/title of a PR to
  get it to run the full stable/nightly linux/windows test matrix.

New Features (BREAKING)

• start adding APIs for various forms of keyed streams "joins", add KVS counter server
  Also fixes incorrect output metadata for KeyedStream::fold, and
  removes KeyedSingleton::all_ticks for now until we a) actually need it
  and b) can think carefully about its semantics.

• expose a stream of membership events for bidi externals

• introduce support for dynamic external clients
  So far, Hydro has only supported deployments where there is a statically
  known number of single-connection external clients for sending /
  receiving data. This is not practical in production applications where
  external users will dynamically connect to the Hydro service.

  This takes the first step towards addressing this, by setting up the
  networking mechanism for handling dynamically connected clients and
  adding an API for sending/receiving data.

  This also changes the source_external_bytes APIs to return the raw
  BytesMut sent over the network, rather than adding a freezing step.

  Finally, we show an end-to-end example using this interface to write a
  simple HTTP server.

Refactor (BREAKING)

• remove unnecessary ConnectedSourceSink trait

Commit Statistics

• 11 commits contributed to the release.
• 10 commits were understood as conventional.
• 10 unique issues were worked on: #1966, #1978, #1980, #1981, #1996, #2029, #2031, #2163, #2246, #2267

Commit Details

view details

• #1966
  • Introduce support for dynamic external clients (5d40134)
• #1978
  • Remove unnecessary ConnectedSourceSink trait (97b879d)
• #1980
  • Make polling fair with round-robin (6b37888)
• #1981
  • Expose a stream of membership events for bidi externals (1bb2262)
• #1996
  • Start adding APIs for various forms of keyed streams "joins", add KVS counter server (f9f5317)
• #2029
  • [ci-full] fix ci issues (4e84a3f)
• #2031
  • Use round-robin polling for MergeSource to ensure fairness (92adacc)
• #2163
  • DemuxMap, use in hydro_deploy_integration (335ded3)
• #2246
  • Add Location::bind_single_client for bidi single client (4a43594)
• #2267
  • Compilation on non-Unix [ci-full] (e5f2004)
• Uncategorized
  • Release hydro_build_utils v0.0.1, dfir_lang v0.15.0, dfir_macro v0.15.0, variadics v0.0.10, sinktools v0.0.1, hydro_deploy_integration v0.15.0, lattices_macro v0.5.11, variadics_macro v0.6.2, lattices v0.6.2, multiplatform_test v0.6.0, dfir_rs v0.15.0, copy_span v0.1.0, hydro_deploy v0.15.0, hydro_lang v0.15.0, hydro_std v0.15.0, safety bump 5 crates (092de25)