Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1403 commits
Select commit Hold shift + click to select a range
e9639f6
ci: consolidate tasks and use sccache and nextest (#1015)
shadaj Feb 26, 2024
e9c743e
ci: make sure we have fmt and clippy and don't cache latest nightly (…
shadaj Feb 26, 2024
b29d7cc
docs(docs): update build instructions (#1075)
MingweiSamuel Feb 26, 2024
1fdcf22
feat(docs): playground graph `WriteConfig` options functional, stylin…
MingweiSamuel Feb 26, 2024
82df6cf
feat(docs): style graph config settings (#1075)
MingweiSamuel Feb 26, 2024
b364328
ci: don't fail fast lints and tests (#1079)
shadaj Feb 27, 2024
c8d6985
feat(lattiecs): add `Lattice[Bi]Morphism` traits, impls for cartesian…
MingweiSamuel Feb 9, 2024
eb34ccd
feat(hydroflow_plus): use an IR before lowering to Hydroflow (#1070)
shadaj Feb 28, 2024
c1d1b51
feat(hydroflow_plus): unify send/demux/tagged APIs (#1080)
shadaj Feb 28, 2024
ff158db
feat(lattices): impl missing `SimpleCollectionRef` for various collec…
MingweiSamuel Mar 1, 2024
09f0c57
feat(hydroflow_lang): add (inefficient) `lattice_bimorphism` operator…
MingweiSamuel Mar 1, 2024
39ab8b0
chore: appease various clippy lints (#1084)
MingweiSamuel Mar 1, 2024
18ee2ad
fix(hydroflow): cleanup timing in some `surface_async` tests, #1078 (…
MingweiSamuel Mar 1, 2024
5a451ac
chore(variadics): prep for 0.0.4 release
MingweiSamuel Mar 2, 2024
83cac6b
chore: mark hydroflow_datalog, hydroflow_macro as unchanged for release
MingweiSamuel Mar 2, 2024
09ea65f
Release hydroflow_lang v0.6.0, hydroflow_datalog_core v0.6.0, hydrofl…
hydro-project-bot[bot] Mar 2, 2024
118a563
test(hydroflow): add hydroflow scheduling spin test for #1050 #800 (#…
MingweiSamuel Mar 1, 2024
99657d5
feat(hydroflow): scheduler `log` subgraph name (which includes surfac…
MingweiSamuel Mar 1, 2024
f8311db
fix(hydroflow): #1050 for `fold_keyed` (#1086)
MingweiSamuel Mar 1, 2024
fd90d41
feat: add `kvs_mut` example, fix #785 (#1087)
MingweiSamuel Mar 4, 2024
550b17c
docs: more improvements to `persist_mut[_keyed]` docs (#1089)
MingweiSamuel Mar 5, 2024
7958fb0
style: qualified path cleanups for clippy (#1090)
MingweiSamuel Mar 5, 2024
76e501a
style(hydroflow): `Never` -> `std::convert::Infallible` (#1093)
MingweiSamuel Mar 7, 2024
cfb3029
feat(hydroflow_plus): add APIs for running optimization passes (#1083)
shadaj Mar 11, 2024
61cb55a
feat(hydroflow_datalog): add aggregation for collecting values into a…
shadaj Mar 13, 2024
5b65626
feat(hydroflow_plus): move persist manipulation into a proper optimiz…
shadaj Mar 13, 2024
13235c1
docs: Few improvements to the quickstart guides (#1099)
rohitkulshreshtha Mar 13, 2024
2427847
docs(hydroflow_lang): add docs for `state()` operator (#1109)
MingweiSamuel Mar 18, 2024
90d2eb9
style: cleanup `.vscode/settings.json` (#1112)
MingweiSamuel Mar 19, 2024
6cc450b
test: add `fork_join/hydroflow/surface` benchmark, remove old comment…
MingweiSamuel Mar 19, 2024
be8d767
refactor: use smallvec `[_; 1]` for handoff pred(s)/succ(s) [ci-bench…
MingweiSamuel Mar 19, 2024
5f21e4c
feat(hydroflow): implement teeing handoff for scheduled layer (#1068)
discord9 Feb 21, 2024
31a543c
feat(hydroflow): allow dropping of tee handoff output to prevent memo…
discord9 Mar 18, 2024
0ac2d46
refactor(hydroflow): Teeing overhead moved to graph assembly time, in…
MingweiSamuel Mar 20, 2024
8a22b3a
refactor(hydroflow): Cleanup user-facing teeing APIs (#1068)
MingweiSamuel Mar 20, 2024
f29c710
fix(hydroflow): `HandoffMeta::is_bottom` impl for `TeeingHandoff` [ci…
MingweiSamuel Mar 20, 2024
70d420a
style(topolotree): remove redundant qualified name, for clippy
MingweiSamuel Mar 21, 2024
77f3e5a
feat(hydroflow_plus): simplify lifetime bounds for processes and clus…
shadaj Mar 21, 2024
dfe5a1b
fix(hydroflow_lang): allow `null()` to receive reference input
MingweiSamuel Mar 25, 2024
54b4ee3
fix(stageleft): ignore unnecessary lifetime lint on entrypoints (#1117)
shadaj Mar 25, 2024
d3a5f51
docs(hydroflow_plus): fix references to old APIs (#1116)
shadaj Mar 25, 2024
ba2df44
refactor(hydroflow_cli_integration): use `TcpListenerStream` instead …
MingweiSamuel Mar 27, 2024
5d68cd7
Some improvements to the hydroflow template (#14)
rohitkulshreshtha Mar 27, 2024
99bbe50
test(hydroflow): fix some `surface_codegen.rs` tests, actually test o…
MingweiSamuel Mar 27, 2024
6cc5a7f
fix(stageleft): handle multiple references to copy-able free variable…
shadaj Mar 27, 2024
b6e3bec
Initial Algebra Library (#1127)
conor-23 Mar 29, 2024
7f68ebf
feat(hydroflow_plus): simplify Location trait to remove lifetimes (#1…
shadaj Apr 2, 2024
a0e829e
fix(hydroflow_lang): fix `state()` op push codegen (#1130)
MingweiSamuel Apr 2, 2024
2d2c43d
fix(hydroflow_plus): allow BuiltFlow to be cloned even if the deploy …
shadaj Apr 2, 2024
916a366
feat(hydroflow_datalog): add syntax for "splatting" columns (#1132)
shadaj Apr 3, 2024
e395ad5
fix(hydroflow_datalog): leftover comments (#1135)
shadaj Apr 3, 2024
68d8ffc
feat(hydroflow_plus): switch launch to be a macro to enable borrowing…
shadaj Apr 3, 2024
602e21f
feat(hydroflow_lang): include subgraph ID in pivot_run codegen (#1137)
MingweiSamuel Apr 4, 2024
88e2ca4
refactor(hydroflow_lang): add `#[repr(transparent)]` to type guard co…
MingweiSamuel Apr 4, 2024
fc447ff
chore: appease latest nightly clippy (#1140)
MingweiSamuel Apr 4, 2024
0a5e785
feat(hydroflow_lang): initial proof-of-concept for singletons (#1091)
MingweiSamuel Feb 20, 2024
f9b26b6
feat(hydroflow_lang): switch singletons references to being per-op in…
MingweiSamuel Mar 30, 2024
8cb29fa
feat(hydroflow_lang): enable singleton reference usage in all operato…
MingweiSamuel Apr 2, 2024
601c484
feat(hydroflow_lang): improve singleton error messages/handling (#1133)
MingweiSamuel Apr 2, 2024
fa34dd3
feat(hydroflow_lang): track which ops have singleton state (#1133)
MingweiSamuel Apr 2, 2024
54c6874
feat(hydroflow_lang): enable inspect to have no ouputs (#1128)
MingweiSamuel Apr 5, 2024
1b19361
refactor(hydroflow_lang): consider singleton references as `DelayType…
MingweiSamuel Apr 5, 2024
1bde8a2
feat(hydroflow_lang): Render singleton references in graphvis (#1146)
MingweiSamuel Apr 5, 2024
2a10c4f
chore: mark `lattices` as unchanged for `0.6.1` release
MingweiSamuel Apr 5, 2024
cd63f22
Release hydroflow_cli_integration v0.5.2, hydroflow_lang v0.6.1, hydr…
hydro-project-bot[bot] Apr 5, 2024
5c5b652
feat(hydroflow_lang): allow `fold()` to be referenceable as a singlet…
MingweiSamuel Apr 3, 2024
994990b
fix(hydroflow_lang): Fix handling of single-node push subgraphs (#1134)
MingweiSamuel Apr 9, 2024
0f16d1f
feat(hydroflow_lang): make fold output optional, usable as just a sin…
MingweiSamuel Apr 9, 2024
d9f72a6
test(hydroflow_lang): add tests for #1147 (failing) (#1148)
MingweiSamuel Apr 9, 2024
82b3030
fix(hydroflow_lang): fix singleton reference edges being backwards, f…
MingweiSamuel Apr 9, 2024
5679bfb
feat(hydroflow_lang): allow `reduce()` to be referenceable as a singl…
MingweiSamuel Apr 9, 2024
23cfe08
Release hydroflow_lang v0.6.2, hydroflow v0.6.2, hydroflow_plus v0.6.…
hydro-project-bot[bot] Apr 9, 2024
c385c13
Release hydroflow_plus v0.6.1, hydro_deploy v0.6.1, hydro_cli v0.6.1,…
hydro-project-bot[bot] Apr 9, 2024
93fd05e
feat(stageleft): re-compile staged sources for the macro at the top l…
shadaj Apr 10, 2024
9a89595
ci: enable sccache on windows (#1154)
shadaj Apr 11, 2024
0cafbdb
fix(hydroflow_plus): handle send_bincode with local structs (#1151)
shadaj Apr 11, 2024
75fdb30
chore: updated pinned rust to 2024-04-10 (#1152)
MingweiSamuel Apr 10, 2024
d9b2c02
style: appease latest nightly clippy (#1152)
MingweiSamuel Apr 10, 2024
1801502
chore: update pyo3, silence warnings in generated code (#1152)
MingweiSamuel Apr 10, 2024
b050726
style: supress warnings on dead fields (#1152)
MingweiSamuel Apr 11, 2024
d2427e2
test(hydroflow): update some compile-fail outputs caused by rustc reg…
MingweiSamuel Apr 11, 2024
651ee1b
test: add `precheck.bash` for pre-commit checking (#1138)
MingweiSamuel Apr 12, 2024
92c72ba
fix(hydro_deploy): end processes with SIGTERM instead of SIGKILL (#1129)
shadaj Apr 12, 2024
29a263f
feat(hydroflow_plus): add support for collecting counts and running p…
davidchuyaya Apr 15, 2024
d7e579c
refactor(hydroflow_lang)!: replace `state()` with `state_ref()` imple…
MingweiSamuel Apr 16, 2024
1057b27
refactor(hydroflow_lang): unify `process_singletons.rs` code (#1159)
MingweiSamuel Apr 15, 2024
4386fac
refactor(hydroflow_lang)!: change `lattice_bimorphism` to take state …
MingweiSamuel Apr 12, 2024
720c8a0
chore(multiplatform_test): fix clippy warning on latest nightly, fix …
MingweiSamuel Apr 16, 2024
b9e585b
ci: include `multiplatform_test` as a top-level released crate (#1161)
MingweiSamuel Apr 16, 2024
7eac5f3
chore: update .gitignore
MingweiSamuel Apr 17, 2024
eeef3ac
Add Integral domain to algebra library (#1155)
chaeyeonlee07 Apr 17, 2024
69abccd
fix(hydroflow): fix `TeeingHandoff` not scheduling outputs `tee()`d a…
MingweiSamuel Apr 17, 2024
b072ee0
refactor(hydroflow): improve `TeeingHandoff` drop implementation (#1164)
MingweiSamuel Apr 17, 2024
cbb3e4b
chore(hydroflow_datalog): update Rust Sitter (#1168)
shadaj Apr 19, 2024
c901740
chore: update precheck.bash
MingweiSamuel Apr 20, 2024
c3f5a37
feat(hydroflow_plus): add prototype of tagging algebraic properties (…
conor-23 Apr 20, 2024
997d90a
feat(hydroflow): Added poll_futures and poll_futures_async operators.…
RyanAlameddine Apr 22, 2024
c9dc66d
feat(hydroflow_datalog)!: add detupling syntax and allow interleaving…
shadaj Apr 23, 2024
40f1a19
refactor(hydroflow_lang): remove reference edges, reverts #1017 #1041…
MingweiSamuel Apr 16, 2024
8f4cd7b
test(hydroflow): add tests for scheduler spinning #961 (#1171)
MingweiSamuel Apr 24, 2024
d773f9a
fix(hydroflow): fix scheduler spinning on replay, fix #961 (#1171)
MingweiSamuel Apr 23, 2024
c0a06bb
fix(lattices):typos in lattice docs (#1174)
conor-23 Apr 26, 2024
20471f1
refactor(hydroflow_lang): reorder error message emission for conflict…
MingweiSamuel Apr 19, 2024
9df9c62
feat(hydroflow_lang): error on unused ports, fix #1108 (#1167)
MingweiSamuel Apr 19, 2024
a4cd5fe
style(hydroflow): fix warning unnecessary qualification (#1178)
MingweiSamuel May 1, 2024
55051e1
Extend Chat Example w/ Gossip Based Backend (#1120)
rohitkulshreshtha May 1, 2024
d8e4d9d
feat(lattices): definitions of linearity and bilinearity in algebra lib
conor-23 May 1, 2024
152fc07
Added David's 2024 papers (#1180)
davidchuyaya May 1, 2024
4ca8ce4
feat(hydroflow_lang): allow `defer_tick()`, `next_stratum()` to have …
MingweiSamuel May 3, 2024
1873322
ci(hydro_cli): bump Python version to build on M1 (#1179)
shadaj May 3, 2024
2715350
style(hydroflow_lang): cleanup some ops formatting (#1176)
MingweiSamuel Apr 25, 2024
d57b911
fix(hydroflow_lang): cleanup codegen for `fold_keyed` (#1176)
MingweiSamuel Apr 26, 2024
e2fa6b0
fix(hydroflow_lang): fix #1050 for `reduce_keyed`, fix #1050 (#1176)
MingweiSamuel Apr 26, 2024
4f037bf
Marking precheck.bash as executable. (#1189)
rohitkulshreshtha May 9, 2024
b292f11
`source_interval` no longer emits Instant instances on output. (#1190)
rohitkulshreshtha May 9, 2024
c2f6c95
feat(hydroflow)!: Introduce newtypes for working with ticks (#1193)
rohitkulshreshtha May 13, 2024
b86f11a
chore: expect custom config names to prevent warnings (#1192)
MingweiSamuel May 13, 2024
f46e0ac
test(hydroflow): join replay static test (#1191)
MingweiSamuel May 14, 2024
c09a23e
fixup! test(hydroflow): join replay static test (#1191) (#1197)
MingweiSamuel May 14, 2024
6e57172
feat(hydroflow_plus): add API to get the cluster ID of the current no…
shadaj May 15, 2024
9bcc526
docs(kvs_bench): improve docs/README.md, fix #856 (#1199)
MingweiSamuel May 16, 2024
b649d47
refactor(kvs_bench): use `Duration` instead of int seconds (#1199)
MingweiSamuel May 17, 2024
f184ea1
feat(hydroflow_lang): insert `persist()` before singleton referencers…
MingweiSamuel May 17, 2024
218175c
feat(hydroflow)!:Change current_tick_start to wall clock time (#1196)
rohitkulshreshtha May 17, 2024
041bcf9
part 1 (#1181)
chaeyeonlee07 May 17, 2024
826dbd9
refactor: simplify `demux_enum()`, somewhat improves error messages #…
MingweiSamuel May 20, 2024
5ec13eb
feat(doc): Updated Hydroflow networking examples to point to Hydroflo…
rohitkulshreshtha May 21, 2024
b9e85a4
Add RunLLM chat widget to Hydro docs page (#1220)
cw75 May 22, 2024
fe704a6
docs: Add CONTRIBUTING.md, fix #1118 (#1222)
MingweiSamuel May 22, 2024
9364361
feat: add more to `precheck.bash`, add `--quick` option (#1222)
MingweiSamuel May 23, 2024
c2577bd
feat(lattices): Expose PairBimorphism public. (#1230)
rohitkulshreshtha May 23, 2024
b0692b0
feat(hydroflow_lang): add `'static`/`'tick` support for `state()` ope…
MingweiSamuel May 23, 2024
658f648
fix(stageleft): fix missing `syn` `visit-mut` feature (#1225)
MingweiSamuel May 24, 2024
0ed1f26
feat(lattices): Make Pair<> members public (#1233)
rohitkulshreshtha May 24, 2024
bf1322d
ci: validate the PR title rather than the commit message (#1169)
shadaj May 24, 2024
f21fe6f
chore: mark `hydroflow_datalog` as unchanged for 0.7 release
MingweiSamuel May 24, 2024
0d2f14b
docs: Updating CONTRIBUTING.md with some info about feature branches …
rohitkulshreshtha May 24, 2024
c9dfddc
chore: use workaround for `cargo smart-release` not properly ordering…
MingweiSamuel May 24, 2024
2852147
Release hydroflow_lang v0.7.0, hydroflow_datalog_core v0.7.0, hydrofl…
hydro-project-bot[bot] May 24, 2024
1ad690b
fix(lattices): Make inner for `WithTop` & `WithBot` private (#1244)
rohitkulshreshtha May 29, 2024
1a6228f
feat(variadics): add traits for referencing variadics (#1241)
MingweiSamuel May 30, 2024
b3d01c2
feat(lattices_macro): add `#[derive(Lattice)]` derive macros, fix #12…
MingweiSamuel Jun 3, 2024
b92dfc7
feat(variadics): add `iter_any_ref` and `iter_any_mut` to `VariadicsE…
MingweiSamuel Jun 4, 2024
1bc6c61
docs(hydroflow_lang): fix `dest_sink` tokio links (#1266)
MingweiSamuel Jun 4, 2024
b4e226f
docs(lattices_macro): add `#[derive(Lattice)]` docs to README, import…
MingweiSamuel Jun 4, 2024
2a4881d
docs: test code snipets, generate output for `surface_flows`, fix #81…
MingweiSamuel Jun 4, 2024
39ad0d6
fix(hydroflow): make sure tasks are spawned!!!! (#1273)
MingweiSamuel Jun 4, 2024
dfb5ec9
fix(hydroflow): yield before `collect_ready_async` to ensure backgrou…
MingweiSamuel Jun 4, 2024
b79f1a4
fix(hydroflow_lang): allow use of generics in `demux_enum::<...>()` o…
MingweiSamuel Jun 5, 2024
6ba72c5
chore(hydroflow): Checkin RustRover IDE files. (#1282)
rohitkulshreshtha Jun 5, 2024
70a3f9e
refactor(hydroflow_lang): improve diagnostics by re-spanning `#root` …
MingweiSamuel Jun 5, 2024
14067e9
docs(hydroflow_lang): cleanup for `clippy::doc_lazy_continuation` (#1…
MingweiSamuel Jun 6, 2024
b3c233d
test(hydroflow): fix `fold_keyed()` and add `reduce_keyed()` compile-…
MingweiSamuel Jun 7, 2024
f1442a0
refactor(hydroflow_lang): improve diagnostics for missing generic par…
MingweiSamuel Jun 13, 2024
baacf9d
refactor: rearrange `precheck.bash` conditions for exit code 0 (#1299)
MingweiSamuel Jun 13, 2024
3098f77
chore: update pinned rust version to 2024-06-17 (#1309)
MingweiSamuel Jun 18, 2024
f91c300
fix(hydroflow): add `add_state_tick` to state API, reset at end of ea…
MingweiSamuel Jun 18, 2024
404f0ac
fix(hydroflow_lang): improve spanning of singleton substitution code,…
MingweiSamuel Jun 19, 2024
30e5df2
fix: for upstream changes (#2)
MingweiSamuel Jun 19, 2024
f45b9dd
fix(hydroflow_lang): allow `ensure_singleton_referencers_succeed_pers…
MingweiSamuel Jun 20, 2024
7647461
Bump nightly toolchain version
shadaj Jun 20, 2024
0e30b50
move to template/hydroflow_plus
MingweiSamuel Jun 21, 2024
c1a70f8
Merge remote-tracking branch 'hpt/move' into hpt for #1314 (#1315)
MingweiSamuel Jun 21, 2024
888c3ce
chore: update pinned rust version
MingweiSamuel Jun 21, 2024
a75ace3
move to template/hydroflow
MingweiSamuel Jun 21, 2024
2270ea9
Merge remote-tracking branch 'ht/move-hf' into ht for #1314 (#1316)
MingweiSamuel Jun 21, 2024
8eb8aa1
docs(hydroflow_plus): update docs for hydroflow plus, pull code from …
MingweiSamuel Jun 25, 2024
c70114d
fix(variadics): fix `HomogenousVariadic` `get` and `get_mut` only ret…
MingweiSamuel Jun 28, 2024
c69a37b
chore: Update RunLLM Configuration (#1328)
agiron123 Jul 1, 2024
9c83440
fix(lattices): change fuzz test bounds to require `PartialEq` instead…
MingweiSamuel Jul 1, 2024
20080cb
feat(variadics): add traits for dealing with variadics of references …
MingweiSamuel Jul 2, 2024
67c0e51
refactor(hydroflow_lang)!: require lifetime on `perist*()` operators …
MingweiSamuel Jul 2, 2024
bedbb3f
refactor(hydroflow_plus_test): reorganize examples, one per file, add…
MingweiSamuel Jul 10, 2024
0feae74
refactor(hydro_deploy): build cache cleanup (#1334)
MingweiSamuel Jul 12, 2024
947ebc1
style(hydro_deploy): rename `SSH` -> `Ssh` (#1340)
MingweiSamuel Jul 14, 2024
e3e6933
refactor(hydro_deploy): remove unneeded `Arc<RwLock<` wrapping of `la…
MingweiSamuel Jul 15, 2024
b7275c2
style(hydroflow_lang): fix unnecessary `&` for clippy
MingweiSamuel Jul 15, 2024
ae78454
fix: add papers to website (#1342)
jhellerstein Jul 15, 2024
c13951a
docs: update cargo-generate commands, say to run `rustup update` to e…
MingweiSamuel Jul 15, 2024
256779a
revert: "feat(hydroflow): Added poll_futures and poll_futures_async o…
MingweiSamuel Jul 16, 2024
bbef070
fix(variadics): `EitherRefVariadic` is `Variadic` (#1352)
MingweiSamuel Jul 16, 2024
12b8ba5
style!: enable clippy `upper-case-acronyms-aggressive` (#1345)
MingweiSamuel Jul 16, 2024
141eae1
refactor(hydro_deploy)!: replace some uses of `tokio::sync::RwLock` w…
MingweiSamuel Jul 18, 2024
6039078
refactor(hydro_deploy)!: replace `async-channel` with `tokio::sync::m…
MingweiSamuel Jul 18, 2024
057a0a5
refactor(hydro_deploy)!: make `HydroflowSource`, `HydroflowSink` trai…
MingweiSamuel Jul 19, 2024
f536ecc
refactor(hydro_deploy)!: Make `Host::provision` not async anymore (#1…
MingweiSamuel Jul 19, 2024
c5a8de2
refactor(hydro_deploy)!: make `Host` trait use `&self` interior mutab…
MingweiSamuel Jul 20, 2024
2286558
refactor(hydro_deploy)!: make `Service::collect_resources` take `&sel…
MingweiSamuel Jul 22, 2024
186310f
chore: mark `hydroflow_datalog` and `hydroflow_macro` as unchanged fo…
MingweiSamuel Jul 22, 2024
0e64791
ci: use official create-github-app-token action
MingweiSamuel Jul 22, 2024
755e8a6
fix(hydroflow_lang)!: remove singleton referencer `persist::<'static>…
MingweiSamuel Jul 22, 2024
669beea
chore: mark `pusherators` as unchanged for release, to ensure version…
MingweiSamuel Jul 23, 2024
ca6c16b
Release hydroflow_lang v0.8.0, hydroflow_datalog_core v0.8.0, hydrofl…
hydro-project-bot[bot] Jul 23, 2024
993d43a
fix: MacOS lld compilation failure (#1361)
davidchuyaya Jul 25, 2024
f215b18
fix(hydroflow_lang): Provide types for filter on antijoin (#1362)
davidchuyaya Jul 25, 2024
654b77d
fix(hydro_deploy): avoid Terraform crashing on empty provider block (…
shadaj Jul 26, 2024
749a103
feat(hydro_deploy)!: Perf works over SSH (#1313)
davidchuyaya Jul 29, 2024
11d430e
fix(hydro_deploy): link with system linker for macOS wheels (#1363)
shadaj Jul 29, 2024
220b5bc
fixup! feat(hydro_deploy)!: Perf works over SSH (#1313)
MingweiSamuel Jul 30, 2024
ab12e5b
fix(hydroflow_plus): overly restrictive input types for `send_bincode…
shadaj Jul 30, 2024
8856c85
refactor(hydro_deploy)!: use `buildstructor` to handle excessive `Dep…
MingweiSamuel Jul 31, 2024
43ff49d
fix(variadics): allow `PartialEqVariadic::eq_ref` to take `AsRefVar`s…
MingweiSamuel Jul 31, 2024
77246e7
refactor(hydro_deploy): cleanup handling of arc `Weak` in `deployment…
MingweiSamuel Jul 31, 2024
a214786
refactor(hydro_deploy)!: `Deployment.stop()` for graceful shutdown in…
MingweiSamuel Aug 2, 2024
bb081d3
refactor(hydro_deploy)!: end-to-end flamegraph generation, fix #1365 …
MingweiSamuel Aug 6, 2024
bd793e2
feat(hydroflow): add `cross_singleton` operator (#1373)
shadaj Aug 6, 2024
c12b249
fix(hydroflow_plus): add `Clone` bounds to `cross_join` and simplify …
shadaj Aug 7, 2024
eaf497b
feat(hydroflow_plus): add operators necessary for Paxos / PBFT (#1376)
shadaj Aug 7, 2024
a88a550
refactor(hydro_deploy): adjust `ProgressTracker::println` (#1378)
MingweiSamuel Aug 13, 2024
09d6d44
refactor(hydroflow_plus)!: start rearranging stages of flow compilati…
shadaj Aug 13, 2024
0eba702
refactor(hydroflow_plus)!: defer network instantiation until after fi…
shadaj Aug 14, 2024
06c5141
fix(stageleft): typing hole when splicing `RuntimeData` (#1397)
shadaj Aug 14, 2024
128aaec
refactor(hydroflow_plus)!: simplify process/cluster specs (#1394)
shadaj Aug 14, 2024
5f2789a
refactor(hydroflow_plus)!: disentangle instantiated nodes from locati…
shadaj Aug 15, 2024
b518e67
fix(hydroflow_plus): wrong stream type for `source_interval` (#1405)
shadaj Aug 21, 2024
1aeacb2
fix(hydroflow_plus): rewrite IR in place to avoid stack overflow and …
shadaj Aug 21, 2024
46a8a2c
feat(hydroflow_plus): use trybuild to compile subgraph binaries (#1398)
shadaj Aug 21, 2024
75dd4fb
fix(hydroflow): `fold<'tick>` should always emit a value (#1407)
shadaj Aug 21, 2024
0ee5d96
feat(hydroflow_lang)!: change `state()` to output a stream of only de…
MingweiSamuel Aug 22, 2024
e8a40eb
docs: RELEASING.md say `cargo changelog` is from `cargo-smart-release…
MingweiSamuel Aug 22, 2024
0a465e5
refactor(hydro_deploy)!: rename integration crates to drop CLI refere…
shadaj Aug 22, 2024
fedd3ef
feat(hydro_deploy): improve progress UX by collapsing nested groups (…
shadaj Aug 22, 2024
3850b47
feat(hydroflow): Added simulation framework. (#1416)
rohitkulshreshtha Aug 22, 2024
63b528f
fix(hydro_deploy): only instantiate `Localhost` once (#1403)
shadaj Aug 22, 2024
7bf9ee2
feat(hydroflow_plus): add paxos (#1410)
davidchuyaya Aug 22, 2024
e7fadc5
fix(hydroflow_plus): merge issue in paxos (#1419)
shadaj Aug 22, 2024
3c41e1e
chore: drop unused dependencies (#1417)
shadaj Aug 22, 2024
fa41720
style!: rename some `CLI`->`Deploy`, decapitalize acronym names (#1399)
MingweiSamuel Aug 23, 2024
9e5f58e
feat(hydroflow_lang): allow `demux_enum` to have any number of output…
MingweiSamuel Aug 23, 2024
11af328
chore: lower min dependency versions where possible, update `Cargo.lo…
MingweiSamuel Aug 24, 2024
461ae84
refactor: remove `lazy_static` dependency (#1426)
MingweiSamuel Aug 25, 2024
6568263
feat(hydro_deploy): Add end-to-end flamegraph generation for macos an…
MingweiSamuel Aug 26, 2024
536e644
feat(hydroflow_plus)!: refactor API to have no-tick semantics by defa…
shadaj Aug 26, 2024
22c7218
fix(hydroflow_lang): remove `FlowProps` (#1420)
MingweiSamuel Aug 26, 2024
44c6b14
feat(hydroflow_plus)!: separate singletons into their own types (#1425)
shadaj Aug 27, 2024
f5f1eb0
docs: cleanup doc comments for clippy latest (#1428)
MingweiSamuel Aug 27, 2024
82de6f5
feat(hydroflow_plus): add unbounded top-level singletons (#1427)
shadaj Aug 27, 2024
3fde68d
style(hydro_deploy): use `name_of!` macro (#1429)
MingweiSamuel Aug 27, 2024
c4683ca
fix(hydro_deploy): only record usermode events in perf (#1431)
shadaj Aug 28, 2024
71f69aa
feat(hydroflow_plus): add API for cycle with initial value (#1430)
shadaj Aug 28, 2024
9c352f5
refactor(hydroflow_lang): cleanup handling of span locations #1268, w…
MingweiSamuel Aug 28, 2024
c8a6bc4
ci: increase CI timeouts
MingweiSamuel Aug 29, 2024
c41787f
ci: update `RELEASING.md` notes, prep for release, wip
MingweiSamuel Aug 30, 2024
6ac34e2
ci: update `RELEASING.md`, say to manually bump versions of renamed c…
MingweiSamuel Aug 30, 2024
a2ec110
chore: manually set versions for crates renamed in #1413
MingweiSamuel Aug 30, 2024
0750117
Release hydroflow_lang v0.9.0, hydroflow_datalog_core v0.9.0, hydrofl…
hydro-project-bot[bot] Aug 30, 2024
01c9c24
docs: Update README.md for docs website (#1438)
rohitkulshreshtha Sep 4, 2024
af58f64
docs: update npm packages (#1437)
MingweiSamuel Sep 4, 2024
5b8ed84
add working test harness site
MingweiSamuel Sep 4, 2024
8712635
call global javascript function from rust (ugly)
MingweiSamuel Sep 5, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
21 changes: 21 additions & 0 deletions .cargo/config.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
[build]
rustflags = [
"-Zproc-macro-backtrace",
"-Wunused_qualifications",
"-Wclippy::upper_case_acronyms",
# Flag to make build.rs scripts generate docs. Should only be used in this repository
# internally, not by dependants.
'--cfg=HYDROFLOW_GENERATE_DOCS',
# https://github.com/rust-lang/rust-clippy/issues/10087
## TODO(mingwei): Need rust-analyzer support:
# "-Aclippy::uninlined-format-args",
]

[target.x86_64-apple-darwin]
linker = "rust-lld"

[target.x86_64-unknown-linux-musl]
linker = "rust-lld"

[target.x86_64-pc-windows-msvc]
linker = "rust-lld.exe"
18 changes: 18 additions & 0 deletions .config/nextest.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
[test-groups]
serial-integration = { max-threads = 1 }

[[profile.default.overrides]]
filter = 'binary(deadlock_detector)'
test-group = 'serial-integration'

[[profile.default.overrides]]
filter = 'binary(two_pc)'
test-group = 'serial-integration'

[[profile.default.overrides]]
filter = 'binary(kvs)'
test-group = 'serial-integration'

[[profile.default.overrides]]
filter = 'binary(kvs_replicated)'
test-group = 'serial-integration'
1 change: 1 addition & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
target/
7 changes: 7 additions & 0 deletions .github/gh-pages/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
/debug
/release
/tmp
/CACHEDIR.tag
/.lock
/.rustc_info.json
/.rustdoc_fingerprint.json
8 changes: 8 additions & 0 deletions .github/gh-pages/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
---
- [The Hydroflow Book]({{ "/book/" | prepend: site.github.url | replace: 'http://', '//' }})
- [Rust Docs]({{ "/doc/hydroflow/" | prepend: site.github.url | replace: 'http://', '//' }})
- [Design Docs]({{ "/design_docs/" | prepend: site.github.url | replace: 'http://', '//' }})
- [Benchmark History]({{ "/bench/" | prepend: site.github.url | replace: 'http://', '//' }})
- [Latest Benchmarks]({{ "/criterion/report/" | prepend: site.github.url | replace: 'http://', '//' }})
- [Github Repository 🔗](https://github.com/hydro-project/hydroflow)
14 changes: 14 additions & 0 deletions .github/workflows/audit.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
name: Security audit
on:
push:
paths:
- '**/Cargo.toml'
- '**/Cargo.lock'
jobs:
security_audit:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: actions-rs/audit-check@v1
with:
token: ${{ secrets.GITHUB_TOKEN }}
185 changes: 185 additions & 0 deletions .github/workflows/build-cli.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,185 @@
name: Build CLI

on:
push:
branches:
- main
- feature/**
tags:
- 'hydro_cli-v[0-9]+.[0-9]+.[0-9]+'

env:
PACKAGE_NAME: hydro_deploy
PYTHON_VERSION: "3.10" # to build abi3 wheels

# based on Ruff's CI
jobs:
pre_job:
runs-on: ubuntu-latest
outputs:
should_skip: ${{ steps.skip_check.outputs.should_skip }}
steps:
- id: skip_check
uses: fkirc/skip-duplicate-actions@v5.3.0
with:
cancel_others: "true"

macos-universal:
runs-on: macos-latest
if: ${{ needs.pre_job.outputs.should_skip != 'true' }}
needs: pre_job
strategy:
matrix:
target:
- universal2-apple-darwin
steps:
- uses: actions/checkout@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_VERSION }}
- name: "Build wheels"
uses: PyO3/maturin-action@v1
with:
working-directory: hydro_deploy/hydro_cli
target: ${{ matrix.target }}
args: --release --out dist
env:
CARGO_TARGET_X86_64_APPLE_DARWIN_LINKER: clang
- name: "Install built wheel"
run: |
pip install hydro_deploy/hydro_cli/dist/${{ env.PACKAGE_NAME }}-*.whl --force-reinstall
- name: "Upload wheels"
uses: actions/upload-artifact@v3
with:
name: wheels
path: hydro_deploy/hydro_cli/dist

linux:
runs-on: ubuntu-latest
if: ${{ needs.pre_job.outputs.should_skip != 'true' }}
needs: pre_job
strategy:
matrix:
target:
- x86_64-unknown-linux-gnu
- i686-unknown-linux-gnu
steps:
- uses: actions/checkout@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_VERSION }}
architecture: x64
- name: "Build wheels"
uses: PyO3/maturin-action@v1
with:
working-directory: hydro_deploy/hydro_cli
target: ${{ matrix.target }}
manylinux: auto
# fix openssl, based on https://github.com/Intreecom/scyllapy/blob/develop/.github/workflows/release.yaml
before-script-linux: |
if command -v yum &> /dev/null; then
yum update -y && yum install -y perl-core libatomic

# If we're running on i686 we need to symlink libatomic
# in order to build openssl with -latomic flag.
if [[ ! -d "/usr/lib64" ]]; then
ln -s /usr/lib/libatomic.so.1 /usr/lib/libatomic.so
fi
fi
args: --release --out dist
- name: "Install built wheel"
if: ${{ startsWith(matrix.target, 'x86_64') }}
run: |
pip install hydro_deploy/hydro_cli/dist/${{ env.PACKAGE_NAME }}-*.whl --force-reinstall
- name: "Upload wheels"
uses: actions/upload-artifact@v3
with:
name: wheels
path: hydro_deploy/hydro_cli/dist

linux-cross:
runs-on: ubuntu-latest
if: ${{ needs.pre_job.outputs.should_skip != 'true' }}
needs: pre_job
strategy:
matrix:
platform:
- target: aarch64-unknown-linux-gnu
arch: aarch64
- target: armv7-unknown-linux-gnueabihf
arch: armv7
steps:
- uses: actions/checkout@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_VERSION }}
- name: "Build wheels"
uses: PyO3/maturin-action@v1
with:
working-directory: hydro_deploy/hydro_cli
target: ${{ matrix.platform.target }}
manylinux: auto
args: --release --out dist
- name: "Upload wheels"
uses: actions/upload-artifact@v3
with:
name: wheels
path: hydro_deploy/hydro_cli/dist

windows:
runs-on: windows-latest
if: ${{ needs.pre_job.outputs.should_skip != 'true' }}
needs: pre_job
strategy:
matrix:
platform:
- target: x86_64-pc-windows-msvc
arch: x64
- target: i686-pc-windows-msvc
arch: x86
- target: aarch64-pc-windows-msvc
arch: x64
steps:
- uses: actions/checkout@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_VERSION }}
architecture: ${{ matrix.platform.arch }}
- name: "Build wheels"
uses: PyO3/maturin-action@v1
with:
working-directory: hydro_deploy/hydro_cli
target: ${{ matrix.platform.target }}
args: --release --out dist
- name: "Install built wheel"
if: ${{ !startsWith(matrix.platform.target, 'aarch64') }}
shell: bash
run: |
python -m pip install hydro_deploy/hydro_cli/dist/${{ env.PACKAGE_NAME }}-*.whl --force-reinstall
- name: "Upload wheels"
uses: actions/upload-artifact@v3
with:
name: wheels
path: hydro_deploy/hydro_cli/dist

release:
name: Release
runs-on: ubuntu-latest
needs:
- macos-universal
- linux
- linux-cross
- windows
if: ${{ startsWith(github.ref, 'refs/tags/hydro_cli-') }}
steps:
- uses: actions/download-artifact@v3
with:
name: wheels
- uses: actions/setup-python@v5
- name: "Publish to PyPi"
env:
TWINE_USERNAME: __token__
TWINE_PASSWORD: ${{ secrets.PYPI_TOKEN }}
run: |
pip install --upgrade twine
twine upload --skip-existing *
Loading