Make `Dagger.finish_stream()` propagate downstream#579

Closed

JamesWrigley wants to merge 56 commits intojps/stream2from

Commits on Nov 15, 2024

Add metadata to EagerThunk

jpsamaroo
authored and
JamesWrigley
committed
Sch: Allow occupancy key to be Any

jpsamaroo
authored and
JamesWrigley
committed
Add streaming API

jpsamaroo
authored and
JamesWrigley
committed
Reference Dagger.EAGER_THUNK_STREAMS explicitly
JamesWrigley
committed
Use Base.promote_op() instead of Base._return_type()
JamesWrigley
committed
Special-case StreamingFunction in EagerThunkMetadata() constructor
JamesWrigley
committed
Fix reference to task-queues.md in the docs
JamesWrigley
committed
Delete Dagger.cleanup()
JamesWrigley
committed
streaming: Show thunk ID in logs

jpsamaroo
authored and
JamesWrigley
committed
streaming: Add tests

jpsamaroo
authored and
JamesWrigley
committed
Use procs() when initializing EAGER_CONTEXT
JamesWrigley
committed
streaming: Fix concurrency issues

jpsamaroo
authored and
JamesWrigley
committed
Add a --verbose option to runtests.jl
JamesWrigley
committed
Ensure that stream_fetch_values!() yields in its loop
JamesWrigley
committed
Add support for limiting the evaluations of a streaming DAG
JamesWrigley
committed
Dev the migration-helper branch of MemPool.jl
JamesWrigley
committed
Minor style cleanup
JamesWrigley
committed
Use `DTaskFailedException` and increase the default timeout
JamesWrigley
committed
Initial support for robustly migrating streaming tasks
JamesWrigley
committed
Inherit the top-level testsets in the streaming tests
JamesWrigley
committed
Replace `rand_finite()` with a deterministic `Producer` functor
JamesWrigley
committed
fixup! Initial support for robustly migrating streaming tasks
JamesWrigley
committed
fixup! fixup! Initial support for robustly migrating streaming tasks

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Refactor into DTaskTLS struct

jpsamaroo
authored and
JamesWrigley
committed
fixup! task-tls: Refactor into DTaskTLS struct

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
streaming: Handle cancellation

jpsamaroo
authored and
JamesWrigley
committed
fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! fixup! Initial support for robustly migrating streaming tasks

jpsamaroo
authored and
JamesWrigley
committed
Sch: Add unwrap_nested_exception for DTaskFailedException

jpsamaroo
authored and
JamesWrigley
committed
ProcessRingBuffer: Add length method

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
streaming: Buffers and tasks per input/output

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
Sch: Trigger cancel token on task exit

jpsamaroo
authored and
JamesWrigley
committed
Add task_id for DTask

jpsamaroo
authored and
JamesWrigley
committed
ProcessRingBuffer: Allow closure

jpsamaroo
authored and
JamesWrigley
committed
RemoteFetcher: Only collect values up to free buffer space

jpsamaroo
authored and
JamesWrigley
committed
streaming: Close buffers on closing StreamStore

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Tweaks and fixes, task_id helper

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Add task_cancel!

jpsamaroo
authored and
JamesWrigley
committed
streaming: max_evals cannot be specified as 0

jpsamaroo
authored and
JamesWrigley
committed
streaming: Small tweaks to migration and cancellation

jpsamaroo
authored and
JamesWrigley
committed
dagdebug: Always yield to avoid heisenbugs

jpsamaroo
authored and
JamesWrigley
committed
tests: Revamp streaming tests

jpsamaroo
authored and
JamesWrigley
committed
tests: Add offline mode

jpsamaroo
authored and
JamesWrigley
committed
dagdebug: Add JULIA_DAGGER_DEBUG config variable

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Add graceful vs. forced

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Wrap InterruptException in DTaskFailedException

jpsamaroo
authored and
JamesWrigley
committed
options: Add internal helper to strip all options

jpsamaroo
authored and
JamesWrigley
committed
streaming: Get tests passing

jpsamaroo
authored and
JamesWrigley
committed

Commits on Nov 16, 2024

Commits on Nov 17, 2024