v0.19.1

Dagger v0.19.1

Diff since v0.19.0

Merged pull requests:

• scopes/Sch: Add optimized check for proc in scope (#640) (@jpsamaroo)
• Add support for @inbounds via Base.@BoundsCheck in abstract array types (#643) (@pszufe)
• CI: Remove DTables reverse CI (#644) (@jpsamaroo)
• Sch: Quietly fail to put do_tasks exception (#645) (@jpsamaroo)
• change div to cld to avoid DivideError in FFT (#648) (@islent)

Closed issues:

• 3D FFT ConcurrencyViolationError (#646)
• 3D FFT gets DivideError: integer division error (#647)

v0.19.0

Dagger v0.19.0

Diff since v0.18.17

Breaking changes

• The result of delayed(...)(...) can no longer be evaluated twice
• ThunkOptions has been replaced with Options
• Arbitrary options cannot be propagated anymore
• The Processor component of Chunk, and the processor option, are no longer relevant to scheduling

Merged pull requests:

• Various performance and memory optimizations (#558) (@jpsamaroo)
• datadeps: Add at-stencil helper (#564) (@jpsamaroo)
• Add task affinity support with compute_scope and result_scope in Dagger.jl's @spawn macro (#610) (@AkhilAkkapelli)
• logging: Default disable metrics, enable all_task_deps (#626) (@jpsamaroo)
• Add view Support for Efficient DArray Chunk Slicing (#627) (@AkhilAkkapelli)
• DArray: Add FFT implementation for 1D/2D/3D (#629) (@jpsamaroo)
• Enhance DArray Distribution with Processor Assignment (#630) (@AkhilAkkapelli)
• CompatHelper: bump compat for AMDGPU in [weakdeps] to 2, (keep existing compat) (#637) (@github-actions[bot])

Closed issues:

• Memory leak when copying data from one worker to another (#547)

v0.18.17

Dagger v0.18.17

Diff since v0.18.16

Merged pull requests:

• tests: Test show_logs method (#601) (@jpsamaroo)
• docs: Document Dagger.set_distributed_package! (#602) (@jpsamaroo)
• docs: Make note about required packages for visualization (#603) (@jpsamaroo)
• JSON3Ext: Deprecate Dagger.render_logs for :chrome_trace (#604) (@jpsamaroo)
• docs: Adjust wording and headers for viz (#605) (@jpsamaroo)
• docs: Clarify limitations of Datadeps (#606) (@jpsamaroo)
• docs: Define Datadeps example functions with @everywhere (#607) (@jpsamaroo)
• datadeps: Support field access in Deps (#608) (@jpsamaroo)
• datadeps: Support inner task scopes (#609) (@jpsamaroo)
• datadeps: Reduce dynamic dispatch with wrappers (#612) (@jpsamaroo)
• CI: Add Buildkite test jobs for Julia 1.10 and 1.11 (#613) (@jpsamaroo)
• docs: Simplify logging basics (#614) (@jpsamaroo)
• docs: Move Options subsection in task-spawning.md (#615) (@jpsamaroo)
• Add documentation for different task spawning syntaxes (#616) (@jpsamaroo)
• docs: Document move and move! functions (#617) (@jpsamaroo)
• stencils: Add tests and documentation (#619) (@jpsamaroo)
• Fix DArray setindex! scope, and support threads=: in Dagger.scope() (#620) (@jpsamaroo)
• Move GPU support into Dagger (#623) (@jpsamaroo)

Closed issues:

• 'No TID' warnings when shard is used (#571)
• Error when using Dagger in Jupyter Notebook / Google Colab (#594)
• Error with docs example on nested loops (#595)
• Dagger.workers() do not include DistributedNext workers ? (#600)

v0.18.16

Dagger v0.18.16

Diff since v0.18.15

Merged pull requests:

• precompile: Switch task cleanup assert to warn (#599) (@jpsamaroo)

Closed issues:

• Dagger won't precompile in Julia 1.12-beta3 (#598)

v0.18.15

Dagger v0.18.15

Diff since v0.18.14

Merged pull requests:

• Add streaming API (#463) (@jpsamaroo)
• datadeps: Don't skip copy on no writedep (#580) (@jpsamaroo)
• streaming: Add DAG teardown option (#584) (@jpsamaroo)
• parser: Support setindex (#585) (@jpsamaroo)
• Hash USER environment variable during system_uuid fallback (#587) (@nHackel)
• docs: writes to parameter passed to Out(), doesnt read from it (#590) (@n0rbed)
• x is uninitialized in docs (#593) (@n0rbed)

Closed issues:

• Bump TimespanLogging and register new version (#597)

v0.18.14

Dagger v0.18.14

Diff since v0.18.13

Merged pull requests:

• Initial support for robustly migrating streaming tasks (#568) (@JamesWrigley)
• CompatHelper: add new compat entry for PythonCall in [weakdeps] at version 0.9, (keep existing compat) (#574) (@github-actions[bot])
• parser: Re-support broadcast (#575) (@jpsamaroo)
• Use [sources] to specify local deps for documentation (#576) (@m-fila)
• CompatHelper: bump compat for Colors in [weakdeps] to 0.13, (keep existing compat) (#577) (@github-actions[bot])
• Update CI jobs (#578) (@JamesWrigley)
• Add support for DistributedNext (#582) (@JamesWrigley)

Closed issues:

• Dagger documentation does not build locally (#552)

v0.18.13

Dagger v0.18.13

Diff since v0.18.12

Merged pull requests:

• Add render/show_logs to chrome_trace (#540) (@m-fila)
• Include datadeps in API documentation (#541) (@m-fila)
• CompatHelper: add new compat entry for JSON3 in [weakdeps] at version 1, (keep existing compat) (#542) (@github-actions[bot])
• Add a Features/Roadmap document (#544) (@jpsamaroo)
• Add rand! implementation (#546) (@pszufe)
• add documentation for Task / Thread occupancy (#549) (@wolthom)
• Warn in docs about sync on inner loops (#550) (@quildtide)
• docs: Create favicon and add it to the documentation (#551) (@wolthom)
• @Spawn: Properly rethrow in @sync (#553) (@jpsamaroo)
• More Thunk to DTask renames (#554) (@jpsamaroo)
• Add fetch_all recursive helper (#555) (@jpsamaroo)
• @spawn: Support NamedTuple construction and access (#556) (@jpsamaroo)
• Add task/scheduler cancellation API (#557) (@jpsamaroo)
• Replace all uses of @async with Threads.@Spawn (#559) (@JamesWrigley)
• Task names, and various GraphVizExt and PlotsExt improvements (#560) (@jpsamaroo)
• Update README.md (#562) (@Rabab53)
• LU implementation for DArray (#565) (@jpsamaroo)
• Make Dagger.cancel!() handle a shutting down/shutdown scheduler (#566) (@JamesWrigley)
• use user given task names in chrome trace (#570) (@m-fila)
• Add Python integration (#572) (@jpsamaroo)

Closed issues:

• Assignable task names for logging purposes (#545)
• Parallelization across threads does not appear to work correctly (#548)

v0.18.12

Dagger v0.18.12

Diff since v0.18.11

Merged pull requests:

• DArray: Fix DMatrix show elements (#530) (@jpsamaroo)
• Dead worker handling (#532) (@JamesWrigley)
• parser: Assorted improvements (#533) (@jpsamaroo)
• aliasing: Add optimized will_alias for views (#534) (@jpsamaroo)
• DArray: Make allocations configurable via Processor (#535) (@jpsamaroo)
• Sch: Halt on Julia exit (#537) (@jpsamaroo)
• Fix typos in documentation, tests and benchmarks (#538) (@m-fila)
• Minor fixes to Datadeps for GPUs (#539) (@jpsamaroo)

Closed issues:

• Dagger's syntax when calling functions with kwards does not match Julia syntax (#421)
• BUG @spawn macro does not support do syntax (#479)
• @spawn does not work with nested function call (#480)
• Adding processes and using eager API produces warnings about workers dying (#536)

v0.18.11

Dagger v0.18.11

Diff since v0.18.10

Merged pull requests:

• Add support for limiting the evaluations of a streaming DAG (#519) (@JamesWrigley)
• CompatHelper: add new compat entry for GraphViz in [weakdeps] at version 0.2, (keep existing compat) (#520) (@github-actions[bot])
• CompatHelper: add new compat entry for DataFrames in [weakdeps] at version 1, (keep existing compat) (#521) (@github-actions[bot])
• CompatHelper: add new compat entry for Colors in [weakdeps] at version 0.12, (keep existing compat) (#522) (@github-actions[bot])
• CompatHelper: add new compat entry for Plots in [weakdeps] at version 1, (keep existing compat) (#523) (@github-actions[bot])
• DArray: Fix broken indexing caching (#525) (@jpsamaroo)
• tests: Fix assumption that rand won't return 0 (#526) (@jpsamaroo)
• delayed: Make depwarn less noisy (#527) (@jpsamaroo)
• DArray: Improve 0-dim support (#528) (@jpsamaroo)

v0.18.10

Dagger v0.18.10

Diff since v0.18.9

Merged pull requests:

• Cleanup imports with ExplicitImports.jl (#504) (@JamesWrigley)
• DArray: Add automatic partitioning and show array elements (#505) (@jpsamaroo)
• build(deps): bump julia-actions/cache from 1 to 2 (#508) (@dependabot[bot])
• Add a section to the documentation about code loading (#510) (@JamesWrigley)
• Add type restrictions to Base.isless() methods to fix invalidations (#511) (@JamesWrigley)
• logging/viz: Some fixes, and more docstrings (#513) (@jpsamaroo)
• Add option to the tests for setting the number of workers (#515) (@JamesWrigley)
• Test fixes (#516) (@JamesWrigley)
• Rename EagerThunk to DTask (#518) (@jpsamaroo)
• Datadeps: Add aliasing awareness and GPU support (#524) (@jpsamaroo)

Closed issues:

• function show_plan not working (#433)
• Cannot precompile Dagger on Julia 1.11.0-beta1 (#503)
• KeyError: key Dagger not found (#509)