v0.18.10

Dagger v0.18.10

Diff since v0.18.9

Merged pull requests:

• Cleanup imports with ExplicitImports.jl (#504) (@JamesWrigley)
• DArray: Add automatic partitioning and show array elements (#505) (@jpsamaroo)
• build(deps): bump julia-actions/cache from 1 to 2 (#508) (@dependabot[bot])
• Add a section to the documentation about code loading (#510) (@JamesWrigley)
• Add type restrictions to Base.isless() methods to fix invalidations (#511) (@JamesWrigley)
• logging/viz: Some fixes, and more docstrings (#513) (@jpsamaroo)
• Add option to the tests for setting the number of workers (#515) (@JamesWrigley)
• Test fixes (#516) (@JamesWrigley)
• Rename EagerThunk to DTask (#518) (@jpsamaroo)
• Datadeps: Add aliasing awareness and GPU support (#524) (@jpsamaroo)

Closed issues:

• function show_plan not working (#433)
• Cannot precompile Dagger on Julia 1.11.0-beta1 (#503)
• KeyError: key Dagger not found (#509)

v0.18.9

Dagger v0.18.9

Diff since v0.18.8

Merged pull requests:

• logging: Make IDs consistent, add helpers for logging and visualization (#468) (@jpsamaroo)
• @shard: Construct shards in parallel (#481) (@jpsamaroo)
• Reference Dagger.EAGER_THUNK_STREAMS explicitly (#484) (@JamesWrigley)
• DArray: Fixes and improvements for mapreduce operations (#485) (@jpsamaroo)
• Special-case StreamingFunction in EagerThunkMetadata() constructor (#486) (@JamesWrigley)
• Stop tracking the manifest files (#487) (@JamesWrigley)
• Fix import of ScopedValues in Julia v1.11 (#489) (@JamesWrigley)
• DArray: Implement efficient in-place matrix-matrix multiply (#492) (@Rabab53)
• Add options docstrings to the docs (#493) (@JamesWrigley)
• Doc/add Quickstart datadeps documentation (#495) (@johnmaxrin)
• Streaming branch fixes (#496) (@JamesWrigley)
• Remove more invalidations (#498) (@jpsamaroo)
• build(deps): bump julia-actions/setup-julia from 1 to 2 (#499) (@dependabot[bot])
• Add num_processors helper (#500) (@jpsamaroo)
• precompile: Don't let throwto hang the root task (#502) (@jpsamaroo)

Closed issues:

• shard executes f in sequence, not in parallel (#473)
• API Request: number of processors (including threads) (#474)
• Feature Request: Support init argument for reduce functions. (#475)
• Updating to Documenter.jl v1 (#482)
• Cannot use Dagger with Julia 1.11 (alpha2) (#488)
• Cannot use Dagger on Julia beta 1.11.0 (#501)

v0.18.8

Dagger v0.18.8

Diff since v0.18.7

• Disabled CHUNK_CACHE eviction logic
• Added view and cholesky/cholesky! operations to the DArray
• Added helpers all_processors and compatible_processors
• Fixed some precompile hangs seen on Mac M-series chips
• Removed the DArray stage cache

Merged pull requests:

• Sch: Disable CHUNK_CACHE evictions for now (#467) (@jpsamaroo)
• DArray: Add Cholesky and view implementations (#469) (@jpsamaroo)
• Add some processor utilities (#470) (@jpsamaroo)
• precompile: Slightly lengthen pre-wait timeout (#471) (@jpsamaroo)
• DArray: Remove the stage cache (#472) (@jpsamaroo)

v0.18.7

Dagger v0.18.7

Diff since v0.18.6

• Added spawn_datadeps for OpenMP-style (in/out) task dependencies
• Eagerly free task results when task will no longer be used
• Assorted bug fixes

Merged pull requests:

• Add spawn_datadeps for OMP-like task model (#454) (@jpsamaroo)
• Retry jl_set_task_tid on failure (#462) (@jpsamaroo)
• Eagerly free Thunk cached results when unneeded (#464) (@jpsamaroo)
• Sch: Temporarily disable chunk cache (#465) (@jpsamaroo)

Closed issues:

• Error: "jl_set_task_tid == 0" when calling length(::DTable) (#459)

v0.18.6

Dagger v0.18.6

Diff since v0.18.5

Various bugfixes:

• Removed some 1- and 2-letter exports that could conflict with user variables
• Skipped accidental hashing of arbitrary task arguments in the scheduler
• Fixed with_options not merging new options with previously-set options (yikes!)

Merged pull requests:

• DaggerWebDash: Use gethostname and getipaddr (#451) (@jpsamaroo)
• Don't export Bytes constants (#458) (@jpsamaroo)
• reschedule_inputs: Don't hash non-Thunk inputs (#460) (@jpsamaroo)
• tests: Test for previous option preservation (#461) (@jpsamaroo)

v0.18.5

Dagger v0.18.5

Diff since v0.18.4

Fixed a variety of concurrency bugs

Merged pull requests:

• Add precompilation via PrecompileTools (#446) (@jpsamaroo)
• CompatHelper: add new compat entry for Statistics at version 1, (keep existing compat) (#447) (@github-actions[bot])
• processor_runner: Fix race in collect proc_states (#452) (@jpsamaroo)
• errormonitor_tracked: Use spin lock (#455) (@jpsamaroo)
• OSProc: Add locking around OSPROC_PROCESSOR_CACHE (#456) (@jpsamaroo)

Closed issues:

• Failed to cleanup datastore after 0 seconds Forcibly evicting all entries (#445)
• UNHANDLED TASK ERROR: ArgumentError: destination has fewer elements than required (#449)
• DTables.groupby causes issues when multiple processes available (#450)
• Occasional UndefRefError: access to undefined reference when fetching DTables (#453)

v0.18.4

Dagger v0.18.4

Diff since v0.18.3

Merged pull requests:

• options: Use with over deprecated scoped (#442) (@jpsamaroo)
• Sch: Fix various locking and WeakChunk issues (#443) (@jpsamaroo)

Closed issues:

• "Multiple concurrent writes to Dict detected!" with DTables.reduce (#437)
• scoped deprecated (#441)

v0.18.3

Dagger v0.18.3

Diff since v0.18.2

Merged pull requests:

• Fix broken webpage link in README.md (#424) (@kylebeggs)
• Update path splitting rule in Dagger.File / Dagger.tofile (#425) (@svilupp)
• Fix error in documentation (#427) (@meggart)
• Use ScopedValues instead of ContextVariablesX (#428) (@jpsamaroo)
• build(deps): bump actions/checkout from 3 to 4 (#429) (@dependabot[bot])
• submission: Call init_eager on worker 1 (#432) (@jpsamaroo)
• ThunkFailedException: Scrub out Thunk (#434) (@jpsamaroo)
• submission: Fix variable shadowing bug (#436) (@jpsamaroo)

Closed issues:

• type Nothing has no field thunk_dict with Distributed (#431)
• Cannot serialize a Thunk when processing an error with Distributed (#430)
• KeyError with selecting multiple columns (also with reduce and combine) with Distributed (#435)

v0.18.2

Dagger v0.18.2

Diff since v0.18.1

Merged pull requests:

• Requires-ify UI deps (#417) (@jpsamaroo)
• Update Dagger README.md docs with a use case sceanario (#418) (@pszufe)
• Add File and tofile helpers (#419) (@jpsamaroo)

v0.18.1

Dagger v0.18.1

Diff since v0.18.0

Closed issues:

• Outdated StatsBase version bound (#411)

Merged pull requests:

• Add CompatHelper, UB StatsBase to 0.34 (#412) (@jpsamaroo)
• TEST: Try implementing custom actions (#413) (@jpsamaroo)
• disk_caching: Pass Dagger module in remotecall (#414) (@jpsamaroo)
• build(deps): bump actions/checkout from 2 to 3 (#415) (@dependabot[bot])
• CI: Only check for custom cmds once (#416) (@jpsamaroo)