Skip to content
GitLab
  • Menu
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • sac2c sac2c
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 393
    • Issues 393
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 15
    • Merge requests 15
  • Deployments
    • Deployments
    • Releases
  • Wiki
    • Wiki
  • External wiki
    • External wiki
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • sac-group
  • sac2csac2c
  • Merge requests
  • !408

Add option for minimum size to distribute over nodes

  • Review changes

  • Download
  • Email patches
  • Plain diff
Open Thomas Koopman requested to merge thomas/sac2c:distmem-min-size into develop May 26, 2025
  • Overview 8
  • Commits 7
  • Changes 12

Currently in the distributed memory backend, a with-loop is either parallelised over all nodes in the cluster, or not at all. This merge requests makes this more fine grained to not parallelise, parallelise only within a node, or parallelise both within nodes and across nodes, for genarray and modarray. We do this by adding an option -mindistsize that can be used in conjunction with -minmtsize.

We do not do this for fold because distribution over node is treated as a property of the memory, not parallel execution. This makes it a pain in the ass to implement it for fold also. As this is not performance critical in any application I can think of, I am not going to implement this.

Edited May 28, 2025 by Thomas Koopman
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: distmem-min-size