Code

Spawn many small reprojection tasks#41

Code

Draft

drewoldag wants to merge 12 commits intomaindirac-institute/kbmod-wf:mainfrom issue/40/smaller-reproj-tasksdirac-institute/kbmod-wf:issue/40/smaller-reproj-tasksCopy head branch name to clipboard

+650-13

Commits

Commits on Sep 3, 2024

• Initial commit to parallelize the reprojection step across many small workers.

  drewoldag

  committed
  b06b059

  Copy full SHA for b06b059

Commits on Sep 5, 2024

• Adding a temporary testing workflow to prove out that the approach to Futures works correctly.

  drewoldag

  committed
  47f1aaf

  Copy full SHA for 47f1aaf

• WIP - Expect several bugs, but need to test on Klone now.

  drewoldag

  committed
  fb2b9a4

  Copy full SHA for fb2b9a4

• Updates to workflow to support older version of parsl.

  drewoldag

  committed
  5a40a35

  Copy full SHA for 5a40a35

• Fixes to get workflow running on Klone.

  drewoldag

  committed
  f8f2b5f

  Copy full SHA for f8f2b5f

• Add relax=True

  drewoldag

  committed
  5084621

  Copy full SHA for 5084621

• Fix variable name typo.

  drewoldag

  committed
  bed7b54

  Copy full SHA for bed7b54

Commits on Sep 6, 2024

• Fix keyword typo.

  drewoldag

  committed
  d703dff

  Copy full SHA for d703dff

• Merge branch 'issue/40/smaller-reproj-tasks' of https://github.com/dirac-institute/kbmod-wf into issue/40/smaller-reproj-tasks

  drewoldag

  committed
  8df4964

  Copy full SHA for 8df4964

• Fix another keyword typo.

  drewoldag

  committed
  e73e755

  Copy full SHA for e73e755

• Include more parameters to align with what kbmod reproject.py is doing.

  drewoldag

  committed
  9b16a9a

  Copy full SHA for 9b16a9a

Commits on Sep 10, 2024

• Copying the WCS header info to the other layers in the fits shard.

  drewoldag

  committed
  c9efb14

  Copy full SHA for c9efb14