Skip to content

Integrate Keck DRP framework with Prefect based DRP flow#2

Merged
mikelangmayr merged 5 commits intomainfrom
mike/keck-framework
Sep 22, 2025
Merged

Integrate Keck DRP framework with Prefect based DRP flow#2
mikelangmayr merged 5 commits intomainfrom
mike/keck-framework

Conversation

@mikelangmayr
Copy link
Contributor

@mikelangmayr mikelangmayr commented Aug 7, 2025

  • integrate Keck DRP framework primitives into the existing pipeline
  • wrap Keck functions (NormalizeFlat, TraceSlits1D) as Prefect tasks
  • update batch flow to use wrapped primitives in Prefect
  • organize code into clear structure
  • verify end-to-end flow from flat input to corrected FITS and QA outputs

Updated Architecture overview

  • Normalized flat frames

  • Flat-field correction images

  • Slit trace solutions

  • Quality assurance (QA) plots

                     ┌────────────────────────┐
                     │   Raw FITS Flat Files  │
                     └────────────┬───────────┘
                                  │
                                  ▼
                  ┌────────────────────────────┐
                  │  Core DRP Logic (lris2_drp) │
                  │  e.g. flat.py, tracing.py   │
                  └────────────┬───────────────┘
                               │
                               ▼
              ┌────────────────────────────────────┐
              │  Keck DRP Primitives (keck_funcs)   │
              │  - NormalizeFlat                    │
              │  - TraceSlits1D                     │
              └────────────┬───────────────────────┘
                           │
                           ▼
          ┌──────────────────────────────────────┐
          │  Prefect Task Wrappers (prefect_tasks)│
          │  - normalize_flat_task                │
          │  - trace_slits_task                   │
          │  - load/save FITS, QA plot            │
          └────────────┬──────────────────────────┘
                       │
                       ▼
         ┌────────────────────────────────────┐
         │  Prefect Flow (flows/batch_flat_flow.py) │
         │  - Runs all tasks as a pipeline     │
         └────────────┬───────────────────────┘
                      │
                      ▼
          ┌──────────────────────────────────┐
          │   Output Directory Structure      │
          │   - Corrected FITS                │
          │   - Slit Trace Text               │
          │   - QA PNG                        │
          └──────────────────────────────────┘
    

@mikelangmayr mikelangmayr merged commit 14d3827 into main Sep 22, 2025
2 checks passed
@mikelangmayr mikelangmayr deleted the mike/keck-framework branch September 22, 2025 20:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant