-
Notifications
You must be signed in to change notification settings - Fork 174
JP-3727: changed psfalign product from quadmodel to cubemodel #8747
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #8747 +/- ##
==========================================
+ Coverage 60.59% 60.63% +0.04%
==========================================
Files 372 372
Lines 38401 38372 -29
==========================================
- Hits 23269 23267 -2
+ Misses 15132 15105 -27 ☔ View full report in Codecov by Sentry. |
Regression tests are all accounted for: 18 of the 22 failures match the ones on the nightly runs here. The other four (two each for NIRCam and MIRI) are all directly testing the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks great! Thanks for the analysis and for putting it together.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, pending concurrence from any of the INS coronography folks.
I am going to defer or hand off doing a review for this one, as I'm not an INS coronagraphy folks anymore. I would suggest that instead @aggle should review and concur for MIRI, and @juliengirard for NIRCam. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me - the psf-subtracted images from the PID-1386 test case look reasonable as well.
Looks good to me as well! |
Okay, sounds like we have agreement. I'll go ahead and merge. Thanks all! |
Resolves JP-3727
Closes #8746
A previous pull request implemented a change that simplified the pipeline's coronagraphic data processing such that the alignment of the PSF to the science data is only done on the first science integration, then assumed to be the same for all subsequent integrations. Prior to this change, the shifted PSF was stored in a 4-dimensional data structure (QuadModel of shape n_sci_integrations, n_psf_integrations, n_rows, n_cols), which made sense when the shift was different on each science integration. Now, though, this model is identical over the zeroth axis and therefore redundant with itself. Furthermore, this model uses a lot of memory (see JP-3724), and is likely a (the?) cause of the out-of-memory failures reported on multiple datasets in JWSTDMS-921 (see comments on that ticket for additional datasets). This PR stores the shifted PSF as a CubeModel instead.
Checklist for PR authors (skip items if you don't have permissions or they are not applicable)
CHANGES.rst
within the relevant release sectionHow to run regression tests on a PR