8000 JP-2645 - Snowball and Shower flagging in Jump by mwregan2 · Pull Request #7039 · spacetelescope/jwst · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

JP-2645 - Snowball and Shower flagging in Jump #7039

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Oct 7, 2022

Conversation

mwregan2
Copy link
Contributor
@mwregan2 mwregan2 commented Sep 11, 2022

Resolves JP-2645

Add parameters to allow flagging of snowballs and showers. Corresponding PR in stcal is spacetelescope/stcal#118

Checklist for maintainers

  • added entry in CHANGES.rst within the relevant release section
  • updated or added relevant tests
  • updated relevant documentation
  • added relevant milestone
  • added relevant label(s)
  • ran regression tests, post a link to the Jenkins job below.
    How to run regression tests on a PR
  • Make sure the JIRA ticket is resolved properly

@mwregan2
Copy link
Contributor Author

I can't figure out why the unit tests are failing. They work for me. The assert error is saying something about file (s) not being closed. It is referring to the gain and read noise files.

Copy link
Collaborator
@hbushouse hbushouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. Just minor comments about wording and typos.

8000
@cshanahan1
Copy link
Collaborator

I see that you added some tests in stcal for some of the functions you added there, but I think it would be good to have a few tests in JWST as well for the full step using these new options

@cshanahan1
Copy link
Collaborator

@mwregan2 (summarizing some of our call earlier)

i added a test to demonstrate the use of the sat_required_snowball flag, and it doesn't seem to be working (maybe an error on my end?). what i did was add in circles of pixels in the 1st (not 0th) read of the input data. inside those circles, and in every read after, there is a smaller circle of saturation flags in the core in the dq array in the input model. from what i understand of the code, what should be happening here is that the clusters of jump flags should be flagged as snowballs only if they also have saturated pixels in a circular shape within the boundaries, which they do in this case, so the jump flags should be expanded. it doesn't detect the snowballs in that read and therefore does not expand the radius of the jump dq flags as expected. additionally, it does detect a 'snowball' in the last read (where there is none). while i don't totally understand what is going on, and again it might just be an error on my end, i think it might have something to do with the calculation of the new_flagged_pixels array on line 349 in stcal.

for now i have commented this test out

@codecov
Copy link
codecov bot commented Oct 6, 2022

Codecov Report

Base: 79.51% // Head: 79.66% // Increases project coverage by +0.14% 🎉

Coverage data is based on head (25f2950) compared to base (966f05d).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7039      +/-   ##
==========================================
+ Coverage   79.51%   79.66%   +0.14%     
==========================================
  Files         412      412              
  Lines       37322    37356      +34     
==========================================
+ Hits        29678    29758      +80     
+ Misses       7644     7598      -46     
Flag Coverage Δ *Carryforward flag
nightly 79.71% <100.00%> (+0.21%) ⬆️ Carriedforward from 8473256
unit 51.99% <100.00%> (+<0.01%) ⬆️

*This pull request uses carry forward flags. Click here to find out more.

Impacted Files Coverage Δ
jw 8000 st/jump/jump.py 100.00% <100.00%> (ø)
jwst/jump/jump_step.py 100.00% <100.00%> (ø)
jwst/regtest/regtestdata.py 86.23% <0.00%> (+1.37%) ⬆️
jwst/regtest/conftest.py 88.04% <0.00%> (+23.36%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@cshanahan1 cshanahan1 force-pushed the snowball_shower branch 2 times, most recently from 66c226c to 7176b5a Compare October 6, 2022 20:52
@hbushouse hbushouse added this to the Build 9.0 milestone Oct 7, 2022
@hbushouse
Copy link
Collaborator

I'm assuming that there's no real benefit in running a regtest against the PR branch, because the new stuff is turned off by default, hence we don't expect the new code to get exercised at all. Given that, I'm thinking we're ready to merge. Any objections?

@mwregan2
Copy link
Contributor Author
mwregan2 commented Oct 7, 2022

Yes, this will be transparent until we add the parameter reference files.

@hbushouse hbushouse merged commit 0090919 into spacetelescope:master Oct 7, 2022
@hbushouse
Copy link
Collaborator

Full regression test run on the master branch after merging this PR was clean, as expected (no changes).

@mwregan2
Copy link
Contributor Author
mwregan2 commented Oct 11, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants
0