10000 JP-2623: Multiprocessing failure in ramp fitting. by kmacdonald-stsci · Pull Request #6880 · spacetelescope/jwst · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

JP-2623: Multiprocessing failure in ramp fitting. #6880

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jun 24, 2022

Conversation

kmacdonald-stsci
Copy link
Contributor
@kmacdonald-stsci kmacdonald-stsci commented Jun 10, 2022

Closes #
Resolves JP-2623

Description

The primary cause of the multiprocessing failure was the int_times object, which is an astropy.io object that cannot be properly pickled. Since it is not used in ramp fitting, it is no longer passed to STCAL ramp fitting and is handled entirely in the ramp fitting step code.

Checklist

  • Tests
  • Documentation
  • Change log
  • Milestone
  • Label(s)

Copy link
Collaborator
@hbushouse hbushouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Just needs a change log entry.

@hbushouse
Copy link
Collaborator

Looks good now. Obviously need to wait to merge until the supporting changes in stcal have been merged and released.

Copy link
Contributor
@dmggh dmggh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The latest updates look good to me; a couple minor comments on the existing function docs in ramp_fit_step.py :

  • Lines 78, 113 and 148 of ramp_fit_step.py should be "Returns"

  • int_times in 'def create_integration_model( ... ) ' should be included in the epydocs

@karllark
Copy link
Collaborator

I have used this branch and the accompanying stcal branch to process quite a large amount of MIRI imaging observations with success. I have seen no differences in the resulting rate images.

@hbushouse hbushouse merged commit 09ce441 into spacetelescope:master Jun 24, 2022
@kmacdonald-stsci kmacdonald-stsci deleted the jp_2623 branch November 10, 2022 05:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants
0