8000 Upload spectrum data support by pro100watt · Pull Request #207 · vikinganalytics/mvg · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Upload spectrum data support #207

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 4, 2023
Merged

Upload spectrum data support #207

merged 10 commits into from
Apr 4, 2023

Conversation

pro100watt
Copy link
Contributor
@pro100watt pro100watt commented Mar 29, 2023

Description

Added create_spectrum_source and create_spectrum_measurement methods to MVGAPI.

New dependencies:
requirements.txt: pydantic

Fixes #206

Type of Change

  • Bug fix (non-breaking change which fixes an issue -> bump patch)
  • New feature (non-breaking change which adds functionality -> bump minor version)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected -> bump major version)
  • Documentation Update
  • CI/CD workflows Update

Checklist

  • I have added tests that prove that my fix/feature works
  • Linters pass locally and I have followed PEP8 code style
  • New and existing tests pass locally
  • I have updated the documentation if needed
  • I have commented hard-to-understand areas in the code

Requirements

  • I have updated the MVG version

@codecov
Copy link
codecov bot commented Mar 29, 2023

Codecov Report

Patch coverage: 89.65% and project coverage change: +0.55 🎉

Comparison is base (252819d) 73.11% compared to head (439d03d) 73.67%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #207      +/-   ##
==========================================
+ Coverage   73.11%   73.67%   +0.55%     
==========================================
  Files          12       12              
  Lines         915      942      +27     
==========================================
+ Hits          669      694      +25     
- Misses        246      248       +2     
Impacted Files Coverage Δ
mvg/plotting.py 31.39% <0.00%> (ø)
mvg/mvg.py 90.00% <92.30%> (+0.15%) ⬆️
mvg/utils/response_processing.py 77.27% <100.00%> (+1.08%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@pro100watt pro100watt marked this pull request as ready for review March 29, 2023 18:29
@pro100watt pro100watt requested review from vnadhan, tuix and claezon March 30, 2023 08:10
Copy link
Contributor
@vnadhan vnadhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pro100watt Thanks for the working on this feature in a rapid manner. Good work on maintaining consistency in the file mvg.py. More attention could be given to the proper naming of stub data in the test suite. You can look at the conftest in vibium-pipeline / vibium-cloud to look at the naming of the fixtures (that create sources and measurements) and the output of those fixtures.

It is good for you to know we want to move away from hard coded data that is used widely in MVG and we will instead generate and use random data for the measurements.

@pro100watt pro100watt requested a review from vnadhan April 3, 2023 18:16
Comment on lines +529 to +533
Although it is up to the client side to handle the
scaling of data it is recommended that the values
represent the acceleration in g.
The timestamp shall represent the time when the measurement was
recorded.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tuix Could you review this description? This is a copy of the description for create_measurement. For spectrum measurement, do we need to provide this recommendation that the spectrum data could be in units of
acceleration?

pro100watt and others added 3 commits April 4, 2023 10:40
- Improve fixture that creates spectrum sources
- Use simulated spectrum measurements
- Name of a test case should start with the name of the tested method
@vnadhan vnadhan force-pushed the romar/create_spectrum branch 2 times, most recently from 6df1833 to e63decd Compare April 4, 2023 15:09
@vnadhan vnadhan force-pushed the romar/create_spectrum branch from 602e898 to e405d19 Compare April 4, 2023 15:23
vnadhan added 2 commits April 4, 2023 17:34
... by asking pydantic to import the binary file of pydantic to be be able to get all the modules present in pydantic package
Copy link
Contributor
@vnadhan vnadhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pro100watt Raman, thanks again for working on this issue. I have refactored your code in the test suite to make it more aligned with what we have developed so far in other vibium products.

I identified that a deprecated attribute of one of the methods from pandas was used in plotting.py that led to the failure in one of the notebooks.

I noticed that you had added a disabler for a pylint instruction no-name-in-module and this was due to the pydantic package. I removed the disabler and instead added the extension-pkg-whitelist to allow pylint to work with pydantic modules.

I will approve this PR and if you have comments on my commits, please let me know.

@pro100watt pro100watt merged commit 9856de0 into master Apr 4, 2023
@vnadhan vnadhan deleted the romar/create_spectrum branch April 5, 2023 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for uploading spectrum data
2 participants
0