Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rmspe test stat #22

Merged

Conversation

semihakbayrak
Copy link
Contributor

@semihakbayrak semihakbayrak commented Sep 24, 2024

Checklist

  • I've formatted the new code by running hatch run dev:format before committing.
  • I've added tests for new code.
  • I've added docstrings for the new code.

Description

  • RMSPE test implemented.

Issue Number: #16

Copy link
Contributor

@thomaspinder thomaspinder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work 👏 minor comments.

@@ -79,21 +77,6 @@ def to_df(self) -> pd.DataFrame:
PlaceboSchema.validate(df)
return df

def summary(self, precision: int = 4) -> Table:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

placeholder: I assume this method is migrated elsewhere

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, a new parent class TestResultFrame is created and it owns the summary method. PlaceboTestResult and RMSPETestResult both utilize this method as subclasses.

@thomaspinder thomaspinder merged commit 9b7b5aa into amazon-science:rmspe-test-stat Sep 24, 2024
6 checks passed
thomaspinder added a commit that referenced this pull request Sep 24, 2024
thomaspinder added a commit that referenced this pull request Sep 24, 2024
* RMSPE WIP

* Rmspe test stat (#22)

* Minor change in README to fix guidance for developers (#18)

* Noise transform (#19)

* Add noise transformation that apply perturbations on treatment

* Formatting

* Add docstring

* Fix linting

* Add tests to check perturbation impact and randomness over timepoints

* bump version (#20)

* Initial implementation of RMSPE

* Add TestResultFrame parent class for test results

* Add test for RMSPE

* Add doc string

* Fix linting

* Update src/causal_validation/validation/rmspe.py

Co-authored-by: Thomas Pinder <[email protected]>

* Fix typo

---------

Co-authored-by: Thomas Pinder <[email protected]>

---------

Co-authored-by: Thomas Pinder <[email protected]>
Co-authored-by: Semih Akbayrak <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants