Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add fairness metrics #434

Merged
merged 34 commits into from
Oct 27, 2023
Merged

add fairness metrics #434

merged 34 commits into from
Oct 27, 2023

Commits on May 15, 2023

  1. rename metrics.R -> aaa-metrics.R

    The forthcoming metrics execute these functions via their constructor and thus introduce errors at `load_all()`. We could also instead rename the fairness files to be run last, e.g. `zzz-fair.R`.
    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    b98b2ac View commit details
    Browse the repository at this point in the history
  2. implement metric constructor

    This doesn't actually function independently as a commit, as I've linked out to the metrics made with this function in docs, but is otherwise able to stand on its own.
    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    92c232d View commit details
    Browse the repository at this point in the history
  3. implement 3 canonical fairness metrics

    `demographic_parity()`, `equalized_odds()`, and `equal_opportunity()` are all special cases of `fairness_metrics()`.
    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    44ef50b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c260656 View commit details
    Browse the repository at this point in the history
  5. add NEWS entry

    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    31e4a5f View commit details
    Browse the repository at this point in the history
  6. add pkgdown entry

    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    5922ae2 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    7236a14 View commit details
    Browse the repository at this point in the history
  8. remove unused test object

    simonpcouch committed May 15, 2023
    Configuration menu
    Copy the full SHA
    60973ba View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Configuration menu
    Copy the full SHA
    6998108 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a9fc2e0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    27f53e9 View commit details
    Browse the repository at this point in the history
  4. remove incomplete phrase

    simonpcouch committed May 16, 2023
    Configuration menu
    Copy the full SHA
    7fe7fb8 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    bdb7c5a View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    ca6d7b8 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. Configuration menu
    Copy the full SHA
    f1d663f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    45f57ff View commit details
    Browse the repository at this point in the history
  3. run test on all systems

    simonpcouch committed May 18, 2023
    Configuration menu
    Copy the full SHA
    43037d9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ef7f5a1 View commit details
    Browse the repository at this point in the history
  5. update snaps

    simonpcouch committed May 18, 2023
    Configuration menu
    Copy the full SHA
    556f2c5 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    6fad6a4 View commit details
    Browse the repository at this point in the history
  7. check direction argument

    simonpcouch committed May 18, 2023
    Configuration menu
    Copy the full SHA
    a9231a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. Configuration menu
    Copy the full SHA
    82717fa View commit details
    Browse the repository at this point in the history
  2. document implementation in @description

    now refers to the yardstick functions and `.post` values in docs.
    
    also, moves `max_positive_rate_diff()` to the top of the file so that `fairness_metric()` doesn't error out on load.
    simonpcouch committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    a2dfe36 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    375269b View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. special-case metric factories in metric_set() checks

    gives `fairness_metric()` output an additional `metric_factory` class
    simonpcouch committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    76f2d4f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    587ff32 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    05086ea View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Configuration menu
    Copy the full SHA
    25a893f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4436785 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. use devl probably

    EmilHvitfeldt committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    12ff56a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    251f45b View commit details
    Browse the repository at this point in the history
  3. aggregrate -> aggregate

    simonpcouch committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    6c0b76f View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. Configuration menu
    Copy the full SHA
    219562c View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Configuration menu
    Copy the full SHA
    690e738 View commit details
    Browse the repository at this point in the history