You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file/subtest/other)
I noticed weighting for this directory was giving 33% weight to 2% of the subtests. In this particular case, the test files were broken up arbitrarily for authoring convenience, so weighting evenly per subtest failure would be a better choice.
However, that's not always the case in other directories... /encoding tests for example would count for ~60% of the WPT score if all subtests were weighted evenly. So that wouldn't be the best solution either.
Perhaps in wpt-metadata, a top-level directory or subdirectory could hint which choice [ file | subtest | other? ] would be a better selection for scoring Inerop and other WPT CI results.
The text was updated successfully, but these errors were encountered:
Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file/subtest/other)
I noticed weighting for this directory was giving 33% weight to 2% of the subtests. In this particular case, the test files were broken up arbitrarily for authoring convenience, so weighting evenly per subtest failure would be a better choice.
However, that's not always the case in other directories...
/encoding
tests for example would count for ~60% of the WPT score if all subtests were weighted evenly. So that wouldn't be the best solution either.Perhaps in
wpt-metadata
, a top-level directory or subdirectory could hint which choice [ file | subtest | other? ] would be a better selection for scoring Inerop and other WPT CI results.The text was updated successfully, but these errors were encountered: