MESS v1.0.9

• Added number of tests to MESS plot

MESS v1.0.8

• Updated automated number of significance tests to find empty bin > median MESS score

MESS v1.0.7

• Limit the number of significance tests performed to increase statistical power
  • Previously, MESS would perform all n choose 2 possible significance tests, which would dramatically reduce statistical power after multiple hypothesis test correction
  • This is not ideal, as only the right tail of the distribution is of interest
  • Now, MESS will detect the number of significance tests k to perform, or the user can provide a specific value for k, and MESS will only perform significance tests on the k largest MESS scores

MESS v1.0.6

• Added red, yellow, and green counts for each pair of students
  • Red = Both students put the same wrong answer
  • Yellow = Both students got it wrong, but put different wrong answers
  • Green = Only 1 student got it wrong

MESS v1.0.5

• Use kde.logpdf(X) instead of log(kde.pdf(X)) to avoid rounding down to 0
• Improved flexibility for multiple correct/incorrect responses

MESS v1.0.4

• Plot KDE above optional histogram

MESS v1.0.3

• Added ability to optionally plot a histogram as well

MESS v1.0.2

• Added "proportion identical" column to output TSV
• Refactored how Benjamini-Hochberg correction is performed to be safer with respect to floats

MESS v1.0.1

• Refactored argument parsing code into its own function

MESS v1.0.0

• Initial release