Round your numbers in rank tests: exact and asymptotic inference and ties

摘要

Non-parametric statistical tests are commonly used in the behavioral sciences. Researchers need to be aware that non-parameteric methods involving ranks can perform unreliably as a result of very small amounts of noise added in the storage and manipulation of values by computers, causing spurious reduction in the number of ties. In order to avoid this problem, researchers should round values to an appropriate number of decimal places prior to the ranking procedure to ensure that data points whose values cannot be separated according to the precision of their measurement are recorded as having identical rank. We also recommend exact rather than asymptotic evaluation of p values in non-parametric statistical tests.