Uses and abuses of statistical significance tests and other statistical resources: a comparative study

摘要

The empirical study we present here deals with a pedagogical issue that has not been thoroughly explored up until now in our field. Previous empirical studies in other sectors have identified the opinions of researchers about this topic, showing that completely unacceptable interpretations have been made of significance tests and other statistical resources. We tried to show the degree to which these errors of interpretation appear in a sample of university professors and researchers. To evaluate the beliefs and opinions of the university professors about certain methodological and statistical questions, we adapted the "Psychometrics Group Instrument" questionnaire by Mittag (1999) and Mittag and Thompson (Educational Researcher 29:14-20, 2000). We specifically wanted to detect opinions about: (1) avoiding inappropriate interpretations, (2) rectifying incorrect uses, (3) creating a debate on possible alternatives, and (4) proposing editorial changes in the publication criteria. In this study, we compare the results we obtained with those obtained by two other equivalent studies (Gordon, Journal of Vocational Educational Research 26:1-18, 2001; Mittag and Thompson, Educational Researcher 29:14-20, 2000). The characteristics of the sample and the scope of the results are described, and a critical reflection is carried out on typical misunderstandings in interpretation that show a worrisome lack of understanding of some basic methodological and statistical concepts.