Exploratory and confirmatory research in the open science era

摘要

1. Applied ecological research is increasingly inspired by the open science movement. However, new challenges about how we define our science when biodiversity data are being shared and re-used are not solved. Among these challenges is the risk associated with blurring the distinction between research that mainly seeks to explore patterns with no a-priori articulated hypotheses (exploratory research), and research that explicitly tests a-priori formulated hypotheses (confirmatory research). 2. A rapid screening of a random selection of the peer-reviewed literature suggests that neither experimental protocols nor hypothesis-testing sensu stricto are common in applied ecological research. In addition, most experiments are carried out on small spatial scales, which contrast with current global policy needs and research trends towards addressing large spatial and temporal scales. This latter trend makes it unfeasible for policy to rely mainly on insights gained from experimental research. 3. To solve fundamental local, regional and global societal challenges, we need both exploratory and confirmatory research. However, the fundamental roles that confirmatory research testing a-priori hypothesis play in establishing causal relationships need to be revaluated in applied ecological research. 4. A clearer distinction between exploratory and confirmatory research is currently needed, and could be facilitated by allocating journal sections to different types of research; by embracing new tools offered by the open science era, such as pre-registration of hypothesis; by establishing new systems where post-hoc hypotheses emerging through exploration can also be registered for later testing; and by more broad adoption of causal inference methods that foster more structured testing of hypotheses about causal mechanisms from observational biodiversity data. 5. Synthesis and applications. To gain the full benefits of the open science era, researchers, funding bodies and journal edit