Best (and Worst) Practices for Organizing a Challenge on Cardiac Biophysical Models During AI Summer: The CRT-EPiggyl9 Challenge

摘要

During the last years tens of challenges have been organized to benchmark computational techniques with shared data. Historically, most challenges in conferences such as MICCAI have been devoted to medical image processing, especially on object recognition or segmentation tasks. Due to the increasing popularity and easy access to machine (deep) learning methods, as part of our current Artificial Intellingence (AI) summer, the number of Al-related challenges has exploded. In parallel, the community of biophysical models also has a valuable history of organizing challenges, including synthetic and experimental data, to assess the accuracy of the resulting simulations. In this paper, the similarities and differences in computational challenges organized by these communities are reviewed, suggesting best practices and what to avoid when organizing a challenge on biophysical models. Specifically, details will be given about the preparation of the CRT-EPiggy 19 challenge.