Quanty: An online game for eliciting the wisdom of the crowd

摘要

Quanty is an online game that anonymously pairs players to estimate distances, weights, sizes, frequencies and such from photographs. The degree to which players agree determines the number of points they receive. We hypothesized that this game would generate more accurate aggregated estimates than would singular estimates by exploiting the wisdom of the crowd. Ninety-six participants (50 in group 1 using the metric system, and 46 in group 2 using the non-metric system) estimated height, weight, and distance of various objects; aggregated estimates of each group were more likely to approach accurate answers than were individual estimates, especially when the aggregates were calculated using medians and median absolute deviations. Also, the majority of participants thought that the game was as fun as the popular game Tetris. The results suggest that Quanty can be used to improve the judgment accuracy of professionals. (C) 2015 Elsevier Ltd. All rights reserved.