An approach to judging contests, competitions, and events in which aspects of crowdsourcing are applied to the judging, so that skill and/or talent and/or merit will predominate the voting outcomes rather than chance when using non-expert demographically diverse voters as judges. A contest, competition, or event judging method includes: accepting applications from potential web based non-expert judges (WebNEV) by establishing the unique identity thereof to yield a population of potential WebNEVs; assessing attributes of each potential WebNEV; collecting and analyzing information about the reasons each potential WebNEV wants to judge the contest, competition, or event; and selecting and registering WebNEVs from the population of potential WebNEVs, the selected WebNEVs being those that as a group which maximizes demographic diversity while balancing bias in accordance with the contest's, competition's, or event's rubric.
展开▼