Evaluation rounds explained

Evaluation > Rounds

The voting rounds are a flexible tool that allows you to have different ways of approving and/or evaluating the applications you receive for your program.

You can create multiple rounds for a single evaluation phase if you require various voting methods to be used for the different categories.

With the voting rounds created, you simply need to approve and shortlist each application to the corresponding voting round.

Choose whether applications shortlisted in this round will be evaluated by a panel of judges you invite for the program or by public voting.

Voting round types

  • Score voting — best for evaluation phases where you require custom scorecards, each with its own set of criteria, weights, and scale. The scores given by each judge are then averaged and the candidate with the highest average score is considered the winner.

  • Popularity voting — with this option each member of the judging panel is allowed to approve one or more program applications. You can also set how many votes are given to each judge and the winner in a category is the application that gets the most votes.

  • Simple review — as the name suggests, the simple voting option can be used for quickly reviewing applications. Unlike Popularity voting, Simple review gives members of the judging panel the option to give applications a negative vote.

  • Points voting — this is essentially a points distribution evaluation system where each voter is asked to distribute a set number of points among shortlisted applications. Points can be limited per application, category, and round. The applications with the most points are the winners.

  • Positional voting — a rank-based evaluation system where each voter expresses their preferences in rank order. The rank position of each voter preference is allotted a specific fixed weighting. The weighting is based on the Borda count where each application gets a number of points corresponding to the number of candidates ranked lower. Applications receive points based on their rank position and the ones with the most points overall win.

  • Single transferable vote — a rank-based evaluation system where each voter expresses their preferences in rank order. While a vote is initially allocated to the voter’s first preference, it may subsequently be transferred according to alternate preferences if the application is eliminated or has received surplus votes.

Some quick examples

Example A: Create an evaluation process of two stages — Round 1 with the Simple review option as an initial approval stage, and Round 2 as the more detailed evaluation stage which uses the Score voting method. When applications for your program start coming in, you shortlist them for Round 1 where they can be reviewed and either approved or rejected. Then, depending on the results, you can move the approved ones to the next stage by shortlisting them for Round 2 of the evaluation process.

Example B: Create multiple Round 1 voting rounds for a single evaluation stage, where each different round is for a different application category. Let’s say you have a Round 1 Images (for an imaginary images category) and a Round 1 Videos (for the videos category). You then shortlist the program applications to their respective rounds — submissions of images will be shortlisted for Round 1 Images, while videos will be shortlisted for Round 1 Videos.