Evaluation rounds
      Back to home
      1. Evalato Help Docs
      2. Evaluation settings
      3. Evaluation rounds

      Set up an evaluation round

      Evaluation > Rounds

      You can set, edit, and customize every element of the evaluation process for your program. Program applications you receive have to be shortlisted for one or more of the voting rounds.

      You can set up both multiple rounds for the evaluation phases of your program as well as multiple rounds for the same evaluation phase to accommodate various voting methods.

      Adding an evaluation round

      Go to Evaluation > Rounds and press the Add round button to add a new evaluation round. You can customize every aspect of the new round.

      Round name

      Set a name for your round such as Round 1, Phase 1, Group round, Elimination round, etc.

      Accepting votes

      Choose whether your program is currently accepting votes. In addition to the “yes” or “no” options, you can select “set dates” which will open up additional fields where you can set the time period when you will be accepting votes for that exact round.

      • Score voting – best for evaluation phases where you require custom scorecards, each with its own set of criteria, weights, and scale. The scores given by each judge are then averaged and the candidate with the highest average score is considered the winner.

      • Popularity voting – with this option each member of the judging panel is allowed to approve one or more program applications. You can also set how many votes are given to each judge and the winner in a category is the application that gets the most votes.

      • Simple review – as the name suggests, the simple voting option can be used for quickly reviewing applications. Unlike Popularity voting, Simple review gives members of the judging panel the option to give applications a negative vote.

      • Points voting – this is essentially a points distribution evaluation system where each voter is asked to distribute a set number of points among shortlisted applications. Points can be limited per application, category, and round. The applications with the most points are the winners.

      • Positional voting – a rank-based evaluation system where each voter expresses their preferences in rank order. The rank position of each voter preference is allotted a specific fixed weighting. The weighting is based on the Borda count where each application gets a number of points corresponding to the number of candidates ranked lower. Applications receive points based on their rank position and the ones with the most points overall win.

      • Single transferable vote – a rank-based evaluation system where each voter expresses their preferences in rank order. While a vote is initially allocated to the voter’s first preference, it may subsequently be transferred according to alternate preferences if the application is eliminated or has received surplus votes.

      Judge comments

      You can make judge comments:

      • Optional – each judge can provide commentary in addition to their scores, if they wish to do so;

      • Mandatory – each judge is required to provide commentary in addition to their scores;

      • Disabled – judge comments are disabled.

         

      Enable abstain

      Allow judges to decline to vote on one or more applications for this specific evaluation round. When a judge declines to vote on an application, the points for the application are calculated as if the judge does not exist. This option is only available if you choose Score voting.

      Allow voting from applications list

      This option is available if you choose Popularity voting, Simple review, or Points voting. Tick the checkbox if you want to enable your evaluators to vote from the applications list.

      Judges can view other judges scores

      Allow an evaluator to see how other evaluators have voted on the applications in the assigned category.

      Enable score normalization

      With the Score voting type, you also get the option to enable score normalization – a mathematical formula which ensures that every entry is scored based on the same set of standards, regardless of how many judges are evaluating the program submissions.

      Instructions

      Tick the Add voting instructions checkbox to add instructions that apply to this specific voting round and are visible only to the evaluators assigned to it. If you want to add general instructions for your judges or for public voters, you can do that in Website > Judging portal / Public voting portal.