Judge infit is a statistic is an indication of the degree of consistency or inconsistency of this expert's decisions compared to those of the other experts.

A low infit score indicates better consistency, a higher infit score indicates worse consistency.

An infit value much greater than two standard deviations above the mean of the infit statistics indicates some significant inconsistency on the part of the expert, and it might be worthwhile contacting the expert to check that they fully understand the judging process, and are taking it seriously.

For more on judge infit see Pollitt (2012).

We can use the following function in R to calculate judge infit statistics after we have exported the decision data, using R code available on GitHub.