I am a judge and some things are difficult to control. Some judges, just like regular people, like what they like and do not like what they don't like. Here is my rib taste score from last weekend: 899949, Really? Texture: 997959, appearance was pretty even though. Looks like Judge #5 was in a hateful mood, or was judge #6 in disguise.
I do like to idea of calibrating the judging, if for no other reason than letting the outliers know they are off the norm.