Let me give an example of why I think tracking is good...
We all know there are judges who scores entries consistently lower than every other judge at his/her table at every contest. Tracking will allow the organization to clearly identify this type of problem and do something about it. Retraining comes to mind as a possible corrective measure but there are certainly other steps. And, since judges can be tracked, those who have been identified as being well outside the norm, have been retrained, etc., their performance after corrective steps can also be tracked to see if the retraining, etc., made any difference. If not, well, now there are clear and well defined reasons for saying "Adios, Judge #6!".
Any tool, if used improperly, can result in abuse. That, however, should not prevent us from using tools at all.