The BBQ BRETHREN FORUMS.


Forum Portal Recipes Smoke Signals Magazine Welocme Merchandise Associations Purchase Subscription Brethren Banners
Go Back   The BBQ BRETHREN FORUMS. > Discussion Area > Competition BBQ

Notices

Competition BBQ *On Topic Only* Discussion regarding all aspects of Competition BBQ. Experiences competing or visiting, questions, getting started, Equipment, announcements of events, Results, Reviews, Planning, etc. Questions here will be responded to with competition BBQ in mind.


Reply
Thread Tools
Unread 09-07-2012, 06:30 PM   #61
stl-rich
Full Fledged Farker

 
stl-rich's Avatar
 
Join Date: 07-10-10
Location: saint louis, MO
Downloads: 0
Uploads: 0
Default

At well run comps judges are not allowed to just sit as they please - good reps try to balance the master judges, the experienced, the semi-experienced and the noobs.

Good reps do a good job
stl-rich is offline   Reply With Quote


Thanks from: --->
Unread 09-07-2012, 08:54 PM   #62
Grizmt
Got Wood.
 
Join Date: 12-16-10
Location: Phoenix,az
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by stl-rich View Post
At well run comps judges are not allowed to just sit as they please - good reps try to balance the master judges, the experienced, the semi-experienced and the noobs.

Good reps do a good job
That's been my experience at almost every comp I've been at. Hey, that's it! Take the judges newly discerned rankings and mix 'em up at each table, tough,easy and undecided.
Grizmt is offline   Reply With Quote


Unread 09-07-2012, 09:47 PM   #63
Funtimebbq
Full Fledged Farker
 
Join Date: 11-19-09
Location: Whittier, CA
Downloads: 0
Uploads: 0
Default

That was suggested many pages ago but will only work after judges have had several contests for the system to calculate their scoring pattern. Unfortunately, by the time that happens, all judges will be scoring so high, it will not matter. Once judges see themselves being sent to re-education camps, those who are on the bubble will get the message and start scoring higher, defeating the system.
Funtimebbq is offline   Reply With Quote


Unread 09-08-2012, 03:16 PM   #64
smoke-n-my-i's
is One Chatty Farker
 
smoke-n-my-i's's Avatar
 
Join Date: 08-27-07
Location: Hillsborough, NC
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Jorge View Post
I think his point was that many teams seem to have bought into that theory, not that it was accurate.
Quote:
Originally Posted by pahutchens View Post
Yeah that's what I thought I said too
sorry abt that one... I totally read it too fast and missed the point.... I seem to do that some times, and regret it later....
__________________
KCBS Member
Smoke-N-My-I's Competition BBQ Team
2 Chargriller SuperPros with SFB's(retired)
2 UGLY drum smokers
Weber 22 1/2" & 18 1/2" Kettle
Super fast RED Thermapen
Screaming fast ORANGE Thermapen
KCBS Certified Table Captain
KCBS Certified Judge
smoke-n-my-i's is offline   Reply With Quote


Thanks from:--->
Unread 09-08-2012, 09:57 PM   #65
CBQ
is One Chatty Farker

 
CBQ's Avatar
 
Join Date: 01-11-09
Location: Cumberland, RI
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Carnivorous Endeavors BBQ View Post
I wonder how this would work out if all certified judges scores were kept and averaged over a period of time or several contests. Judges could then be assigned to tables so that all tables have near the same cumulative average for scoring. If all tables had a close to the same average in scoring, it would seemingly(on the surface) start a contest with a more level playing field. This way you shouldn't get 1 table who likes to score all 9's for practically everything. Just a thought....
That might be an interesting idea. Talking to reps, they sometimes KNOW there are certain judges that always score low or score high. Some reps have told me they dread certain judges showing up at a contest because they know a lot of 5s and 6s are going to be handed out for some good bbq. The reps, however, don't have any power to DO anything about that. The above suggestion might have to mitigate some of the risk - but I wouldn't try to group like judges together.

Winning the table...when it's a low scoring table...doesn't help you. Spreading out low scoring judges evenly across all the tables would be more fair to the teams.
__________________
Chris
ZBQ Competition BBQ Team, Rhode Island
"The Most Dangerous Team in BBQ" - Jon Vallone
www.teamzbq.com

KCBS, KCBS CBJ, NEBS
CBQ is offline   Reply With Quote


Unread 09-09-2012, 09:33 AM   #66
Grizmt
Got Wood.
 
Join Date: 12-16-10
Location: Phoenix,az
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by CBQ View Post
That might be an interesting idea. Talking to reps, they sometimes KNOW there are certain judges that always score low or score high. Some reps have told me they dread certain judges showing up at a contest because they know a lot of 5s and 6s are going to be handed out for some good bbq. The reps, however, don't have any power to DO anything about that. The above suggestion might have to mitigate some of the risk - but I wouldn't try to group like judges together.

Winning the table...when it's a low scoring table...doesn't help you. Spreading out low scoring judges evenly across all the tables would be more fair to the teams.
This brings up some food for thought. Why is it that someone scoring 5-6 is considered "low scoring"? Doesn't the rating scale go from 2-9 or has this truly turned into 6-9 scoring? Is there now an attitude like in T-Ball where there's a trophy for just being there?
The reps said "they know a lot of 5-6's are going to be handed out for some good BBQ", in whose opinion (theirs?) and why is their opinion any more valid that the person judging it?
Then you have the question of who's palate is correct, could the people who're "low scoring" actually have a better palate than the "high scoring"?
Would y'all prefer false high scoring? If so then maybe the scoring and judges instructions should be changed to reflect that.

I hope you don't take this as me jumping on you or what you posted, it's not meant that way, I think you bring up some good points for discussion.

I keep hearing how this judge or that judge scored low so the judge "must" be the issue, why isn't the same said for judges that score crazy high when the rest of the table doesn't? I've never,ever seen a judge taken aside for scoring too high, just too low.
A good example of this whole argument is Hells Kitchen. You have all the chefs make a dish and invariably each one thinks it tastes fantastic. When it's tasted by Gordon or a selected group of celebrity chefs they have a way different opinion. Same thing on Chopped,Cupcake wars,wine tasting etc.

Until such a time where an absolute set of iron clad taste criteria can be laid out so every person tastes the same way/thing AND the judges are all instructed the absolute same way then you're going to have personal taste variations/rule interpretations that are not explainable nor changeable.

I guess one thing could be done which is having to pass a palate test before you're allowed to be a judge.
Grizmt is offline   Reply With Quote


Unread 09-09-2012, 12:02 PM   #67
smoke-n-my-i's
is One Chatty Farker
 
smoke-n-my-i's's Avatar
 
Join Date: 08-27-07
Location: Hillsborough, NC
Downloads: 0
Uploads: 0
Default

Here is a section from my TC pamphlet that was given to us at our class. Dated 4-14-2011

And as a cook, I have seen this posted in areas used by judges before, so it is not top secret.

Judges are told the scoring system is from 9 to 2.
9 is excellent
8 very good
7 above average
6 average
5 below average
4 poor
3 bad
2 inedible

So, there seems to be some judges that think that most meat coming across their score sheet is average or below. So, what do they deem would be a 7, 8, or even a 9? That is a good question.

Is the judges given a different scoring sequence in their classes? I would hope not.
__________________
KCBS Member
Smoke-N-My-I's Competition BBQ Team
2 Chargriller SuperPros with SFB's(retired)
2 UGLY drum smokers
Weber 22 1/2" & 18 1/2" Kettle
Super fast RED Thermapen
Screaming fast ORANGE Thermapen
KCBS Certified Table Captain
KCBS Certified Judge
smoke-n-my-i's is offline   Reply With Quote


Unread 09-10-2012, 04:52 AM   #68
New Pal Frank
Full Fledged Farker

 
New Pal Frank's Avatar
 
Join Date: 08-04-10
Location: New Palestine IN
Downloads: 0
Uploads: 0
Default

In the CBJ class my wife and I took 2 1/2 years ago, we were told that (average) 6, was what every backyard cook (meaning home cook) would produce. Not what the average team would produce. Therefore, most of the Q that has come accross my tables in the 25 contests we have judged has been 7 or higher.
Also if i score below a 7, I will give a coment card so the team isn't left scratching their head as I have since we started competing this year.
As a couple of Reps have told us in the judges meeting before hand, ther is NO limit to how many 9's you can give out in a contest. If everything presented to you is top shelf product, it is a 9 and I agree. We are judging on criteria, not comparison.
__________________
Backwoods Competitor, Backwoods Chubby,UDS, Weber OT Gold
KCBS MCBJ
Super Fast Super Accurate Blue Thermapen, Mavrick 732
Husband & Wife Team (so far)

Hug Hogs Competition BBQ Team
New Palestine IN
New Pal Frank is offline   Reply With Quote


Unread 09-10-2012, 02:29 PM   #69
Grizmt
Got Wood.
 
Join Date: 12-16-10
Location: Phoenix,az
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by New Pal Frank View Post
In the CBJ class my wife and I took 2 1/2 years ago, we were told that (average) 6, was what every backyard cook (meaning home cook) would produce. Not what the average team would produce. Therefore, most of the Q that has come accross my tables in the 25 contests we have judged has been 7 or higher.
Also if i score below a 7, I will give a coment card so the team isn't left scratching their head as I have since we started competing this year.
As a couple of Reps have told us in the judges meeting before hand, ther is NO limit to how many 9's you can give out in a contest. If everything presented to you is top shelf product, it is a 9 and I agree. We are judging on criteria, not comparison.
I have been instructed on several occasions that 5 is the average, other times it was said to be 6.
Where I kind of take issue is the idea that just because a "team" cooked it that it would automatically start at any number. It's either good or not according to my palate and is scored that way obviously in degrees dependent on how good or how bad it is. If some meat comes across my plate that tastes real heavy of "jet fuel" or "creosote" (over smoked) then the likelihood of it getting a 6 or 7 out of me is slim to none. With that being said do I still score it a 5 or 6 to not insult someone?
Just to be clear, I don't have any problem handing out 9's to everyone who's food I'm judging IF the product deserves it and conversely, no judge should be discouraged or afraid to hand out 3's if so deserved but unfortunately that's the current culture in some places.
Grizmt is offline   Reply With Quote


Unread 09-16-2012, 01:59 AM   #70
gettinbasted
Full Fledged Farker
 
Join Date: 09-14-12
Location: Saddlebrooke, MO
Downloads: 0
Uploads: 0
Default I loved it

The extra information was very useful. Unfortunately my pork was judged at table 10.... we won the most difficult table at least!

Without the new scoring I might be tinkering with my pork technique, but looking at the extra info I will probably stay the course.
gettinbasted is offline   Reply With Quote


Unread 09-16-2012, 02:28 AM   #71
Ringburner
Full Fledged Farker
 
Ringburner's Avatar
 
Join Date: 05-26-12
Location: Auckland, NEW ZEALAND
Downloads: 0
Uploads: 0
Default

Sounds like judging is almost as complex as cooking!

Sent from my GT-I9100 using Tapatalk 2
__________________
Really?
Ringburner is offline   Reply With Quote


Unread 09-16-2012, 08:29 AM   #72
THE Meatman
Found some matches.
 
Join Date: 06-26-12
Location: Hemlock,NY
Downloads: 0
Uploads: 0
Default

looks nice and clean...easy to understand
THE Meatman is offline   Reply With Quote


Unread 09-16-2012, 11:35 AM   #73
McEvoy AZ
On the road to being a farker
 
Join Date: 04-14-12
Location: Laveen AZ
Downloads: 0
Uploads: 0
Default

I may have missed this earlier in the thread, as I have not read the whole thing. It seems to me that what they are doing could be achieved by making sure there is a short commit on every score. Might even come up with a coding system that would expedite the scoring, as in the number 1 means to salty. With this system you would know why a judge scored you the way they did.
I was at a contest that another sanctioning body put on where most judges commented and I found I agreed with some of the judges and some of the judges contidicted other judges. This way you could look at the comment and decide for yourself if the judge was on point or not.
I think there is always going to be luck in this as we are facing human judges and thank god that is the case or the same teams would always win and what would be the point of showing up if you are not one of the winning teams.
McEvoy AZ is offline   Reply With Quote


Unread 09-17-2012, 07:57 AM   #74
bover
is one Smokin' Farker
 
Join Date: 01-19-11
Location: Lee's Summit, MO
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Funtimebbq View Post
That was suggested many pages ago but will only work after judges have had several contests for the system to calculate their scoring pattern. Unfortunately, by the time that happens, all judges will be scoring so high, it will not matter. Once judges see themselves being sent to re-education camps, those who are on the bubble will get the message and start scoring higher, defeating the system.
It stands to reason that judges that overscore would be handled in the same manner as those that underscore. Anyone consistently straying from the norm should be subjected to re-education.
__________________
"If I were just a bit more humble, I'd be perfect"
bover is offline   Reply With Quote


Unread 09-17-2012, 08:03 AM   #75
bover
is one Smokin' Farker
 
Join Date: 01-19-11
Location: Lee's Summit, MO
Downloads: 0
Uploads: 0
Default

I'm also in the camp of not including the alt number on the overall report. What purpose does it serve? To me it just seems like an opportunity for collusion at future events assuming the same renumbering methodology is used year after year.
__________________
"If I were just a bit more humble, I'd be perfect"
bover is offline   Reply With Quote


Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Loading



All times are GMT -5. The time now is 06:14 AM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.
vBulletin Optimisation provided by vB Optimise v2.6.0 Beta 4 (Lite) - vBulletin Mods & Addons Copyright © 2014 DragonByte Technologies Ltd.
2003 -2012 © BBQ-Brethren Inc. All rights reserved. All Content and Flaming Pig Logo are registered and protected under U.S and International Copyright and Trademarks. Content Within this Website Is Property of BBQ Brethren Inc. Reproduction or alteration is strictly prohibited.
no new posts