The BBQ BRETHREN FORUMS.


Forum Portal Recipes Smoke Signals Magazine Welocme Merchandise Associations Purchase Subscription Brethren Banners
Go Back   The BBQ BRETHREN FORUMS. > Discussion Area > Competition BBQ

Notices

Competition BBQ *On Topic Only* Discussion regarding all aspects of Competition BBQ. Experiences competing or visiting, questions, getting started, Equipment, announcements of events, Results, Reviews, Planning, etc. Questions here will be responded to with competition BBQ in mind.


Reply
Thread Tools
Unread 04-15-2013, 12:46 PM   #61
Jorge
somebody shut me the fark up.
 
Jorge's Avatar
 
Join Date: 01-23-04
Location: DFW, San AntonioTx
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Hawg Father of Seoul View Post
Here's my problem with tracking a judge's performance. They would have to evaluate the judge against all tables they have judged to see if they are actually a statistical outlier. I doubt that any one in KCBS could handle the stats for that. (You could use the I/O psychology program at MSU to do it)

The entire beauty of the current program is that you have the "samples" of judges that resemble randomness. Sure you have some systematic variance and some silos, but it is better than medical "random samples".

If they start a BBQ inquisition, they may rid the system of GOOD variance. Believe it or not a LOT of these scores that are all over the place are accurate and would hold true if the same sample was provided to a larger audience. Is that not the point, to give an accurate score?
I think you are probably ahead of the curve at this point.

The software will have the ability to collect the data necessary to do the analysis. Just about everybody has an opinion about what it will show. Having worked with statistics quite a bit I've got no doubt that some trends will emerge quickly. But, based on that experience I'd suggest not making any decisions until a year of data had been captured, and used to test various algorithms.

I don't know if anyone currently employed or serving on the board has the experience to do the analysis or consult, but I know of at least one member that contacted me while I served on the board that does. I don't see any hurdles that can't be negotiated.
__________________
You can't be a real country unless you have a beer and an airline - it helps if you have some kind of a football team, or some nuclear weapons, but at the very least you need a beer. --Frank Zappa

BOOGITY, BOOGITY, BOOGITY!!!

Recipient of a Huggies box!

Shut up, and cook!!!!
Jorge is offline   Reply With Quote


Thanks from: --->
Unread 04-15-2013, 01:46 PM   #62
Hawg Father of Seoul
is One Chatty Farker
 
Join Date: 09-14-10
Location: Rogers, AR
Downloads: 0
Uploads: 0
Default

Quote:
I think you are probably ahead of the curve at this point.
Pun intended?

Not trying to be disrespectful at all. If correctly handled, the data will speak for itself. The problem is that a lot of people think that they understand stats. A few easy questions to weed out the posers- 1. How do you handle outliers? 2. What if they are outliers in X and Y space? 4. How and when do you correct for skewness and kurtosis? 3. What program do you use for nonparametric data?

These are all super simple questions for any one that is allowed a crack any commercial data set.
Hawg Father of Seoul is online now   Reply With Quote


Thanks from:--->
Unread 04-15-2013, 06:26 PM   #63
Smoke'n Ice
is one Smokin' Farker
 
Join Date: 05-08-09
Location: Plano, TX
Downloads: 0
Uploads: 0
Default

Based on currently available data, the BOD, the committee responsible for the the Score program, the programmers for the score program, the owers of the software company responsible for the score program do not have a clue about these last posts. Any analysis will require a new committee, and good luck. The folks in the technology committee are not taking advantage of the resources available to the orgainization from the membership.

The bottom line is "Don't Hold Your Breath!"
Smoke'n Ice is offline   Reply With Quote


Thanks from: --->
Unread 04-15-2013, 08:10 PM   #64
Outnumbered
is One Chatty Farker

 
Outnumbered's Avatar
 
Join Date: 09-18-11
Location: Smithville, Missouri, United States
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Svenmac View Post
The best thing Kcbs could ever do is have all judges shadow a team and see how much $$$$
Why does this matter? We all know the cost of participating. If I get a 7 and the judge thinks it's the worst thing he/she has ever tasted, what does a 7 tell me about that?

When I've judged, the table captain tried to tell me all this. When I said I cooked contests, the TC and the other judges quickly stopped telling me anything. I wanted to learn from them about what judges were thinking. A lot of times, it wasn't what I was, that's for d$#^ sure.

My point is that if you're going to play this game, learn the game. If not, get out. It costs money like anything other "sport" or game.

Personally, if I'm going to spend this much money to compete, I want to get a true indication of how my food is being received.
__________________
Greg Vincent

When I die, my goal is to have a visible smoke ring when the coroner cuts me open for the autopsy.
Outnumbered is offline   Reply With Quote


Thanks from:--->
Unread 04-16-2013, 12:30 AM   #65
Svenmac
Knows what a fatty is.
 
Join Date: 03-03-10
Location: Paducah, KY
Downloads: 0
Uploads: 0
Default

I play the game very well thank you and I pay the costs. Go back and read most if this has been hashed out. If you get a 7 and truely deserve a 7 then you are a low to mid packer and never will win a contest. My whole point was when you go to contests and 5 judges give you all 9s and the last judge gives you 777. I do have a problem with that. But I'm not restarting the debate for sake of the board
Svenmac is offline   Reply With Quote


Unread 04-16-2013, 06:24 PM   #66
Bentley
Babbling Farker
 
Bentley's Avatar
 
Join Date: 03-14-07
Location: Culpeper, Virginia
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Svenmac View Post
The best thing Kcbs could ever do is have all judges shadow a team and see how much $$$$ and time the cooks put into a contest.

I have been a Chief Cook and Judge for 11 years...Do you think when I judge, I really care how much they spent to do it? That was their choice!

I am also gonna score the way I do whether you track me or not. I agree you should be able to articulate ANY score you give and I can. If it comes down to KCBS does not like that my scores deviate too much from the others, you better be ready to ban me, cuz it aint gonna change.
__________________
Certified Master Judge #5382


What is best in life? "To crush your BBQ opponents, to see them driven before you, and to hear the lamentations of their women."
Bentley is offline   Reply With Quote


Thanks from: --->
Unread 04-16-2013, 07:53 PM   #67
G'pa Herb
Found some matches.
 
Join Date: 11-20-12
Location: Arizona
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Svenmac View Post
My whole point was when you go to contests and 5 judges give you all 9s and the last judge gives you 777. I do have a problem with that. But I'm not restarting the debate for sake of the board
According to the official KCBS 2013 Official Rules and Regulations Judging Procedures, under Judging Procedures, rule #7: "The low score is thrown out.", basically DQing that judge. How is this not a suitable "fix" to the stated problem?

Last edited by G'pa Herb; 04-16-2013 at 10:22 PM..
G'pa Herb is offline   Reply With Quote


Thanks from:--->
Unread 04-16-2013, 09:38 PM   #68
Q-Dat
Babbling Farker

 
Q-Dat's Avatar
 
Join Date: 12-03-08
Location: Pearl River LA
Downloads: 0
Uploads: 0
Default

Ok does anyone really think that anyone here is suggesting that if the judges see what we spend and how hard we work that they should have sympathy on us and give higher scores?

No really I am asking a serious question. Does anyone ACTUALLY think that ANYBODY is dumb enough to suggest that EXACTLY the way I put it in the first sentence?

Ok nobody? Good.

The suggestion is not being made to improve the judging of judges on this site. What it COULD do is maybe give some judges who have far too cavalier of an attitude about judging, a better scope and comprehension of the responsibility and the privilege that they have taken on. A judge who likes to just put 7's out of mental laziness might be encouraged to step it up if they see what we have invested.

The idea of judges cooking with a team was NEVER intended to even begin to change criteria. Only attitudes.

Now is this idea realistic? Who knows...
Q-Dat is offline   Reply With Quote


Thanks from: --->
Unread 04-17-2013, 01:17 AM   #69
Svenmac
Knows what a fatty is.
 
Join Date: 03-03-10
Location: Paducah, KY
Downloads: 0
Uploads: 0
Default

At least you get what I'm saying.

Guys you are taking my statement out of context. Like I stated before I don't care if your lotta bull with a 300k setup or joe bob with a WSM I made that statement for the exact reason Qdat just said

I know they drop the lowest but it shouldn't happen in first place
Svenmac is offline   Reply With Quote


Unread 04-17-2013, 11:03 AM   #70
Outnumbered
is One Chatty Farker

 
Outnumbered's Avatar
 
Join Date: 09-18-11
Location: Smithville, Missouri, United States
Downloads: 0
Uploads: 0
Default

^^^But there are times that could happen. (And I honestly believe we're agreeing here.)

For instance, if you turn in 7 bones and one wasn't done properly and it was tough. The other 5 judges got a bone with good tenderness and you get 8s and 9s, but that 6th judge selected the wrong bone and a jackhammer wouldn't pull it off the bone. So you get a 7 for tenderness. By most judging standards today, that would give you a 7 in tenderness, but the scoring range says that should actually be a 4 or maybe even a 3.

But nobody is going to score a 4 because the "teams spend too much money" or "I don't want to fill out a comment card."

I don't see how giving me a 7 to make me feel better about myself when I really deserved a 4 for tenderness is going to help anyone.

But if you're going to go that way, you have to make sure you're going to get an honest opinion from all the judges. If not, you're opening the door to really getting a lucky table draw for a win. If that happens, I hope I get the table of nice old ladies who don't want to hurt anybody's feelings and everyone else gets the judges who do it correctly.
__________________
Greg Vincent

When I die, my goal is to have a visible smoke ring when the coroner cuts me open for the autopsy.
Outnumbered is offline   Reply With Quote


Unread 04-17-2013, 11:22 AM   #71
Bentley
Babbling Farker
 
Bentley's Avatar
 
Join Date: 03-14-07
Location: Culpeper, Virginia
Downloads: 0
Uploads: 0
Default

Quote:
Originally Posted by Q-Dat View Post
The suggestion is not being made to improve the judging of judges on this site. What it COULD do is maybe give some judges who have far too cavalier of an attitude about judging, a better scope and comprehension of the responsibility and the privilege that they have taken on. A judge who likes to just put 7's out of mental laziness might be encouraged to step it up if they see what we have invested.

I don't think that anything you do is going to effect change in judges like that, it is just a pit fall of competing...If KCBS thinks tracking them will help, by all means do it, just please have a system in place to be able to deal with the judge...or it is all just blowing smoke.
__________________
Certified Master Judge #5382


What is best in life? "To crush your BBQ opponents, to see them driven before you, and to hear the lamentations of their women."
Bentley is offline   Reply With Quote


Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Loading



All times are GMT -5. The time now is 04:31 PM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.
vBulletin Optimisation provided by vB Optimise v2.6.0 Beta 4 (Lite) - vBulletin Mods & Addons Copyright © 2014 DragonByte Technologies Ltd.
2003 -2012 © BBQ-Brethren Inc. All rights reserved. All Content and Flaming Pig Logo are registered and protected under U.S and International Copyright and Trademarks. Content Within this Website Is Property of BBQ Brethren Inc. Reproduction or alteration is strictly prohibited.
no new posts