If most people couldn't tell the difference between different woods in the test, that would be a result. The test would have worked and done what it was designed to do.
Not according to what you say the aim of the test would be.
Yes, I'd agree that if most people
couldn't tell the difference between different woods in the test, that would indeed be "a" result.
However I understood you to say that the "aim" of your test, or what your test was designed to do was:
...My test has a different aim, it's to answer this: "Does all wood smoke have the same flavor profile? Or do different woods produce different flavors" ?
If a result of
"most people couldn't tell the difference between woods in the test", was obtained, well then that would not necessarily meet what you say would have been the "aim" of the test, and thus the test would not have done what it was designed to do.
Such a result would not definitively answer whether or not all woods produce different flavors.
It wouldn't answer that question one way or the other.
But rather that particular result, would only indicate that even "if" they do produce different flavors, then "most" of the people in your test, could not taste it.
And practically speaking, for those people, in terms of taste, smoke would be smoke.
However while a result of "most cannot tell the difference" is just "a" result, it at the same time, leaves the possibility that "some" in the test, have successfully matched each meat with the wood that it was smoked with.
Now how many of that "some" who successfully did that, may have done so through nothing more than a guess, would have to be considered as well.
This brings us back to those 7 common woods used for smoking.
The odds of successfully matching all 7 woods with their respective meats through smell and taste would of course be considerably higher than matching 2 different woods with two different meat samples.
While I know of no formal testing where average consumers were asked to distinguish between the smell of different types of wood smoke or the taste of barbecue done using various woods, I would not expect that the average consumer, would be able to consistently tell the difference unless the difference were a marked difference.
And yeah, same type of thing with videophiles and 720 vs 1080p.
I'm not surprised.
...I would wager that a lot of people could.
Depending upon the background of the group of people, and which woods you were asking them to distinguish between, that wager could be a perilous one.
Many people just aren't into barbecue at all and eat it only during holidays and not even all holidays. They soak wood chips from whatever bag of wood chips was on sale. That's if they even use wood chips.
If test subjects are coming from that group, well then I feel even more confident in my predictions. Especially if Mesquite were not among the test woods.
If there is a difference in taste between the other 6 choices, or that other 6 bags of wood chips they're having a sale on, well then they likely never noticed it. And still won't.
Another test. Fire a smoker up tomorrow and burn some hickory in it. Ask some people to just stand there and smell it's goodness. Fire the same smoker up the next day with some Mesquite. Ask the same people to once again stand there and smell it's goodness. then ask them if today's smoke smells different than yesterdays. I'd wager that a huge percentage would say "yeah, it smells quite different".
Yes, I conceded earlier that Mesquite would likely be easier for many to pick out of a lineup. And yes, they may not know what to call it. But even so, they'd likely know that it was "different" from for instance, peach.
This much I mentioned earlier.
Or, even think of your own experience. have you ever walked up on someone else smoking, taken a nice deep breath and said "Ah, I love the smell of mesquite". You would be more of an expert and could identify the right name, but just the fact that you can smell the difference proves the point.
Again, with the exception of Mesquite, out of the 7 common woods used for smoking in the U.S, hickory, oak, pecan, apple, cherry, peach, Mesquite, my wager would be that most people will not be able to tell the difference in smell between them until they got to Mesquite.
Again, that's not the case. That a person can't identify the flavor profiles of woods by name doesn't mean that they can't taste the difference. That's kind of been my point.
I'm not saying that they necessarily even have to know the woods by "name".
You could even assign each wood a "number" and each of the 7 plates of meat a "number" as well. Forget the name.
And my bet is that many if not most of the subjects tested, would not even be able to successfully match up the numbers.
In other words,
"this is smoke from wood number one. take a whiff.
and then
"in front of you are 7 plates. take a whiff and a taste of all 7. Now, which of the 7 was smoked with wood number one?
and then go on down the line, letting the subject smell smoke from wood number 2, put the 7 plates in from of him, let him smell and taste them, and then have him tell you which plate was smoked using wood number 2.
Proceed in like manner testing the subject using smoke from woods 3,4,5,6 and 7.
If one really wanted to make it interesting, then don't eliminate any of the plates for the next test, but offer up all seven plates each time a smoke sample was whiffed by the subject. Leave all seven plates in the game after each whiff of smoke, but rearrange their order.
My bet is that until you got to Mesquite, the average subject would fail miserably.
I'd also bet that many would whiff one plume of smoke number one, or on down the line, and would assign that same plume of smoke to say plate #6 on one try and plate #4 on another.
Finally one could randomly repeat the smoke samples and ask the subject "have you smelled this smoke earlier in this test? If so then which number was it?" Some will answer incorrectly there too.