MASTERS ON AUDIO AND VIDEOLetters Archives

May 2003

 

On several occasions recently, I have delved into the murky waters of distinctive amplifier "sound." In September, 2002, I described a series of listening tests I observed in the Fall of 1986, and reported on in the January, 1987 issue of Stereo Review, in which blind comparisons were performed among a group of six audio amplifiers, ranging from a cheapo receiver costing a few hundred bucks to a pair of megadollar mono tube models. The conclusion at that time, as with other tests I have observed or studied, was that listeners couldn't reliably hear any differences between the various amps.

Publishing such results always brings the incredulous to the fore, to point out that the result can't be true. Witness the harangue by audio journalist Mike Silverton, quoted here in my audio column in March, 2003. Predictably, others have joined the fray. Here are a couple of reactions:

...Ian G. Masters


You said, "Six amplifiers were auditioned, ranging from a $200 cheapo receiver to a $12,000 pair of mono tube amplifiers." What you fail to mention, and what makes me a little suspicious, is which amp was paired with what other amp. Did each pair of listeners get a chance to listen to all six amps? From the way this article is worded you could have paired the $200 cheapo with a $600 amp, then a $2000 amp with a $4000 amp, and finally, an $8000 amp against the $12,000 pair. Then I might agree [differences] would be hard to discern.

But you can't tell me there wasn't an amazing difference when comparing the $200 cheapo and the $12,000 pair. The only way to get a true reading is by pairing the lowest with the best, back to back, without confusing the listener with the middle amps. Most people may not be able to tell the difference between a $600 amp and a $3000 amp, but I would be willing to bet that anyone could tell the difference between a $200 amp and the $12,000 pair.

...R. Wilgus

I'd take you up on that, except I'm not a betting man. There wasn't a lot of room in my description to go into the details of the test, but I should point out that some 25 listeners were involved, including many who were very experienced, and many of those who believed that distinctive amplifier sounds were a reality. All had the opportunity to criticize (and, potentially, modify) the test procedures -- none did. Dozens of comparisons were performed, and almost all combinations of amplifiers were tried. For reasons of time, there was less concentration among the mid-priced amplifiers, which most listeners expected would sound pretty much alike anyway, and most time was spent listening to the extreme models. More comparisons were performed between the cheapo and the mono tube jobs than any other pair -- obviously that would be the most contentious situation -- and no, "there wasn't an amazing difference when comparing the $200 cheapo and the $12,000 pair." There was no reliably measurable difference at all.

...Ian G. Masters


I just read your article on amplifier sound and while I think that the differences in the sounds of amplifiers are much exaggerated, if you listen carefully for differences you are sure to find them.

I am a PhD chemist and so I approached this from a different perspective than most who engage in the hobby (not those who actually design the equipment, however). My original assumption was that similarly measuring components, whether they are solid state or tube, would in fact sound similar and that given this premise, power, features and warranty were more important. In fact, at one time I was an avid reader of Stereo Review and I believe I even read the article you describe (although now my memory fails me as to the details since I no longer have this issue).

Over the years of trying several different components and many amps, I have now been convinced by my ears that there is a sonic difference between amps and that it is not just a snow job by all the manufacturers and sales people.

I think the ear is very sensitive to very little things, including usually ignored issues like phase shifts. Now I am sure that in a double-blind session where I am hearing snippets of the same pieces over and over I cannot pick one amp out from another. In fact, it would probably be difficult to pick out one top violinist from another playing the same pieces in snippets using the same methodology. Memory for this kind of thing is not so good.

I think it is because the differences are small that the memory has such difficulty, and why living with a component over time reveals characteristics that you can either live with or not. Determining the sound of an amp is more like telling the difference between vintages from the same winery or detecting the type of wood the wine was stored in. The "experts" can do this but perhaps can be easily fooled since they haven't tasted all the tastes (and odors since this actually plays a bigger role in the "taste" of a wine) that exist. Tasting different types of wine is more like listening to different speakers. The differences are much more obvious.

The situation is 1000 times (at least) worse for amps. Only under critical conditions can one easily hear the differences, as they are generally much smaller than with speakers. I am convinced, however, that they do exist and that the statistics in this case don't actually tell very much with regard to whether something sounds different or not.

Also, how an amp handles complex music is of interest. An amp is not just amplifying one frequency at a time but multiple frequencies at varying amplitudes. This means that many amps are much closer to clipping (or periodically going into clipping on peaks, especially on noncompressed music) than many people would like to believe. So the dynamic behavior of an amp is much more important than its "steady state" RMS values. I think this is why many people find lower-powered tube amps agreeable (higher voltage swings are generally possible along with easier clipping) and find them more "powerful" for a given power rating. Also, the nature of the harmonics, in addition to the level, is critical.

I would like to end by saying that even though you haven't seen "proof" by way of statistics I think you should look at what those statistics are really telling you. They are saying that you can't pick an amp out of a "line up," not that the amps don't sound different. I am a scientist but I also know the weaknesses of using the statistical argument. Also, human psychology plays a very big role in these tests and from what I have seen it has not yet been reduced to a science, nor is it likely to be in the near future.

It seems you have sacrificed your ears and your trust in your senses (yes, I know that they can be fooled, which is what stereo reproduction or surround sound is all about, right?) in the name of "science," whereas I discovered mine in spite of it.

...Brad Morrical

An elegant argument from someone who has thought a lot about it, and I thank you for sharing your insights. But the simple fact is that the experiment was not designed to quantify differences or to describe them, but simply to find out whether the listeners were able to detect any differences at all. And the results, taking the listeners individually and as a group, and among all the combinations of amplifiers that were tried, indicated that choices made were no better than pure chance. They were, therefore, guesses.

I concluded my original report with "This is just the beginning -- few scientists would place a great deal of weight on the results of a single experiment, however extensive, and particularly not a first one. Our techniques must, and will, be refined, and a larger body of data will be collected as more such tests are performed in the years to come . . . But for now, for us, the evidence would seem to suggest that . . . there are still differences between amps, but we are unlikely to hear them." A number of further tests have been performed in the ensuing years, and they haven't served to contradict our earlier findings.

The vehemence of audiophiles' reactions is not really surprising, of course. In his editorial introducing my original article, Stereo Review editor-in-chief William Livingstone said, "There is an Arab proverb that says: The truth angers those whom it does not convince." Nothing in my experience has validated the accuracy of that old saying so clearly as some of our listening tests of audio equipment.

...Ian G. Masters


MASTERS ON AUDIO AND VIDEOAll Contents Copyright © 2003
Schneider Publishing Inc., All Rights Reserved.
Any reproduction of content on
this site without permission is strictly forbidden.