It is my opinion that most people really don't want to risk knowing the facts concerning their detectors true performance. Even if a matrix was developed and made public most would poo-poo it all and buy their 'favorite' brand. People shop based on perceived needs but they buy based on emotional needs. That is why stores sell 'loss-leaders' to get you motivated to come into the store -- they know you'll be walking out with the better model (with a higher profit margin). Pride plays a part too -- who wants to admit the bought a lemon. Adaptability is the human trait to overlook a products limitations -- and instead to adapt or adjust to the limitation. For instance, we discover our new detector's confusing audio response to ferrous junk and hot ground is upsetting -- but soon adapt to it and proclaim the chatter as a good design feature that aids detection. Rather than admit it is as confusing as %ell, the limitation becomes, through mental gymnastics -- a benefit and a mark of superiority.
How many magazine detector reviews seek to justify some nagging design fault with a comment about how the tester found a way to compensate for it or some other aspect made it possible to overlook the poor construction. When it comes to detector reviews you could tie a magnet to a broom stick and someone would claim it has great balance and praise its 'silent operation', with a conclusion that it should prove to be a 'deep seeker' - overall "recommend buy". I'll pay you to say you found a copper Roman coin inscribed 200 B.C. that was dug "real deep" in a "hunted out site" after only two sweeps in an "unworkable" area littered with junk, to undeniably prove what a "fantastic" machine it is (and it costs only $1299.99 MSRP, broom sticks don't grow on trees you know). Some color pictures with a pretty girl holding it up-side-down and you'll be clamoring to buy my patent-pending "M-scope Magneto-pole with Dual Polarized Induction Technology", that's DPIT for the layman.
Well obviously no one would buy such a thing. Instead you might buy a bent metal wire that costs $1.50 to make. You'd pay $65 if I told you it was a "counter-balanced, crystal-powered, deep-seeking, locator dowsing rod".
All I'm asking is to have experienced persons post reasonably well controlled side-by-side test results. Don't know how to keep bogus data out of the results -- very tempting for some to falsify results to make their favorite detector just that much better. With enough data points those bogus data points would be easily removed as outside the norm. Then we would know which detector really is best in various categories and conditions -- yikes! An informed user - could such a thing exist in a hobby that lives on anecdotal stories.
I'd like to see it. Anyone seriously want to setup a webpage (anonymously of course) where data can be posted from home test beds? I'd do it but I'm no HTML guru. Seems like MS Access database with a fill-in user entry for inputting key information (detector used, coil size, settings, soil mineralization low/med/high, air/ground, target, max depth, etc., would work. The results would be displayed in a comparative matrix or graphically by detector.
john