I had a meeting with a vendor a few weeks ago about a new product coming to market and one of the topics we talked about was how well it would be received by reviewers. It was an interesting chat and it led us talk about bias in technology reviews and how to work around them.
It’s always clear to me when a reviewer has a preference for Androis over Windows Mobile, Windows over Mac or iPods over everything else. You can spot the inconsistencies pretty easily. When product A is praised for a feature that’s ignored when product B is reviewed. Or when the opposite occurs and product B is dinged for a flaw that’s also an issue in product A, where the flaw is conveniently ignored. Sometimes product B just gets dinged, even if the apparent flaw or bug isn’t even there. It’s tough to review technology. Face it, if you bought yourself Widget X and learned to use it and adapt to it (and let’s be clear, most technologies force us to adapt to them and not the other way around) you’re going to have a hard time reviewing a Widget Y objectively and it shows in the review.
When Jeffrey Steingarten left his career as a lawyer to become to the food critic at Vogue, he “suffered from a set of strong and arbitrary likes and dislikes regarding food”. And further writes “I feared that I was no better than an art critic who becomes nauseated by the color yellow, or suffers from red-green color blindness.” Or perhaps a technology reviewer that dislikes Apple and is nauseated by Microsoft? How did he overcome his personal bias? He became and omnivore and learned to eat his way through his food phobias. It’s time for tech reviewers to do the same.
Oh and any vendors needing to work through these issues, give me a call, I’ll help you out too :)
Posted by Gartenberg 