Good Customers, Bad Reviews
Skip to content
Marketing Aug 5, 2013

Good Customers, Bad Reviews

Deceptive product reviews aren’t always written by the enemy—or even in anger

Health Gauge via Creative Commons

Based on the research of

Eric T. Anderson

Duncan I. Simester

Editor’s Note: This paper was recently awarded the prestigious Paul E. Green Award from the Journal of Marketing Research.

Customer reviews can make or break a product, influencing what we buy and what companies produce. So with this much riding on them, the prospect of deceptive reviews—reviews that are not what they pretend to be—is quite unsettling.

One fear is that employees from rival firms will pose as legitimate customers and post negative reviews about a company’s products or services. Indeed, on some review sites like TripAdvisor, such concerns may have merit. “Some research has shown that hotels from independent chains may write negative reviews about rival hotels in the area,” explains Eric Anderson, a professor of marketing at the Kellogg School of Management.

But Anderson and his colleague, Duncan Simester of the Massachusetts Institute of Technology, have recently discovered a different type of deceptive review—one written not by a company’s rivals, but by its very best customers.

Evidence of Deception

Anderson and Simester examined customer product reviews posted to the website of a prominent apparel company. The researchers first attempted to connect reviews, which could only be written by registered users, to individual purchases—a task made possible because the retailer was the exclusive seller of its products, and held detailed transaction records. These records linked purchases made through multiple retail channels to specific customers via credit card numbers and other identifying information, leaving researchers fairly confident that if a registered user had made a purchase, they would know it.

Add Insight
to your inbox.

But then the researchers noticed something unexpected: about 5% of the over 300,000 product reviews they sifted through could not be linked to actual purchases. “So we spent a lot of time trying to figure out who these customers are and what these products were,” explains Anderson. “And after an incredible amount of sleuthing”—ruling out the possibility the individuals had received the items as gifts, among other explanations—“we determined that it was very likely that these customers had never bought the product.” In other words, the customers appeared to be lying.

“It’s actually thousands of customers writing these negative reviews. And so the question then is, well who are these guys?”

Linguistic analyses support their conclusion. Prior research has identified a number of features that can be associated with deceptive language—one of the more prominent of which is the use of elaborate narratives. And indeed, reviews that could not be connected to actual purchases had a word count about 40% higher than other reviews. Another linguistic hallmark of deception: a surfeit of exclamation points—“not just one but multiple exclamation points,” says Anderson. “It turns out that’s also very prevalent in these 5% of the reviews.”

So how do these deceptive reviews differ from other reviews on the site? The most striking quality is their negativity. The researchers found that reviewers for whom a purchase could not be verified were twice as likely to assign the lowest rating to a product than reviewers with verified purchases. And make no mistake—this 5% of disproportionately negative reviews was enough to impact sales. “We show in this case that the firm loses about 1–2% of revenue,” explains Anderson. “That may not sound like a lot of money, but when you’re a really big company, losing 1–2% of revenue because of [deceptive] reviews is a huge figure.”

Meet the Deceivers

In considering who these reviewers are, and why they may have left deceptive reviews, it is important to remember that writing reviews is inherently an “anomalous activity,” explains Anderson. “Not many people write reviews. So we’re already down into fewer than 5% of consumers actually taking the time to write reviews. And now we’re finding 5% of that 5% are doing these somewhat deceptive reviews.”

Even so, he explains, it is not the case that just a few bad apples are responsible for the deception. “It’s actually thousands of customers writing these negative reviews. And so the question then is, well who are these guys? And the big surprise to us was: they’re really good customers! In fact they are way better than the average customer.” These deceptive reviewers are such good customers, in fact, that they have on average each purchased over 100 items from the retailer.

The elephant in the room here is, of course, why? Why would a loyal customer write a review of a product she never even purchased? One explanation is that these customers are upset with the company and wielding negative reviews as punishment. Yet it is hard to see how they could be too upset, as these customers continued to purchase products from the retailer even after leaving their deceptive reviews. Nor is there good evidence that these customers were simply racking up reviews to establish social standing and credibility. These reviewers tended to have purchased plenty of products for which they did not write reviews.

Instead, the researchers argue, these reviewers are acting as self-appointed brand managers. “They’re such good customers that they now feel like they should be guiding the company,” says Anderson. “And when the company makes mistakes in the eyes of the consumer, they want to correct them.” Again, linguistic analyses offers some support for this view: the pool of deceptive reviews contained tellingly high numbers of phrases such as “carry more” or “go back to”—phrases suggestive of requests aimed at the firm, rather than advice for fellow customers.

Discouraging Deceptive Reviews

What then can a company do to discourage customers from leaving deceptive product reviews? Resist the urge to take legal action against customers who engage in this behavior, says Anderson—even if you can prove their reviews to be groundless and harmful. After all, these may be some of your best customers. Instead, think redirection. Seek these customers out and offer them other avenues for expressing displeasure, doling out advice, and otherwise feeling heard.

The broader issue, though, is one of representation. Because so few customers leave reviews in the first place, retailers are left with feedback from a population that they know is not representative of their customer base, even without deception thrown into the mix. “That’s a problem,” says Anderson, “and the companies know this.” The pair of researchers has since teamed up with experts in boosting engagement and turnout for political campaigns. The hope is that the two teams of experts can learn from one another: perhaps tricks for increasing voter participation can be used to increase reviewer participation, and vice versa.

Photo credit belongs to Health Guage. Published under a Creative Commons license.

Featured Faculty

Polk Bros. Chair in Retailing; Professor of Marketing; Director Kellogg-McCormick MBAi

About the Writer
Jessica Love is the editor in chief of Kellogg Insight.
About the Research

Eric T. Anderson and Duncan I. Simester (2014) Reviews Without a Purchase: Low Ratings, Loyal Customers, and Deception. Journal of Marketing Research: June 2014, Vol. 51, No. 3, pp. 249-269.

Read the original

Most Popular This Week
  1. How Much Do Boycotts Affect a Company’s Bottom Line?
    There’s often an opposing camp pushing for a “buycott” to support the company. New research shows which group has more sway.
    grocery store aisle where two groups of people protest. One group is boycotting, while the other is buycotting
  2. 5 Takeaways on the State of ESG Investing
    ESG investing is hot. But what does it actually deliver for society and for shareholders?
    watering can pouring over windmills
  3. Could Bringing Your "Whole Self" to Work Curb Unethical Behavior?
    Organizations would be wise to help employees avoid compartmentalizing their personal and professional identities.
    A star employee brings her whole self to work.
  4. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  5. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  6. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  7. What Happens to Worker Productivity after a Minimum Wage Increase?
    A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
    employees unload pallets from a truck using hand carts
  8. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  9. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  10. Why Well-Meaning NGOs Sometimes Do More Harm than Good
    Studies of aid groups in Ghana and Uganda show why it’s so important to coordinate with local governments and institutions.
    To succeed, foreign aid and health programs need buy-in and coordination with local partners.
  11. 3 Tips for Reinventing Your Career After a Layoff
    It’s crucial to reassess what you want to be doing instead of jumping at the first opportunity.
    woman standing confidently
  12. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  13. Podcast: Does Your Life Reflect What You Value?
    On this episode of The Insightful Leader, a former CEO explains how to organize your life around what really matters—instead of trying to do it all.
  14. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  15. In a World of Widespread Video Sharing, What’s Real and What’s Not?
    A discussion with a video-authentication expert on what it takes to unearth “deepfakes.”
    A detective pulls back his computer screen to reveal code behind the video image.
  16. College Campuses Are Becoming More Diverse. But How Much Do Students from Different Backgrounds Actually Interact?
    Increasing diversity has been a key goal, “but far less attention is paid to what happens after we get people in the door.”
    College quad with students walking away from the center
More in Marketing