Good Customers, Bad Reviews
Skip to content
Marketing Aug 5, 2013

Good Customers, Bad Reviews

Deceptive product reviews aren’t always written by the enemy—or even in anger

Health Gauge via Creative Commons

Based on the research of

Eric T. Anderson

Duncan I. Simester

Editor’s Note: This paper was recently awarded the prestigious Paul E. Green Award from the Journal of Marketing Research.

Customer reviews can make or break a product, influencing what we buy and what companies produce. So with this much riding on them, the prospect of deceptive reviews—reviews that are not what they pretend to be—is quite unsettling.

One fear is that employees from rival firms will pose as legitimate customers and post negative reviews about a company’s products or services. Indeed, on some review sites like TripAdvisor, such concerns may have merit. “Some research has shown that hotels from independent chains may write negative reviews about rival hotels in the area,” explains Eric Anderson, a professor of marketing at the Kellogg School of Management.

But Anderson and his colleague, Duncan Simester of the Massachusetts Institute of Technology, have recently discovered a different type of deceptive review—one written not by a company’s rivals, but by its very best customers.

Evidence of Deception

Anderson and Simester examined customer product reviews posted to the website of a prominent apparel company. The researchers first attempted to connect reviews, which could only be written by registered users, to individual purchases—a task made possible because the retailer was the exclusive seller of its products, and held detailed transaction records. These records linked purchases made through multiple retail channels to specific customers via credit card numbers and other identifying information, leaving researchers fairly confident that if a registered user had made a purchase, they would know it.

But then the researchers noticed something unexpected: about 5% of the over 300,000 product reviews they sifted through could not be linked to actual purchases. “So we spent a lot of time trying to figure out who these customers are and what these products were,” explains Anderson. “And after an incredible amount of sleuthing”—ruling out the possibility the individuals had received the items as gifts, among other explanations—“we determined that it was very likely that these customers had never bought the product.” In other words, the customers appeared to be lying.

“It’s actually thousands of customers writing these negative reviews. And so the question then is, well who are these guys?”

Linguistic analyses support their conclusion. Prior research has identified a number of features that can be associated with deceptive language—one of the more prominent of which is the use of elaborate narratives. And indeed, reviews that could not be connected to actual purchases had a word count about 40% higher than other reviews. Another linguistic hallmark of deception: a surfeit of exclamation points—“not just one but multiple exclamation points,” says Anderson. “It turns out that’s also very prevalent in these 5% of the reviews.”

So how do these deceptive reviews differ from other reviews on the site? The most striking quality is their negativity. The researchers found that reviewers for whom a purchase could not be verified were twice as likely to assign the lowest rating to a product than reviewers with verified purchases. And make no mistake—this 5% of disproportionately negative reviews was enough to impact sales. “We show in this case that the firm loses about 1–2% of revenue,” explains Anderson. “That may not sound like a lot of money, but when you’re a really big company, losing 1–2% of revenue because of [deceptive] reviews is a huge figure.”

Meet the Deceivers

In considering who these reviewers are, and why they may have left deceptive reviews, it is important to remember that writing reviews is inherently an “anomalous activity,” explains Anderson. “Not many people write reviews. So we’re already down into fewer than 5% of consumers actually taking the time to write reviews. And now we’re finding 5% of that 5% are doing these somewhat deceptive reviews.”

Even so, he explains, it is not the case that just a few bad apples are responsible for the deception. “It’s actually thousands of customers writing these negative reviews. And so the question then is, well who are these guys? And the big surprise to us was: they’re really good customers! In fact they are way better than the average customer.” These deceptive reviewers are such good customers, in fact, that they have on average each purchased over 100 items from the retailer.

The elephant in the room here is, of course, why? Why would a loyal customer write a review of a product she never even purchased? One explanation is that these customers are upset with the company and wielding negative reviews as punishment. Yet it is hard to see how they could be too upset, as these customers continued to purchase products from the retailer even after leaving their deceptive reviews. Nor is there good evidence that these customers were simply racking up reviews to establish social standing and credibility. These reviewers tended to have purchased plenty of products for which they did not write reviews.

Instead, the researchers argue, these reviewers are acting as self-appointed brand managers. “They’re such good customers that they now feel like they should be guiding the company,” says Anderson. “And when the company makes mistakes in the eyes of the consumer, they want to correct them.” Again, linguistic analyses offers some support for this view: the pool of deceptive reviews contained tellingly high numbers of phrases such as “carry more” or “go back to”—phrases suggestive of requests aimed at the firm, rather than advice for fellow customers.

Discouraging Deceptive Reviews

What then can a company do to discourage customers from leaving deceptive product reviews? Resist the urge to take legal action against customers who engage in this behavior, says Anderson—even if you can prove their reviews to be groundless and harmful. After all, these may be some of your best customers. Instead, think redirection. Seek these customers out and offer them other avenues for expressing displeasure, doling out advice, and otherwise feeling heard.

The broader issue, though, is one of representation. Because so few customers leave reviews in the first place, retailers are left with feedback from a population that they know is not representative of their customer base, even without deception thrown into the mix. “That’s a problem,” says Anderson, “and the companies know this.” The pair of researchers has since teamed up with experts in boosting engagement and turnout for political campaigns. The hope is that the two teams of experts can learn from one another: perhaps tricks for increasing voter participation can be used to increase reviewer participation, and vice versa.

Photo credit belongs to Health Guage. Published under a Creative Commons license.

Featured Faculty

Polk Bros. Chair in Retailing; Professor of Marketing; Director Kellogg-McCormick MBAi

About the Writer
Jessica Love is the editor in chief of Kellogg Insight.
About the Research

Eric T. Anderson and Duncan I. Simester (2014) Reviews Without a Purchase: Low Ratings, Loyal Customers, and Deception. Journal of Marketing Research: June 2014, Vol. 51, No. 3, pp. 249-269.

Read the original

Most Popular This Week
  1. One Key to a Happy Marriage? A Joint Bank Account.
    Merging finances helps newlyweds align their financial goals and avoid scorekeeping.
    married couple standing at bank teller's window
  2. Take 5: Yikes! When Unintended Consequences Strike
    Good intentions don’t always mean good results. Here’s why humility, and a lot of monitoring, are so important when making big changes.
    People pass an e-cigarette billboard
  3. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  4. Will AI Eventually Replace Doctors?
    Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
    doctors offices in small nodules
  5. Entrepreneurship Through Acquisition Is Still Entrepreneurship
    ETA is one of the fastest-growing paths to entrepreneurship. Here's how to think about it.
    An entrepreneur strides toward a business for sale.
  6. Take 5: Research-Backed Tips for Scheduling Your Day
    Kellogg faculty offer ideas for working smarter and not harder.
    A to-do list with easy and hard tasks
  7. How to Manage a Disengaged Employee—and Get Them Excited about Work Again
    Don’t give up on checked-out team members. Try these strategies instead.
    CEO cheering on team with pom-poms
  8. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  9. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  10. The Appeal of Handmade in an Era of Automation
    This excerpt from the book “The Power of Human" explains why we continue to equate human effort with value.
    person, robot, and elephant make still life drawing.
  11. 2 Factors Will Determine How Much AI Transforms Our Economy
    They’ll also dictate how workers stand to fare.
    robot waiter serves couple in restaurant
  12. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  13. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  14. Sitting Near a High-Performer Can Make You Better at Your Job
    “Spillover” from certain coworkers can boost our productivity—or jeopardize our employment.
    The spillover effect in offices impacts workers in close physical proximity.
  15. How the Wormhole Decade (2000–2010) Changed the World
    Five implications no one can afford to ignore.
    The rise of the internet resulted in a global culture shift that changed the world.
  16. What’s at Stake in the Debt-Ceiling Standoff?
    Defaulting would be an unmitigated disaster, quickly felt by ordinary Americans.
    two groups of politicians negotiate while dangling upside down from the ceiling of a room
  17. What Happens to Worker Productivity after a Minimum Wage Increase?
    A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
    employees unload pallets from a truck using hand carts
  18. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  19. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  20. 3 Traits of Successful Market-Creating Entrepreneurs
    Creating a market isn’t for the faint of heart. But a dose of humility can go a long way.
    man standing on hilltop overlooking city
More in Marketing