Product Q&A Forums Hold a Lot of Promise. Here’s How to Make Them Work.
Skip to content
Podcast | Insight Unpacked Season 1: Extraordinary Brands and How to Build Them
Operations Nov 3, 2022

Product Q&A Forums Hold a Lot of Promise. Here’s How to Make Them Work.

The key to these online communities, where users can ask and answer questions, is how many questions get useful answers.

man sits at computer reading Q&A forum

Lisa Röper

Based on the research of

Neha Sharma

Gad Allon

Achal Bassamboo

In 2010, Yahoo Answers—a site where users could ask questions about anything from physics to celebrity pets—had about 25 million users. Five years later, that number had plummeted to 4 million, and in May 2021, the online community was shut down altogether.

Add Insight
to your inbox.

And yet other online communities, like Stack Overflow, have thrived.

The demise—or success—of sites like these are of interest to Achal Bassamboo, Kellogg professor of operations. He seeks to understand how these sorts of online communities work, in particular, because they’re a growing trend in customer service.

“A big thing happening in customer support is that people have moved to self-help because they don’t want to wait at call centers,” Bassamboo says. “And FAQs are available, but the next level is making it more dynamic, so people can ask questions and others can help them out.”

A wide range of businesses launch and nurture online communities. Some of these communities, like Quora, host a broad spectrum of questions and answers; others, like Stack Overflow, an online community for technology developers, target a specific industry. Still others, like the communities run by Apple and Microsoft, are geared toward the products and services sold by a particular company.

These online communities can be a boon for businesses: they can unlock user knowledge, reducing customer-service labor costs and wait times, all while providing better answers to customer queries. But only if they stick around. Like Yahoo Answers, many of these communities have languished or disappeared completely, including Walmart Moms and Generation Benz.

Bassamboo and collaborators Neha Sharma, a Kellogg doctoral candidate in operations, and Gad Allon from the University of Pennsylvania wanted to understand the factors driving online-community success and failure, and what such forums can do to perform better. They define success in this context as growing the number of users and, critically, maximizing the proportion of users’ questions that get answered. After all, if a community attracts a barrage of questions, but only a tiny fraction receives answers, the site is unlikely to flourish.

Online communities “need to balance their growing user base and make sure enough people get answers to sustain that base over time,” Sharma says.

Sharma, Allon, and Bassamboo conducted a study—named a finalist in the IBM Best Service Science Student Paper competition—that modeled online-community dynamics to understand how changing the cost of asking a question would impact user participation and platform sustainability.

They found that moderately increasing the cost of asking—such as through penalties for vague questions—improved the proportion of questions answered, making the community more sustainable. “There’s a sweet spot between too low a cost and too high of one for asking questions that is best for these communities,” Bassamboo says.

Understanding Online Communities

To shed light on online-community dynamics, the researchers built a dynamic model of such systems using concepts from game theory.

Bassamboo points out key features of the model: “There are two kinds of users coming through the door: those coming to ask questions and those coming to answer; and the people providing answers can also ask questions.”

Across users, the key factor is whether participating in the community is worth their while—the payoff could be from having a question answered or from enjoying a good reputation as someone who provides useful answers. “The idea is that people aren’t just providing answers out of the goodness of their heart,” Bassamboo says. “There has to be something in it for them.”

“There’s a sweet spot between too low a cost and too high of one for asking questions that is best for these communities.”

— Achal Bassamboo

As such, changing the platform’s rules of engagement can have a large impact on the functioning of the community and incentives for participation. Specifically, the researchers manipulated how easy it was for hypothetical users to ask a question—or “the personal cost to asking a question,” as Bassamboo puts it.

Sharma describes the different types of costs questions can incur: In Stack Overflow, for instance, “you get a violation if your question seems like a homework question or overly big or complicated. In some systems you get penalized for asking a question that was already answered. That helps users decide whether they want to ask a given question or not.” Similarly, those who answer questions consider the chance that their answer will be considered the best one, typically determined by the asker, yielding reputation points for the answerer.

Guiding the research was a key question: How would raising the cost of asking a question affect the health of the online community?

The Benefit of Question Costs

The researchers ended up with a somewhat unintuitive answer.

“The intuitive guess would be that there would be a threshold cost of asking a question above which the platform would collapse and below which it would survive,” Bassamboo says. “So, if the cost of asking a question is very low, you should have lots of users on the platform, but as it goes up, the number of users goes down and the platform would die.”

In contrast to that linear relationship, the research findings suggest a sweet spot where a moderate cost of asking questions is optimal for the online community’s functioning. “When you increase the cost of asking questions,” Sharma says, “fewer people ask, but it increases the probability a question gets an answer. When people who ask get answers, they are more satisfied and stay on the platform, and the user base becomes sustainable over time.”

Looking at it another way, if the cost of asking questions is very small, a large number of people ask questions, and that results in lots of competition for the attention of users who may be able to provide answers. “All the questions are fighting for the attention from the same finite number of people in that community,” Sharma says. “Then the probability of getting an answer to a specific question goes down, and people drop out and stop asking questions.”

Indeed, the researchers think of the quality of the online community as determined largely by the proportion of questions that are answered. Bassamboo illustrates that idea with a personal example: “If I’m doing homework with my kids and we Google a question, we get very excited when we find a place where someone asked that same question. But it’s disappointing when you see there’s no response to the question. It feels like the end of the road.”

The implication is that imposing a moderate cost on asking questions and thus raising the share of questions answered can improve the overall quality, effectiveness, and sustainability of online communities.

Getting More Questions Answered

The findings point to practical advice for those seeking to develop robust online communities.

“You want a community where there are not only good questions asked but answers to those questions,” Bassamboo says. “So you want to raise the bar of asking a question by penalizing weak or vague questions, resulting in more pinpointed, specific questions. That’s where it’s worth expending some effort and energy.”

For example, a community could go as far as blocking the IP addresses of those whose questions are repeatedly considered weak. Or a community might seek to improve the proportion of questions answered by directing questions to certain participants who are more likely to provide a good answer. “If the system knows you might have the answer, it should be structured to match questions with you,” Bassamboo says.

Sharma notes another, even more effective way high-profile communities are boosting answer rates: “On Apple’s platform, the cost of asking questions isn’t very high. So they’ve spent some money placing their own representatives on the platform to answer harder questions. That way it avoids the situation where people with the hard questions never get an answer because it was never viewed by someone knowledgeable enough to answer it.”

Featured Faculty

Member of the Department of Managerial Economics & Decision Sciences from 2005-2016

Charles E. Morrison Professor of Decision Sciences; Professor of Operations; Co-Director of MMM Program

About the Writer

Sachin Waikar is a freelance writer based in Evanston, Illinois.

About the Research

Sharma, Neha, Gad Allon, and Achal Bassamboo. 2022. “Structuring Online Communities.” Working paper.

Read the original

Most Popular This Week
  1. What Went Wrong with FTX—and What’s Next for Crypto?
    One key issue will be introducing regulation without strangling innovation, a fintech expert explains.
    stock trader surrounded by computer monitors
  2. How Experts Make Complex Decisions
    By studying 200 million chess moves, researchers shed light on what gives players an advantage—and what trips them up.
    two people playing chess
  3. What Donors Need to Hear to Open the Checkbook
    Insights from marketing on how charities can grow by appealing to different kinds of donors.
  4. The Complicated Logic Behind Donating to a Food Pantry Rather than Giving a Hungry Person Cash
    If we were in need, we’d likely want money. So what accounts for that difference?
    Donating food is paternalistic aid
  5. To Improve Fundraising, Give Donors a Local Connection
    Research offers concrete strategies for appealing to donors who want to make an impact.
    Charity appeals that frame the message around local connection tend to be more successful as a result of the proximity effect
  6. Podcast: What the FTX Meltdown Means for the Future of Crypto
    The implosion of the crypto exchange has sent the industry reeling. We dig into what happened and whether cryptocurrency, as a concept, can weather the storm.
  7. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  8. How You Can Make a More Positive Social Impact
    A 3-step guide to becoming a more thoughtful consumer and donor.
    person with money deciding which box to put it in.
  9. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  10. Why Well-Meaning NGOs Sometimes Do More Harm than Good
    Studies of aid groups in Ghana and Uganda show why it’s so important to coordinate with local governments and institutions.
    To succeed, foreign aid and health programs need buy-in and coordination with local partners.
  11. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  12. How Much Do Campaign Ads Matter?
    Tone is key, according to new research, which found that a change in TV ad strategy could have altered the results of the 2000 presidential election.
    Political advertisements on television next to polling place
  13. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  14. Take 5: The Upside of Failure
    A look at the surprising benefits of striking out, and how to make the most of your mistakes.
    Scientists who experienced an early-career setback succeeded more in the long run, new research shows.
  15. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  16. To Get Employees Back to the Office, Address These 4 Frictions
    An innovation expert explains how to meet resistance head-on.
    employees encounter obstacles in front of their office
More in Operations