Search engines are big business—look no further than Google, which reported revenues of $37.9 billion in 2011. And advertising, in the form of sponsored search results, is a massive driver of these revenues. Anyone who uses Google has seen these sponsored search advertisements alongside or above the “organic” results produced by Google’s vaunted PageRank algorithm.
to your inbox.
At Google and other search sites, advertisers bid for search terms in auctions run by the search engine; higher bids typically result in more prominent placement for the accompanying ads. But because advertisers pay the search engine only when users actually click on these ads, the Googles of the world have a strong incentive to analyze which ads are successful and, when deciding the winning bidder, consider that expected performance along with the amount of the bid. At the same time, any search engine must take its own users’ interests into account when displaying sponsored search ads, which may not always line up with the interests of its advertisers.
The dynamics of this incredibly lucrative marketplace intrigued Song Yao, an assistant professor of marketing at the Kellogg School of Management, who wanted to know how the interactions between search engines, users, and advertisers affect profits and consumer satisfaction. “As a consumer and search engine user myself, I noticed these sponsored ads, and I wanted to learn about the processes behind them,” he says. But since almost no empirical data about these outcomes existed, Yao decided to design a model that could be used as a foundation for exploring financial outcomes of keyword markets for search engines and their advertisers, as well as the welfare of search engine users.
Sponsored search ad auctions are an example of two-sided markets: the search engine connects two separate groups (advertisers and users) who hope to benefit from each other. Credit card companies, HMOs, and ad-supported social networks like Facebook and Twitter also engage in two-sided markets. In an ideal two-sided market, all three actors in the system benefit from the interaction. In the case of sponsored search ads, an ideally balanced system would generate healthy profits for the search engine, supply advertisers with a sustainable customer conversion rate for their keyword bids, and display relevant ads to the right customers without degrading their searching experience on the site.
Maintaining this tricky balance is key to any search engine’s success, and not surprisingly, Google closely guards the details of its keyword-auction algorithm. In order to test his sponsored search advertising model, Yao obtained real-world data on user behavior, advertiser bidding, and keyword auction pricing from a smaller search engine (which, for the purposes of Yao’s research, remained anonymous). “We wanted to build a general framework in which we can try to calibrate the parameters that are guiding the behavior of these three parties,” Yao says.
A policy allowing sorting and filtering increased consumer welfare by 3.8 percent, and the negative effects on advertisers reduced the attendant search engine profits by 2.6 percent.
Yao and his co-author, Carl F. Mela, a professor at Duke University, investigated the financial and user-satisfaction impact of three different policies that the anonymous search engine might implement with regard to its sponsored search ads. The first was allowing users to sort and filter search results. “Intuitively, this should increase customer satisfaction—for example, if I go to Expedia and search only for four-star hotels, I’m going to get the results I want much easier than if I saw a list including three- and two-star hotels,” Yao explains. “The problem with filtering from the advertiser’s perspective is that if I win the keyword auction, the result may be filtered out by the user, so my incentive for participating in the auction may be lower.”
When applied to the data, Yao and Mela’s model bore out these assumptions: a policy allowing sorting and filtering increased consumer welfare by 3.8 percent, and the negative effects on advertisers reduced the attendant search engine profits by 2.6 percent. However, the model also showed that in the long run, this better user experience enhanced overall profits for the search engine by 2.9 percent. The change would attract more searchers, which would increase exposure for ads that do not get filtered out. “There’s a loss on the ad side, but the net effect of offering sorting and filtering features is positive,” Yao says.
Another policy that Yao and Mela considered was market segmenting and targeting. When a search engine allows targeted and segmented markets in its keyword auctions, it reduces competition among bids because the advertisers may bid in different markets, potentially lowering the search engine’s revenue. But it also allows advertisers to bid on the customers they actually want, which results in high-quality ads that users find useful. Yao’s model proved both assumptions correct. Plus, market segmenting and targeting resulted in a 1 percent increase in revenue for the search engine. “Because both parties in the market [the advertisers and users] are happy, the search engine benefits too,” Yao says. “It’s win-win-win.”
The last search engine policy was implementing second-price auctions in keyword markets. Unlike first-price auctions, in which the winning bidder must pay the amount that they bid on the item, second-price auctions (such as those run by Google’s keyword markets) allow the winning bidder to pay the amount bid by the “highest loser” instead. If the winning bid on a keyword is $10, and the next highest bid was $9, the winner pays $9 instead of $10.
“Economic theory says that this will make advertisers change their bidding behavior,” Yao says. “If I’m in a first-price auction, I’ll shave or reduce my bid a bit because I know I’ll actually have to pay that amount if I win, and I don’t want to overbid. But if I’m in a second-price auction, I know that if I win I’ll pay less than what I bid anyway, so I’ll just bid an amount that actually matches how I value the item.”
Yao and Mela’s model empirically validated the economic theory that second-price auctions encourage this “truth-telling” behavior from bidders: second-price keyword bids averaged 98 percent of their valuations, whereas first-price bids averaged only 70 percent. However, the model also showed that this second-price bidding behavior had a negligible effect on search engine revenues, which is consistent with existing theories on auctions.
The value of his model comes from precisely this kind of empirical validation of “things we already expect,” Yao says. “Without doing this kind of research, we’ll never know whether these things we intuit or theorize about economic behavior are actually true, and we’ll never know the magnitude of the effects.” Yao is working on integrating his model “to apply to more contexts besides search engines,” such as the online microlending markets at Kiva.org. He admits that any search engines that implement his model are unlikely to acknowledge his contribution, because “these things become trade secrets.”
But he says that advertisers can also benefit from modeling the dynamics of the sponsored search markets they participate in. “Advertisers call me all the time, because these markets are like a black box to them,” Yao says. “But by using this model, they may be able to start to see inside.”
Related reading on Kellogg Insight
Yao, Song and Carl F. Mela. 2011. “A Dynamic Model of Sponsored Search Advertising.” Marketing Science. 30: 447-468.
Will AI Eventually Replace Doctors?Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
What Is the Purpose of a Corporation Today?Has anything changed in the three years since the Business Roundtable declared firms should prioritize more than shareholders?
What Happens to Worker Productivity after a Minimum Wage Increase?A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
3 Tips for Reinventing Your Career After a LayoffIt’s crucial to reassess what you want to be doing instead of jumping at the first opportunity.
Why We Can’t All Get Away with Wearing Designer ClothesIn certain professions, luxury goods can send the wrong signal.
Why You Should Skip the Easy Wins and Tackle the Hard Task FirstNew research shows that you and your organization lose out when you procrastinate on the difficult stuff.
Which Form of Government Is Best?Democracies may not outlast dictatorships, but they adapt better.
6 Takeaways on Inflation and the Economy Right NowAre we headed into a recession? Kellogg’s Sergio Rebelo breaks down the latest trends.
How Are Black–White Biracial People Perceived in Terms of Race?Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
When Do Open Borders Make Economic Sense?A new study provides a window into the logic behind various immigration policies.
How Old Are Successful Tech Entrepreneurs?A definitive new study dispels the myth of the Silicon Valley wunderkind.
How Has Marketing Changed over the Past Half-Century?Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
Why Do Some People Succeed after Failing, While Others Continue to Flounder?A new study dispels some of the mystery behind success after failure.
How to Get the Ear of Your CEO—And What to Say When You Have ItEvery interaction with the top boss is an audition for senior leadership.
Understanding the Pandemic’s Lasting Impact on Real EstateWork-from-home has stuck around. What does this mean for residential and commercial real-estate markets?
Immigrants to the U.S. Create More Jobs than They TakeA new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
Podcast: What to Expect When Joining a Family-Owned BusinessThere are cons—but a lot of pros, too. On this episode of The Insightful Leader, we’ll explore what it’s like to work at a family business when you’re not a family member.