To Better Measure Economic Uncertainty, Look Beyond the Stock Market
Skip to content
Economics Aug 2, 2021

To Better Measure Economic Uncertainty, Look Beyond the Stock Market

Incorporating news sources, surveys, and even Twitter conversations can help give policymakers more nuanced data.

man watches business report on television with bills on table

Yevgenia Nayberg

Based on the research of

David Altig

Scott R. Baker

Jose Maria Barrero

Nick Bloom

Phil Bunn

Scarlet Chen

et al.

High levels of economic uncertainty usually set off alarm bells among economists. After all, uncertainty about future conditions can immobilize complex economic systems, dampening consumer spending, prompting businesses to freeze investments or pause hiring of workers, and driving up the cost of credit.

So when COVID-19 arrived along with massive economic uncertainty, policymakers scrambled to stabilize the economy. And in order to craft an effective response, many turned to the “gold standard” for measuring economic uncertainty, an index called the VIX.

Yet some economists, including Kellogg’s Scott R. Baker, had thought for years that the VIX was not giving policymakers a full-enough picture. VIX is tied to the stock market; a more complete measure of economic uncertainty, they argued, should draw from a broader suite of metrics, including the opinions of business leaders, journalists, and even regular people.

Several economists, including Baker, had previously developed other metrics for uncertainty. So in the spring of 2020 when Covid hit, Baker and 14 colleagues collaborated on research to compare how various metrics could offer a more granular understanding of uncertainty.

Add Insight
to your inbox.

They found that while all measures recorded a steep rise in economic uncertainty, there were some important—and revealing—differences.

The researchers hope their work will encourage policymakers to look beyond the use of stock market–based metrics as a sole measure of economic uncertainty.

“If you, as a policymaker, had been using mostly the VIX as a gauge of uncertainty in the months after the pandemic took hold, you would have seen it drop fairly quickly because Wall Street was calmed by government policy,” Baker says. “But businesses and households were feeling a tremendous amount of uncertainty about the economy, and about what the government was going to do, for a much longer period of time.”

More Perspectives on Uncertainty

Baker and his coauthors represent universities in England, France, Mexico, and the U.S., as well as the Federal Reserve Bank of Atlanta and the Bank of England. In their research collaboration, they trained all of their previously developed uncertainty measures on the same moment: the early months of the COVID-19 pandemic.

Among the new measures is the daily Economic Policy Uncertainty Index, developed by Baker and colleagues in 2016. The index culls through roughly two thousand U.S. newspapers and records daily logs of the number of articles that include the words “economics,” “policy,” and “uncertainty”—or some variant thereof. Values above 100 reflect higher-than-average uncertainty; in March and April 2020, the daily EPU shot to over 500, its highest scores on record.

Another new metric took a similar tack, except it trained its sights on Twitter. This index collected worldwide tweets containing the words “economic” and “uncertainty” (along with their variants) posted between January 1, 2020, and June 1, 2020—roughly 175,000 in total. When the researchers charted the weekly number of tweets containing these terms, they found a nearly identical pattern in uncertainty levels as that displayed by the daily EPU.

“We’ve shown that these metrics can produce very high-quality measures of uncertainty that are consistent with more long-standing and storied metrics.”

— Scott Baker

The third uncertainty measure the researchers tested was an aggregation of results from business expectation surveys, specifically, the U.S.-focused Survey of Business Uncertainty and the U.K.-focused Decision Maker Panel. Both surveys recruit participants from a broad range of public and private companies and ask them to rate the likelihood of various growth scenarios for their businesses over the coming year, as well as how certain they are about those predictions. When the researchers aggregated those responses, they found that uncertainty showed pronounced increases in March and April 2020, and fell back slightly by May 2020.

A fourth uncertainty metric zeroed in on levels of disagreement among professional economic forecasters in the U.S. and the U.K.—specifically, those commenting on likely GDP growth rates one year ahead. The researchers found that disagreement among the forecasters surged to historic levels during the pandemic, with U.S. forecaster disagreement rising eightfold between the first and second quarter of 2020 and U.K. forecaster disagreement jumping twentyfold during that same period.

Finally, the researchers compared these uncertainty measures with the VIX, the Chicago Board Options Exchange’s CBOE Volatility Index. The traditional gold standard in forward-looking economic uncertainty measurement, the VIX calculates its values based on S&P 500 index options prices and registers high levels of financial market uncertainty when the expected change in those prices over the near- or medium-term is high.

The researchers found that the one-month VIX rose from a value of 15 in January 2020 to its highest-ever value of 82.7 on March 16, 2020, and then fell back to below 30 by early May.

Getting More Granular in Looking at Uncertainty

In looking across all of these measures, the researchers were struck by the overwhelming evidence of COVID-19’s far-reaching impact. Indeed, all of the researchers’ metrics, both old and new, charted a quick rise in uncertainty in the wake of the pandemic; most reached all-time peaks.

However, differences across measurements help shed light on how distinct parts of the economy reacted differently during the early months of the pandemic. For example, the researchers find, the duration of peak uncertainty—and the point when it was most pronounced—differed from one measure to the next.

This could be seen in comparing the news-based and Twitter measures to the VIX. Those first two measurements showed continued uncertainty among regular people long after the stock market–based VIX started to level off. This is important for policymakers to know since, of course, the economy is comprised of far more than just financial markets.

“A traditional measure of financial-market volatility like the VIX is very squarely focused on the potential movement of equity prices over the near term,” Baker says, “whereas something like our news-based measure or the Twitter-based measure is more relevant to what households are experiencing more broadly.”

A “Menu of New Measures” Available to Decision Makers

Baker hopes the research helps policymakers take into account a wider range of metrics when making decisions about quelling economic uncertainty. For one thing, he explains, it’s important that the measures be as nimble and rapidly responsive as the economic shocks themselves.

“In the face of really fast-moving shocks where the government is making decisions very rapidly about tremendously huge policy responses—fiscal stimulus, monetary policy, unemployment insurance, regulatory changes, and so on—I think we’ve shown that these metrics can produce very high-quality measures of uncertainty that are consistent with more long-standing and storied metrics,” Baker says.

Policymakers and academics, he says, “can choose the measure that’s most relevant for their purposes rather than reaching for the only one that’s available, which was the situation prior to 10 years ago, when a lot of these alternatives didn’t exist.”

About the Writer

Katie Gilbert is a freelance writer in Philadelphia.

About the Research

Altig, David, Scott Baker, Jose Maria Barrero, Nick Bloom, Phil Bunn, Scarlet Chen, Steve Davis, Julia Leather, Brent Meyer, Emil Mihaylov, Nick Parker, Thomas Renault, Pawel Smietanka, and Greg Thwaites. 2020. “Economic Uncertainty Before and During the COVID-19 Pandemic.” Journal of Public Economics. 191.

Read the original

Most Popular This Week
  1. Will AI Eventually Replace Doctors?
    Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
    doctors offices in small nodules
  2. What Is the Purpose of a Corporation Today?
    Has anything changed in the three years since the Business Roundtable declared firms should prioritize more than shareholders?
    A city's skyscrapers interspersed with trees and rooftop gardens
  3. What Happens to Worker Productivity after a Minimum Wage Increase?
    A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
    employees unload pallets from a truck using hand carts
  4. 3 Tips for Reinventing Your Career After a Layoff
    It’s crucial to reassess what you want to be doing instead of jumping at the first opportunity.
    woman standing confidently
  5. Why We Can’t All Get Away with Wearing Designer Clothes
    In certain professions, luxury goods can send the wrong signal.​
    Man wearing luxury-brand clothes walks with a cold wind behind him, chilling three people he passes.
  6. Why You Should Skip the Easy Wins and Tackle the Hard Task First
    New research shows that you and your organization lose out when you procrastinate on the difficult stuff.
    A to-do list with easy and hard tasks
  7. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  8. 6 Takeaways on Inflation and the Economy Right Now
    Are we headed into a recession? Kellogg’s Sergio Rebelo breaks down the latest trends.
    inflatable dollar sign tied down with mountains in background
  9. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  10. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  11. How Old Are Successful Tech Entrepreneurs?
    A definitive new study dispels the myth of the Silicon Valley wunderkind.
    successful entrepreneurs are most often middle aged
  12. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  13. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  14. How to Get the Ear of Your CEO—And What to Say When You Have It
    Every interaction with the top boss is an audition for senior leadership.
    employee presents to CEO in elevator
  15. Understanding the Pandemic’s Lasting Impact on Real Estate
    Work-from-home has stuck around. What does this mean for residential and commercial real-estate markets?
    realtor showing converted office building to family
  16. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  17. Podcast: What to Expect When Joining a Family-Owned Business
    There are cons—but a lot of pros, too. On this episode of The Insightful Leader, we’ll explore what it’s like to work at a family business when you’re not a family member.
More in Economics