How Well Does COVID Public Policy Align with Science?
Skip to content
Podcast | Insight Unpacked Season 1: Extraordinary Brands and How to Build Them
Policy Jan 7, 2021

How Well Does COVID Public Policy Align with Science?

In an era of misinformation, policy based on “dubious science” could mean a greater loss of life and economic hardship.

Epidemiologist and Politician give news conference

Yevgenia Nayberg

Based on the research of

Yian Yin

Jian Gao

Benjamin F. Jones

Dashun Wang

The rapid development of effective COVID-19 vaccines is a powerful example of how the business world and the scientific world can successfully work in tandem. But there is a thornier, related question: How well does public policy coevolve with science?

In the context of a major existential threat like the COVID pandemic, that means examining how well national, state, and local policies on social distancing, school and business closures, mask wearing, and the like align with the latest scientific findings on the virus.

The issue is critical because any disconnect between science and policy could mean a much greater loss of life and economic hardship. Indeed, there has been general skepticism about how well the science and policy communities communicate, and concern about how well policymakers can differentiate well-supported scientific ideas from less-established ones.

Add Insight
to your inbox.

We’ll send you one email a week with content you actually want to read, curated by the Insight team.

COVID-19 has presented a unique opportunity to study the link between policy and science. “It has been difficult in the past to quantify the impact of science on policymaking, especially in global and fast-moving contexts,” says Dashun Wang, an associate professor of management and organizations at Kellogg and director of Kellogg’s Center for Science of Science and Innovation (CSSI).

To understand the coevolution of science and policy, Wang and colleague Ben Jones, a Kellogg strategy professor, along with CSSI researchers Jian Gao, a Kellogg postdoctoral research fellow, and Yian Yin, a McCormick doctoral student, analyzed tens of thousands of policy documents worldwide. They studied the scientific research those documents drew on, as well as COVID-related documents from intergovernmental organizations like the World Health Organization (WHO). They were interested in how the type and volume of policy documents was influenced by the number of COVID cases in a country, as well as how closely policymaking relied on scientific research.

Overall, their study revealed good news: “We found that global policy attention to COVID-19 closely follows the number of cases and draws heavily on the rapidly evolving science,” Wang says. “And COVID policies rely on validated science. So there’s great synchrony between policy attention, the realities of the outbreak, and sound research.”

How Policy Evolves

To get at links between COVID case rates, policy, and science, the researchers analyzed over 37,000 policy documents across 114 countries—all major economies except mainland China—from the start of 2020 through May 26. This included publications from government agencies, think tanks, and IGOs. They also scrutinized the scientific research cited in the policy documents.

They started by comparing policy documents focused specifically on COVID with all other policy documents. They found that the share of COVID policy documents represented within the total policy documents followed a nearly identical trajectory to the number of confirmed cases worldwide. As the number of cases went up, so did the level of policy attention.

“In an era of misinformation, some good news is that policy documents emphasize vetted science, including the latest science.”

— Ben Jones

And the volume of policy documents wasn’t the only measure that followed pandemic trends; the focus of policy shifted, as well. As COVID-19 effects shifted from strictly health-related to socioeconomic concerns—business closures and unemployment, for example—the number and share of policies related to those areas increased. For example, policy documents in January and February 2020 focused mostly on medical and public health issues, but the share of economy-related documents rose starting in mid-March, as governments started contemplating and implementing shutdown orders.

Importantly, the team also studied the recency and quality of the scientific research on which policy documents relied.

“Do they actually use good science or dubious science?” Wang says.

One concern has been around scientific-article “preprints,” which are papers that have not yet been peer-reviewed. “There has been a flood of COVID research on preprint servers,” Jones says. “Some of these papers have received massive media attention only to be discredited later.”

The researchers found that pandemic-related policy documents drew on not only extremely recent science but also work that had been peer-reviewed. For example, nearly 20 percent of papers cited in COVID-related policy documents were published in 2020, about 10 times the rate seen for non-COVID policy documents. And the articles tended to be those published in respected medical-research journals like The Lancet.

Moreover, the papers cited by pandemic policy documents were more likely to be those referred to more often by other scientific papers, a typical measure of research quality. Research referenced in policy papers had 40 times more citations, on average, than a broader set of COVID research articles not included in policy documents. “This was important because we know science had a very strong response to COVID-19, as the fast pace of vaccine development suggests,” Wang says. “So it’s good to know that policy kept up.”

IGOs as Policy Conduits

Last, the researchers examined the role of governments and intergovernmental organizations (IGOs) in promoting pandemic-related policies.

The results suggest that the policies and communications of large, well-known IGOs like the WHO are critical in tying cross-border policies together and drawing science into policy.

“IGOs, especially the WHO, are a key conduit in absorbing science and then publishing related policy documents,” Jones says. “Then those policy documents are cited worldwide.” As the authors write, national governments “consume science largely indirectly through the IGOs.”

Moreover, when more countries and regions follow the same IGO guidelines, the result is a more unified, consistent response. But some countries, including the U.S., have been “antagonistic” toward large IGOs like the WHO, Wang notes, which can lead to policies less in line with well-documented science. This could potentially mean fragmented implementation and negative health and economic consequences.

“In an era of misinformation, some good news is that policy documents emphasize vetted science, including the latest science,” Jones says. “But different countries behave differently, and science is heard unevenly.”

That begs an important question: Is there a link between how individual countries and governments use science to inform their COVID-related policy and how well they manage the pandemic?

That’s exactly what the Kellogg team is looking into now, Wang explains. “We’re investigating country-level heterogeneity in leveraging science for policymaking, and what the consequences of that are for critical outcomes like citizens’ health.”

Featured Faculty

Gordon and Llura Gund Family Professor of Entrepreneurship; Professor of Strategy; Faculty Director, Kellogg Innovation and Entrepreneurship Initiative (KIEI)

Professor of Management & Organizations; Professor of Industrial Engineering & Management Sciences (Courtesy)

About the Writer
Sachin Waikar is a freelance writer based in Evanston, Illinois.
About the Research
Yin, Yian, Jian Gao, Benjamin F. Jones, and Dashun Wang. 2021. “Coevolution of Policy and Science during the Pandemic.” Science.
Most Popular This Week
  1. Your Team Doesn’t Need You to Be the Hero
    Too many leaders instinctively try to fix a crisis themselves. A U.S. Army colonel explains how to curb this tendency in yourself and allow your teams to flourish.
    person with red cape trying to put out fire while firefighters stand by.
  2. What Triggers a Career Hot Streak?
    New research reveals a recipe for success.
    Collage of sculptor's work culminating in Artist of the Year recognition
  3. What’s the Secret to Successful Innovation?
    Hint: it’s not the product itself.
    standing woman speaking with man seated on stool
  4. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  5. How Much Do Campaign Ads Matter?
    Tone is key, according to new research, which found that a change in TV ad strategy could have altered the results of the 2000 presidential election.
    Political advertisements on television next to polling place
  6. What Went Wrong with FTX—and What’s Next for Crypto?
    One key issue will be introducing regulation without strangling innovation, a fintech expert explains.
    stock trader surrounded by computer monitors
  7. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  8. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  9. How Experts Make Complex Decisions
    By studying 200 million chess moves, researchers shed light on what gives players an advantage—and what trips them up.
    two people playing chess
  10. Yes, Consumers Care if Your Product Is Ethical
    New research shows that morality matters—but it’s in the eye of the beholder.
    woman chooses organic lettuce in grocery
  11. Why Well-Meaning NGOs Sometimes Do More Harm than Good
    Studies of aid groups in Ghana and Uganda show why it’s so important to coordinate with local governments and institutions.
    To succeed, foreign aid and health programs need buy-in and coordination with local partners.
  12. Product Q&A Forums Hold a Lot of Promise. Here’s How to Make Them Work.
    The key to these online communities, where users can ask and answer questions, is how many questions get useful answers.
    man sits at computer reading Q&A forum
  13. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  14. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  15. What the New Climate Bill Means for the U.S.—and the World
    The Inflation Reduction Act won’t reverse inflation or halt climate change, but it's still a big deal.
    energy bill with solar panels wind turbines and pipelines
  16. Post-War Reconstruction Is a Good Investment
    Ukraine’s European neighbors will need to make a major financial commitment to help rebuild its economy after the war. Fortunately, as the legacy of the post–World War II Marshall Plan shows, investing in Ukraine's future will also serve Europe's own long-term interests.
    two people look out over a city
  17. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  18. The Political Divide in America Goes Beyond Polarization and Tribalism
    These days, political identity functions a lot like religious identity.
    people engage in conflict with swords
More in Policy