How Well Does COVID Public Policy Align with Science?
Skip to content
Policy Jan 7, 2021

How Well Does COVID Public Policy Align with Science?

In an era of misinformation, policy based on “dubious science” could mean a greater loss of life and economic hardship.

Epidemiologist and Politician give news conference

Yevgenia Nayberg

Based on the research of

Yian Yin

Jian Gao

Benjamin F. Jones

Dashun Wang

The rapid development of effective COVID-19 vaccines is a powerful example of how the business world and the scientific world can successfully work in tandem. But there is a thornier, related question: How well does public policy coevolve with science?

In the context of a major existential threat like the COVID pandemic, that means examining how well national, state, and local policies on social distancing, school and business closures, mask wearing, and the like align with the latest scientific findings on the virus.

The issue is critical because any disconnect between science and policy could mean a much greater loss of life and economic hardship. Indeed, there has been general skepticism about how well the science and policy communities communicate, and concern about how well policymakers can differentiate well-supported scientific ideas from less-established ones.

COVID-19 has presented a unique opportunity to study the link between policy and science. “It has been difficult in the past to quantify the impact of science on policymaking, especially in global and fast-moving contexts,” says Dashun Wang, an associate professor of management and organizations at Kellogg and director of Kellogg’s Center for Science of Science and Innovation (CSSI).

To understand the coevolution of science and policy, Wang and colleague Ben Jones, a Kellogg strategy professor, along with CSSI researchers Jian Gao, a Kellogg postdoctoral research fellow, and Yian Yin, a McCormick doctoral student, analyzed tens of thousands of policy documents worldwide. They studied the scientific research those documents drew on, as well as COVID-related documents from intergovernmental organizations like the World Health Organization (WHO). They were interested in how the type and volume of policy documents was influenced by the number of COVID cases in a country, as well as how closely policymaking relied on scientific research.

Overall, their study revealed good news: “We found that global policy attention to COVID-19 closely follows the number of cases and draws heavily on the rapidly evolving science,” Wang says. “And COVID policies rely on validated science. So there’s great synchrony between policy attention, the realities of the outbreak, and sound research.”

How Policy Evolves

To get at links between COVID case rates, policy, and science, the researchers analyzed over 37,000 policy documents across 114 countries—all major economies except mainland China—from the start of 2020 through May 26. This included publications from government agencies, think tanks, and IGOs. They also scrutinized the scientific research cited in the policy documents.

They started by comparing policy documents focused specifically on COVID with all other policy documents. They found that the share of COVID policy documents represented within the total policy documents followed a nearly identical trajectory to the number of confirmed cases worldwide. As the number of cases went up, so did the level of policy attention.

“In an era of misinformation, some good news is that policy documents emphasize vetted science, including the latest science.”

— Ben Jones

And the volume of policy documents wasn’t the only measure that followed pandemic trends; the focus of policy shifted, as well. As COVID-19 effects shifted from strictly health-related to socioeconomic concerns—business closures and unemployment, for example—the number and share of policies related to those areas increased. For example, policy documents in January and February 2020 focused mostly on medical and public health issues, but the share of economy-related documents rose starting in mid-March, as governments started contemplating and implementing shutdown orders.

Importantly, the team also studied the recency and quality of the scientific research on which policy documents relied.

“Do they actually use good science or dubious science?” Wang says.

One concern has been around scientific-article “preprints,” which are papers that have not yet been peer-reviewed. “There has been a flood of COVID research on preprint servers,” Jones says. “Some of these papers have received massive media attention only to be discredited later.”

The researchers found that pandemic-related policy documents drew on not only extremely recent science but also work that had been peer-reviewed. For example, nearly 20 percent of papers cited in COVID-related policy documents were published in 2020, about 10 times the rate seen for non-COVID policy documents. And the articles tended to be those published in respected medical-research journals like The Lancet.

Moreover, the papers cited by pandemic policy documents were more likely to be those referred to more often by other scientific papers, a typical measure of research quality. Research referenced in policy papers had 40 times more citations, on average, than a broader set of COVID research articles not included in policy documents. “This was important because we know science had a very strong response to COVID-19, as the fast pace of vaccine development suggests,” Wang says. “So it’s good to know that policy kept up.”

IGOs as Policy Conduits

Last, the researchers examined the role of governments and intergovernmental organizations (IGOs) in promoting pandemic-related policies.

The results suggest that the policies and communications of large, well-known IGOs like the WHO are critical in tying cross-border policies together and drawing science into policy.

“IGOs, especially the WHO, are a key conduit in absorbing science and then publishing related policy documents,” Jones says. “Then those policy documents are cited worldwide.” As the authors write, national governments “consume science largely indirectly through the IGOs.”

Moreover, when more countries and regions follow the same IGO guidelines, the result is a more unified, consistent response. But some countries, including the U.S., have been “antagonistic” toward large IGOs like the WHO, Wang notes, which can lead to policies less in line with well-documented science. This could potentially mean fragmented implementation and negative health and economic consequences.

“In an era of misinformation, some good news is that policy documents emphasize vetted science, including the latest science,” Jones says. “But different countries behave differently, and science is heard unevenly.”

That begs an important question: Is there a link between how individual countries and governments use science to inform their COVID-related policy and how well they manage the pandemic?

That’s exactly what the Kellogg team is looking into now, Wang explains. “We’re investigating country-level heterogeneity in leveraging science for policymaking, and what the consequences of that are for critical outcomes like citizens’ health.”

Featured Faculty

Gordon and Llura Gund Family Professor of Entrepreneurship; Professor of Strategy

Professor of Management & Organizations; Professor of Industrial Engineering & Management Sciences (Courtesy), Director, Center for Science of Science and Innovation (CSSI)

About the Writer
Sachin Waikar is a freelance writer based in Evanston, Illinois.
About the Research
Yin, Yian, Jian Gao, Benjamin F. Jones, and Dashun Wang. 2021. “Coevolution of Policy and Science during the Pandemic.” Science.
Most Popular This Week
  1. One Key to a Happy Marriage? A Joint Bank Account.
    Merging finances helps newlyweds align their financial goals and avoid scorekeeping.
    married couple standing at bank teller's window
  2. Take 5: Yikes! When Unintended Consequences Strike
    Good intentions don’t always mean good results. Here’s why humility, and a lot of monitoring, are so important when making big changes.
    People pass an e-cigarette billboard
  3. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  4. Will AI Eventually Replace Doctors?
    Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
    doctors offices in small nodules
  5. Entrepreneurship Through Acquisition Is Still Entrepreneurship
    ETA is one of the fastest-growing paths to entrepreneurship. Here's how to think about it.
    An entrepreneur strides toward a business for sale.
  6. Take 5: Research-Backed Tips for Scheduling Your Day
    Kellogg faculty offer ideas for working smarter and not harder.
    A to-do list with easy and hard tasks
  7. How to Manage a Disengaged Employee—and Get Them Excited about Work Again
    Don’t give up on checked-out team members. Try these strategies instead.
    CEO cheering on team with pom-poms
  8. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  9. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  10. The Appeal of Handmade in an Era of Automation
    This excerpt from the book “The Power of Human" explains why we continue to equate human effort with value.
    person, robot, and elephant make still life drawing.
  11. 2 Factors Will Determine How Much AI Transforms Our Economy
    They’ll also dictate how workers stand to fare.
    robot waiter serves couple in restaurant
  12. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  13. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  14. Sitting Near a High-Performer Can Make You Better at Your Job
    “Spillover” from certain coworkers can boost our productivity—or jeopardize our employment.
    The spillover effect in offices impacts workers in close physical proximity.
  15. How the Wormhole Decade (2000–2010) Changed the World
    Five implications no one can afford to ignore.
    The rise of the internet resulted in a global culture shift that changed the world.
  16. What’s at Stake in the Debt-Ceiling Standoff?
    Defaulting would be an unmitigated disaster, quickly felt by ordinary Americans.
    two groups of politicians negotiate while dangling upside down from the ceiling of a room
  17. What Happens to Worker Productivity after a Minimum Wage Increase?
    A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
    employees unload pallets from a truck using hand carts
  18. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  19. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  20. 3 Traits of Successful Market-Creating Entrepreneurs
    Creating a market isn’t for the faint of heart. But a dose of humility can go a long way.
    man standing on hilltop overlooking city
More in Policy