How Useful Are ESG Ratings for Sustainable Investors?
Skip to content
Finance & Accounting Mar 25, 2021

How Useful Are ESG Ratings for Sustainable Investors?

These ratings are proliferating. Now there may be a better way to assess them.

investors surround a green building

Lisa Röper

Based on the research of

George Serafeim

Aaron Yoon

Investment funds that prioritize environmental, social, or governance considerations have proliferated in recent decades.

Add Insight
to your inbox.

Investment managers who employ these strategies (which are often gathered under the acronym “ESG”) might, for example, base investment decisions on companies’ carbon output, their employees’ safety on the job, or the percentage of women and minority leaders in top governance positions.

Fund managers who want to build strategies around such granular details need to interpret reams of data and parse ever-updating news and corporate reports. So more and more research firms are now addressing this growing need.

Some of these firms generate “ESG ratings”—a number (typically between 0 and 100) applied to individual companies that attempts to quantify their overall ESG performance. Each rating takes into account a large amount of information across various categories, and each firm producing such ratings uses a different formula. Sometimes, the result is that one company will be stamped with wildly divergent ESG ratings, leading some in the industry to complain that the ratings may be meaningless.

Others argue that, used correctly, the ratings could be a key to smarter investing.

Aaron Yoon, an assistant professor of accounting and information management at the Kellogg School, wanted to challenge the claims on both sides. On one hand, it was possible the ESG ratings didn’t hold water; on the other, it could be that investment managers were giving up on the ratings—and the broader ESG strategy—too easily.

“ESG ratings are a new type of performance evaluation like analyst forecasts or bond ratings,” Yoon says, “and they’ve never been really assessed because there hasn’t been a clear outcome variable.” In other words, while bond ratings and analyst forecasts make straightforward predictions that will eventually be judged against a specific future outcome, ESG ratings aren’t as easy to view as accurate or dead wrong, even with the benefit of hindsight.

“There’s a huge wave of money flowing into the ESG space. My research agenda is ... how can ESG ratings be used in a systematic way, to generate strong returns?”

— Aaron Yoon

In a new paper, Yoon and coauthor George Serafeim, at Harvard Business School, find a way to hold ESG ratings accountable. They test whether the ratings predict future ESG-relevant news about companies—whether this be good news, like a new eco-friendly initiative, or bad news, like a factory accident that injures workers.

They find that consensus ESG ratings do predict good and bad future ESG news, though this predictive ability weakens as disagreement between raters on a given company rises. However, the researchers come up with a profitable investment strategy that takes advantage of these disagreements.

In his previous research into the fast-growing ESG investment space, Yoon’s findings haven’t always reflected well on the industry. This newest paper, however, lends some credibility to the practice of applying and using ESG ratings.

“There’s a huge wave of money flowing into the ESG space,” Yoon says. “My research agenda is, how do we account for ESG? How do we quantify it so that it can be useful to investors? Or, to take it a step further, how can ESG ratings be used in a systematic way, to generate strong returns?”

Examining ESG Ratings’ Predictive Power

The researchers concentrate on the three ESG ratings providers with the most comprehensive coverage—MSCI, Sustainalytics, and Thomson Reuters.

To test whether the ratings predict future news, they average the three firms’ ratings to obtain a single ESG score for each individual company. Yoon and Serafeim then turn to a dataset from TruValue labs, a firm that tracks ESG-related news across thousands of companies and uses natural language processing to place the news on a spectrum of positive to negative. The TrueValue dataset summarized 31,854 firm-level ESG news observations between January 2010 and June 2018.

Comparing the two sets of data revealed that, indeed, ESG ratings were strongly correlated to the sentiment of future ESG news, with high ESG ratings predicting positive news stories and low ratings predicting negative ones.

However, that correlation started to diminish as soon as consensus among raters did; in the presence of significant disagreement, the predictive power of the ratings was much weaker.

The researchers then examined whether ESG ratings—and the level of disagreement among raters—had any effect on stock prices. To explore this, they first looked at reactions to ESG news by comparing a company’s share price one day prior to the news to the price one day after. As they expected, stock prices did respond—positively to good ESG news, and negatively to bad ESG news.

The next step was investigating whether ESG ratings seemed to change the way the good or bad ESG news was absorbed into prices. The researchers found that firms with low average ESG scores saw a bigger stock-price jump following positive ESG news (75 basis points, on average) than those with high ratings (only 34 basis points).

The researchers theorize that this is because companies with high ESG scores already had this good sentiment reflected in their stock prices, and more good news simply confirmed the market’s preconceptions.

The researchers took this finding a step further, by asking how an investment strategy might be designed to take advantage of the predictive abilities of ESG ratings.

First, they established which of the three ESG raters in their sample managed to most accurately forecast future ESG news—and found that this distinction went to MSCI. Next, they created a hypothetical investment portfolio in which they bought companies whose MSCI ESG rating was high and whose ESG ratings from Sustainalytics and Thomson Reuters were comparatively low. (They also did the inverse, selling firms whose MSCI rating was low and whose average of the other two ratings was high.) This high level of disagreement among raters—in tandem with a strong opinion from MSCI— was crucial to the strategy because it suggested that these may be the companies whose ESG performance wasn’t yet reflected in their stock prices.

The portfolio did indeed generate annualized alpha (that is, above-market returns) of 4.27 percent, indicating that the researchers’ strategy unearthed a real pattern surrounding ESG ratings and market response.

A Step Toward More Credibility

Investors who can swiftly take advantage of these discrepancies are poised to profit.

“The general complaint in the industry and in academia is that ESG ratings can have huge discrepancies among them,” Yoon says. “We’re saying, ‘this is how you can potentially take advantage of that.’”

But the even bigger takeaway, Yoon adds, concerns the broader debate about how to use ESG ratings—and whether they’re worth using at all.

“We find that ESG ratings do predict future ESG news,” he says, speculating that the findings will increase the ratings’ credibility.

Featured Faculty

Assistant Professor of Accounting & Information Management

About the Writer

Katie Gilbert is a freelance writer in Philadelphia.

About the Research

Serafeim, George, and Aaron Yoon. 2021. “Stock Price Reactions to ESG News: The Role of ESG Ratings and Disagreement.” Working paper.

Read the original

Most Popular This Week
  1. Will AI Eventually Replace Doctors?
    Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
    doctors offices in small nodules
  2. What Is the Purpose of a Corporation Today?
    Has anything changed in the three years since the Business Roundtable declared firms should prioritize more than shareholders?
    A city's skyscrapers interspersed with trees and rooftop gardens
  3. What Happens to Worker Productivity after a Minimum Wage Increase?
    A pay raise boosts productivity for some—but the impact on the bottom line is more complicated.
    employees unload pallets from a truck using hand carts
  4. 3 Tips for Reinventing Your Career After a Layoff
    It’s crucial to reassess what you want to be doing instead of jumping at the first opportunity.
    woman standing confidently
  5. Why We Can’t All Get Away with Wearing Designer Clothes
    In certain professions, luxury goods can send the wrong signal.​
    Man wearing luxury-brand clothes walks with a cold wind behind him, chilling three people he passes.
  6. Why You Should Skip the Easy Wins and Tackle the Hard Task First
    New research shows that you and your organization lose out when you procrastinate on the difficult stuff.
    A to-do list with easy and hard tasks
  7. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  8. 6 Takeaways on Inflation and the Economy Right Now
    Are we headed into a recession? Kellogg’s Sergio Rebelo breaks down the latest trends.
    inflatable dollar sign tied down with mountains in background
  9. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  10. When Do Open Borders Make Economic Sense?
    A new study provides a window into the logic behind various immigration policies.
    How immigration affects the economy depends on taxation and worker skills.
  11. How Old Are Successful Tech Entrepreneurs?
    A definitive new study dispels the myth of the Silicon Valley wunderkind.
    successful entrepreneurs are most often middle aged
  12. How Has Marketing Changed over the Past Half-Century?
    Phil Kotler’s groundbreaking textbook came out 55 years ago. Sixteen editions later, he and coauthor Alexander Chernev discuss how big data, social media, and purpose-driven branding are moving the field forward.
    people in 1967 and 2022 react to advertising
  13. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  14. How to Get the Ear of Your CEO—And What to Say When You Have It
    Every interaction with the top boss is an audition for senior leadership.
    employee presents to CEO in elevator
  15. Understanding the Pandemic’s Lasting Impact on Real Estate
    Work-from-home has stuck around. What does this mean for residential and commercial real-estate markets?
    realtor showing converted office building to family
  16. Immigrants to the U.S. Create More Jobs than They Take
    A new study finds that immigrants are far more likely to found companies—both large and small—than native-born Americans.
    Immigrant CEO welcomes new hires
  17. Podcast: What to Expect When Joining a Family-Owned Business
    There are cons—but a lot of pros, too. On this episode of The Insightful Leader, we’ll explore what it’s like to work at a family business when you’re not a family member.
More in Finance & Accounting