Policy May 1, 2010

Rating the Raters of Corporate Governance

Independent examination reveals inconsistencies

Based on the research of

Robert M. Daines

Ian Gow

David F. Larcker

In the wake of the Enron and WorldCom corporate scandals, a number of firms began to provide ratings of the quality of companies’ corporate governance. These firms claim that their ratings help investors improve the performance of their portfolios by identifying firms with good or bad governance. Many companies work hard to improve their governance ratings in the belief that doing so will make them more attractive to investors. However, a study co-authored by Ian Gow, assistant professor of Accounting Information and Management at the Kellogg School of Management, raises serious questions about the value of governance ratings in predicting performance. Commercial ratings, Gow and his co-authors conclude, are not the reliable indicators of corporate governance the ratings companies would have you believe. The products, in other words, do not live up to the marketing.

Industry groups and analysts have long expressed skepticism about the value of the ratings. But previous studies of the issue have had limited focus or have lacked credibility because they were sponsored by the ratings firms themselves. The new study is different. “Ours is the first paper to conduct an independent, rigorous examination of these governance ratings,” Gow explains. “We’re also the first to look across different ratings. No one had looked across the board previously.”

The study has particular significance because advising on corporate governance is big business. In 2007 the risk advisory firm RiskMetrics bought Institutional Shareholder Services (ISS), the largest corporate governance advisory firm, for $550 million. ISS claims more than 1,700 institutional clients managing $26 trillion in assets. Individual corporations also engage ISS to help improve their Corporate Governance Quotient (CGQ), the governance rating provided by ISS. Clients of another large player, Governance Metrics International (GMI), manage $15 trillion. Institutional investors, such as mutual funds, that are too small to have their own analytical teams make up the majority of the ratings firms’ client lists.

Differentiating Factors in Corporate Governance
What factors differentiate good corporate governance from bad? Three of the ratings—CGQ, GMI, and The Corporate Library’s TCL rating—take similar approaches. “While they differ in the details,” Gow points out, “they all focus on how companies stack up relative to so-called ‘best practices,’ such as having mostly independent directors or having a separate chairman and CEO.” In contrast, Audit Integrity’s Accounting and Governance Risk (AGR) produces its ratings primarily using financial statement information. Different firms also express their ratings in different ways: letter grades, for example, or numbers from 1 to 10 or 1 to 100.

But do the ratings, however they are expressed, have any relationship to future corporate performance? That was the question addressed by Gow and his collaborators, Robert Daines and David Larcker, both professors at Stanford University. “We had the ratings,” Gow says. “So it was natural to see whether the claims for them were substantiated.”

Determining Outcomes
To determine the predictive value of the ratings, team members studied two relatively rare “bad” outcomes—accounting restatements and class action lawsuits—and three traditional measures of corporate performance—operating performance, market values, and excess stock returns. They also looked at the relationship between companies’ governance ratings and their cost of debt. The team obtained the ratings from a variety of data services and public sources.

Detailed analysis gave a clear picture. “We find that these governance ratings have either limited or no success in predicting firm performance or other outcomes of interest to shareholders,” the team writes. “Moreover, even when there is a statistical association with future outcomes, the substantive effect is small.”

One finding suggests why that result is hardly unexpected: The data show very little correlation among the different governance ratings. “This suggests that either the ratings are measuring very different corporate governance constructs or that there is substantial measurement error in at least some of the ratings,” the team reports. “Since the firms use the same basic governance data . . . we believe that each firm is attempting to measure a similar corporate governance construct.” In fact the most obviously different rating—AGR, which is based on information in financial statements rather than observable corporate governance mechanisms – showed the strongest ability to predict corporate performance.

Muddy Waters
Gow argues that while the leading ratings firms claim to be “measuring the platonic ideal of good governance, our study suggests that it’s far from clear what good governance is, let alone that forcing firms to adopt a checkbox approach to governance will produce good outcomes.”

While ratings agencies initially responded to the study by complaining about the researchers’ methodology, in February RiskMetrics announced that it was dropping CGQ. In its place the company now offers Governance Risk Indicators, or GRId, which rate companies in four categories, thus effectively dispensing entirely with the notion of a single governance score. GRId will also provide each company with its absolute ratings rather than ratings relative to its industry or peers. And it will no longer give extra credit to firms whose corporate directors take ISS courses. Walter Gangl, former director of the Society of Corporate Secretaries and Governance Professionals and former deputy general counsel at Armstrong World Industries Inc., described the study by Gow and his colleagues as the “straw that broke the camel’s back.”

Whether the changes will improve the rating’s ability to predict corporate outcomes remains to be seen. Plainly, the study by Gow and his colleagues has shown deficiencies in the leading governance ratings. Recently leading industry bodies have cited the study in support of calls for the Securities and Exchange Commission to provide more regulatory oversight of firms such as RiskMetrics and GMI that not only rate firms’ corporate governance but also advise investors on how to vote their shares. Gow says, “Companies should definitely question whether taking measures to improve their ratings is worthwhile. For clients of the rating firms the message seems simple: Don’t pay for this stuff.”

Featured Faculty

Ian Gow

Member of the Department of Accounting Information and Management faculty between 2009 and 2011

About the Writer

Peter Gwynne is a freelance writer based in Sandwich, Mass.

About the Research

Daines, Robert M., Ian Gow, and David F. Larcker. 2010. Rating the Ratings: How Good are Commercial Governance Ratings?. Journal of Financial Economics, December, 98(3): 439-461.

Read the original

Editor’s Picks

Careers

Podcast: How to Be a Great Mentor

Plus, some valuable career advice that applies to just about everyone.

Marketing

A New Way to Persuade Kids to Drink More Water and Less Soda

Getting children to make healthy choices is tricky—and the wrong message can backfire.

Innovation

How Can Social Science Become More Solutions-Oriented?

A conversation between researchers at Kellogg and Microsoft explores how behavioral science can best be applied.

Innovation

Buying a Company for Its Talent? Beware of Hidden Legal Risks.

Acquiring another firm’s trade secrets—even unintentionally—could prove costly.

Careers

Take 5: Tips for Widening—and Improving—Your Candidate Pool

Common biases can cause companies to overlook a wealth of top talent.

Innovation

Everyone Wants Pharmaceutical Breakthroughs. What Drives Drug Companies to Pursue Them?

A new study suggests that firms are at their most innovative after a financial windfall.

Careers

4 Key Steps to Preparing for a Business Presentation

Don’t let a lack of prep work sabotage your great ideas.

Healthcare

Video: How Open Lines of Communication Can Improve Healthcare Outcomes

Training physicians to be better communicators builds trust with patients and their loved ones.

Operations

Here’s a Better Way to Schedule Surgeries

A new tool could drive savings of 20 percent while still keeping surgeons happy.

Politics & Elections

Why Economic Crises Trigger Political Turnover in Some Countries but Not Others

The fallout can hinge on how much a country’s people trust each other.

Marketing

Building Strong Brands: The Inside Scoop on Branding in the Real World

Tim Calkins’s blog draws lessons from brand missteps and triumphs.

Economics

How the Coffee Industry Is Building a Sustainable Supply Chain in an Unstable Region

Three experts discuss the challenges and rewards of sourcing coffee from the Democratic Republic of Congo.