Why We Know So Little about Disparities within the Federal Court System—and How That’s Finally Changing
Skip to content
Politics & Elections Jul 10, 2020

Why We Know So Little about Disparities within the Federal Court System—and How That’s Finally Changing

Millions of hard-to-obtain public court records shed new light on the fairness of the U.S. judiciary.

Public court records shed new light on judges' decision-making and the granting of petitions.

Lisa Röper

Based on the research of

Adam Pah

David Schwartz

Sarath Sanga

Zachary Clopton

Peter DiCola

Rachel Davis Mersey

Charlotte Alexander

Kristian Hammond

Luis A. Nunes Amaral

What percentage of federal lawsuits are dismissed or settled? Do cases proceed differently when big companies are involved? How often do judges approve petitions to waive court fees?

These may seem like simple questions, but their answers are unknown. In fact, many fundamental questions about the functioning of our legal system remain unresolved—because the data needed to answer them, while technically public, are trapped behind a pricey paywall.

As a consequence, “there is a dearth of systematic studies on how the judiciary operates,” says Adam Pah, a professor of management and organizations at the Kellogg School. “You can ask the most knowledgeable legal scholars in this country, and no one can tell you all the basic facts you would expect.”

It’s rare to see a database painted as a villain, but that’s how many in the legal community regard PACER (Public Access to Electronic Court Records), the online repository for documents filed in federal court. (The federal system is made up of 94 district courts, 90 bankruptcy courts, and 13 circuit courts. It also includes the Supreme Court, though that now operates a separate database. State and local courts are a different animal altogether.) PACER is notoriously difficult to navigate: each federal court operates its own PACER portal, and the system’s user interface is, in Pah’s words, “straight out of 1991.”

Users are also charged an eye-popping ten cents per page for access to most documents in PACER. Although that may not sound like much, with legal briefs routinely hitting 60 pages, and numerous briefs filed in a single case, those fees can add up quickly.

But despite these steep barriers, Pah and colleagues recently managed to conduct a revealing large-scale analysis of the federal courts. He and 17 other scholars from across Northwestern received a grant that allowed them to access an unprecedented amount of PACER data.

Using just a portion of those data, the team uncovered stark disparities in how frequently low-income litigants get their court fees waived. This finding speaks to a serious lack of consistency in how judges—even those within the same district—handle petitions from litigants.

The researchers gleaned these novel insights using just a tiny fraction of the documents in PACER; if they can access more documents in the future, they hope to explore even bigger questions in even greater depth. The team is also working to create an open alternative to PACER, which will allow researchers and citizens to ask questions about how our judicial system works and find answers.

“This is really just the jumping-off point,” Pah says.

Judges Don’t Waive Court Fees Equally

The research was made possible thanks to a $1 million grant from the National Science Foundation that allowed the research team to buy a full year of PACER case filings from all 94 courts.

Pah and his collaborators decided to focus on downloading docket reports—essentially, the table of contents for a given case—which contain a date-stamped record of the filing of important documents and decisions. Because docket reports are short (and therefore cheap), the researchers could get their hands on a lot of them: 359,071 cases filed across all 94 districts in 2016.

“You can ask the most knowledgeable legal scholars in this country, and no one can tell you all the basic facts you would expect.”

The docket reports allowed the researchers to compare how frequently different judges granted motions for a waiver of court fees, such as the $400 required to file a federal lawsuit. These are known as in forma pauperis (IFP) requests.

There is no uniform standard for determining whether to grant IFP status. Instead, courts typically “leave the decision to the judge’s discretion,” the researchers write. “Individual judges thus have considerable power over whether to grant or deny access to the justice system.”

The researchers used the data from the 94 courts to determine how different judges leveraged this power. While the type of cases filed in Chicago will likely differ from cases filed in New York City, for instance, every case is randomly assigned to a judge within the appropriate court, which let the researchers determine how frequently judges were exercising discretion. “This is the key part,” Pah says. “Since the cases are randomly assigned, we would expect judges within the same district to waive fees at about the same rate.”

But that was not what they found. Their analysis showed that there was huge variation in how frequently judges waived fees, despite the fact that all judges in a given district should see similar petitions, on average.

In one district, certain judges approved IFP requests less than 20 percent of the time, while other judges approved the requests more than 80 percent of the time. Nationwide, nearly 40 percent of judges granted waivers at a rate that significantly differed from their peers, far higher than if the variation had been merely due to chance.

Pah and his fellow researchers were surprised to see such extreme variation. They had expected some differences among different judges, he explains, “but not to the point where individuals in the same district are as distinct as all the 94 courts are themselves.”

While the researchers did not examine what made judges more or less willing to grant petitions, Pah can imagine several plausible explanations, which could be tested in future research. “Is it because of differing interpretations of the rules?” Pah wonders. “Or is it related to the timing or volume of petitions that a judge sees across cases—where a petitioner in one case is so destitute it makes another petitioner in the following case seem less qualified?”

Citizens deserve to know “whether the courts are functioning fairly and efficiently for the public. These questions need to get answered. We need to understand this.”

More Court Records Will Yield New Discoveries

These findings are already being used to help make the judicial system more equitable. The researchers recently presented their results to a group of federal judges who are responsible for making rules in their districts. “Now that they’ve seen our results, they’re interested in using our data to help improve the process,” Pah says.

Pah says he’s amazed by how much he and his collaborators have been able to learn from docket reports alone—which are, after all, relatively spartan documents. “Just with the docket reports, we were already in the Wild West, finding new information,” he says.

He also hopes the new tool that the team is creating will make the process of understanding the federal courts much simpler. Their ultimate goal is to make an alternative to PACER, an open-knowledge network that links court data to other public data about litigants, judges, lawyers, and courts, enabling researchers to ask questions and find answers.

For now, though, the new research demonstrates how much more could be done with greater access to the public documents in PACER. “Behind most of the docket entries, there’s something that was actually filed: briefs, written motions. That information and that context is going to be important for us to get to the next level of understanding,” Pah says.

And that next level of understanding is crucial for our democracy, he argues. Citizens deserve to know “whether the courts are functioning fairly and efficiently for the public. These questions need to get answered. We need to understand this.”

Featured Faculty

Clinical Assistant Professor of Management & Organizations

About the Writer
Susie Allen is a freelance writer in Chicago.
About the Research
Pah, Adam R., David L. Schwartz, Sarath Sanga, Zachary D. Clopton, Peter DiCola, Rachel Davis Mersey, Charlotte S. Alexander, Kristian J. Hammond, and Luís A. Nunes Amaral. 2020. "How to build a more open justice system." Science.

Read the original

Most Popular This Week
  1. Sitting Near a High-Performer Can Make You Better at Your Job
    “Spillover” from certain coworkers can boost our productivity—or jeopardize our employment.
    The spillover effect in offices impacts workers in close physical proximity.
  2. Will AI Kill Human Creativity?
    What Fake Drake tells us about what’s ahead.
    Rockstars await a job interview.
  3. Podcast: How to Discuss Poor Performance with Your Employee
    Giving negative feedback is not easy, but such critiques can be meaningful for both parties if you use the right roadmap. Get advice on this episode of The Insightful Leader.
  4. 2 Factors Will Determine How Much AI Transforms Our Economy
    They’ll also dictate how workers stand to fare.
    robot waiter serves couple in restaurant
  5. How Are Black–White Biracial People Perceived in Terms of Race?
    Understanding the answer—and why black and white Americans may percieve biracial people differently—is increasingly important in a multiracial society.
    How are biracial people perceived in terms of race
  6. The Psychological Factor That Helps Shape Our Moral Decision-Making
    We all have a preferred motivation style. When that aligns with how we’re approaching a specific goal, it can impact how ethical we are in sticky situations.
    a person puts donuts into a bag next to a sign that reads "limit one"
  7. Will AI Eventually Replace Doctors?
    Maybe not entirely. But the doctor–patient relationship is likely to change dramatically.
    doctors offices in small nodules
  8. What’s at Stake in the Debt-Ceiling Standoff?
    Defaulting would be an unmitigated disaster, quickly felt by ordinary Americans.
    two groups of politicians negotiate while dangling upside down from the ceiling of a room
  9. How to Manage a Disengaged Employee—and Get Them Excited about Work Again
    Don’t give up on checked-out team members. Try these strategies instead.
    CEO cheering on team with pom-poms
  10. One Key to a Happy Marriage? A Joint Bank Account.
    Merging finances helps newlyweds align their financial goals and avoid scorekeeping.
    married couple standing at bank teller's window
  11. Why Do Some People Succeed after Failing, While Others Continue to Flounder?
    A new study dispels some of the mystery behind success after failure.
    Scientists build a staircase from paper
  12. 5 Tips for Growing as a Leader without Burning Yourself Out
    A leadership coach and former CEO on how to take a holistic approach to your career.
    father picking up kids from school
  13. Which Form of Government Is Best?
    Democracies may not outlast dictatorships, but they adapt better.
    Is democracy the best form of government?
  14. Daughters’ Math Scores Suffer When They Grow Up in a Family That’s Biased Towards Sons
    Parents, your children are taking their cues about gender roles from you.
    Parents' belief in traditional gender roles can affect daughters' math performance.
  15. Take 5: Research-Backed Tips for Scheduling Your Day
    Kellogg faculty offer ideas for working smarter and not harder.
    A to-do list with easy and hard tasks
  16. What Went Wrong at AIG?
    Unpacking the insurance giant's collapse during the 2008 financial crisis.
    What went wrong during the AIG financial crisis?
  17. Leave My Brand Alone
    What happens when the brands we favor come under attack?
  18. The Second-Mover Advantage
    A primer on how late-entering companies can compete with pioneers.
  19. Take 5: Yikes! When Unintended Consequences Strike
    Good intentions don’t always mean good results. Here’s why humility, and a lot of monitoring, are so important when making big changes.
    People pass an e-cigarette billboard
More in Politics & Elections