> Skip to content
FEATURED:
  • Our Transition to a Nonprofit
Sign In
  • Latest Articles
  • Advice
  • Opinion
  • Webinars
  • Data & Research
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
Sign In
  • Latest Articles
  • Advice
  • Opinion
  • Webinars
  • Data & Research
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
  • Latest Articles
  • Advice
  • Opinion
  • Webinars
  • Data & Research
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
Sign In
ADVERTISEMENT
Opinion
  • Twitter
  • LinkedIn
  • Show more sharing options
Share
  • Twitter
  • LinkedIn
  • Email
  • Facebook
  • Copy Link URLCopied!
  • Print

Charity Navigator’s New “Impact Score” Tells Us Little About a Nonprofit’s True Value

By  Liz Dozier and 
Lisa Pilar Cowan
January 14, 2021
Hand pressing five star rating button web page user interface design.
Getty Images

The nonprofit watchdog group Charity Navigator last fall announced a new feature it designed to provide donors with an improved measure of nonprofit effectiveness. An “impact score” based on “how much good the nonprofit achieves per dollar of cost” will now be added to each nonprofit’s profile. Sounds great, right? Theoretically, it gives a donor insight into how much “good” will result from their dollars. In reality, it doesn’t come close to delivering on that promise.

Charity Navigator, which acquired an organization called ImpactMatters to provide this new measure, isn’t the first or only entity to define a donation’s success by its return on investment. But this attempt to quantify impact for a broad range of nonprofits nationwide is troubling. Because Charity Navigator uses only data that can be standardized across organizations, many qualitative factors are lost. Its primary

We’re sorry. Something went wrong.

We are unable to fully display the content of this page.

The most likely cause of this is a content blocker on your computer or network. Please make sure your computer, VPN, or network allows javascript and allows content to be delivered from v144.philanthropy.com and chronicle.blueconic.net.

Once javascript and access to those URLs are allowed, please refresh this page. You may then be asked to log in, create an account if you don't already have one, or subscribe.

If you continue to experience issues, contact us at 202-466-1032 or help@chronicle.com

The nonprofit watchdog group Charity Navigator last fall announced a new feature it designed to provide donors with an improved measure of nonprofit effectiveness. An “impact score” based on “how much good the nonprofit achieves per dollar of cost” will now be added to each nonprofit’s profile. Sounds great, right? Theoretically, it gives a donor insight into how much “good” will result from their dollars. In reality, it doesn’t come close to delivering on that promise.

Charity Navigator, which acquired an organization called ImpactMatters to provide this new measure, isn’t the first or only entity to define a donation’s success by its return on investment. But this attempt to quantify impact for a broad range of nonprofits nationwide is troubling. Because Charity Navigator uses only data that can be standardized across organizations, many qualitative factors are lost. Its primary impact measures — such as share of budget spent on programs, whether program fees are charged, and whether the organization already receives private funding — are overly simplistic and do not accurately help donors understand a nonprofit’s true value for the community it serves.

In our roles as a former high-school principal and an education program director, we‘ve seen the harms that often accompany a one-size-fits-all evaluation approach. It’s not unlike a “color-blind” approach to equity. Context is important, and when we ignore it, we may end up replicating the very thing we are fighting to eradicate.

Consider, for example, this revealing thought exercise included in the ImpactMatters blog post about the impact score:

A program has a limited budget of $100,000 to improve literacy in a community. It can choose between two approaches to do so: One that can boost literacy by a grade level for 100 students and a second that can also boost literacy by a grade level but for 200 students. All else equal, a sensible program administrator would choose the second, as of course it reaches twice as many students. This is a cost-effectiveness decision. We have limited resources and unlimited needs. Cost-effectiveness is a decision tool that makes those resources go further — helping more people in more ways.

ADVERTISEMENT

The telling words here are “all else equal.” Many factors could vary from one program to another: Do the two programs offer the same supports? At what grade level are the students reading? Who is leading the program, and who is staffing it? What is the organization’s relationship to the community? What literature are the students reading? Are the students primarily being taught how to take a test, or are they learning critical thinking skills? Are their reading materials at school in the same language they speak at home? Are they getting enough to eat during the school day?

Both of us are now grant makers who have centered our work on trusting grantees. We think Charity Navigator’s approach to measuring impact misses the mark — and the point. Impact should be defined, or at least informed, by the organizations and communities that experience the work firsthand. (For more on this, check out Chicago Beyond’s recent guidebook, which reveals the seven inequities lurking within most evaluation systems.)

Beyond the specifics of evaluating a literacy program (or food pantry or senior center), we strongly believe that what an organization chooses to measure is a statement about what it values. When we measure the quality of a nonprofit based on return on financial investment, we ignore the complexities of a grantee’s work and reinforce the idea that the most important factor in giving is protecting a foundation’s reputation or a donor’s wealth. And when we prioritize wealth and reputation over any other indicator of a human life, we are actively preserving the very inequities we purportedly want to eradicate.

This attention to impact as a function of the grant-making process is especially relevant at a moment when philanthropy’s legitimacy has been challenged by critiques of both its effectiveness and its historic role in perpetuating systemic inequities.

So what’s the alternative? Here are a few ways we think about impact and evaluation at our foundations:

ADVERTISEMENT

“How” we fund is intimately related to “what” we fund. The nature and quality of our interactions with nonprofit partners is as important to achieving the outcomes we seek as what we fund and support. We see our grantees as equal partners in this work so how we engage with them is critical to the effectiveness of that work. While foundations typically consider themselves the “brains” and grantees the “brawn,” we believe the nonprofits we support are the experts on their own issues and solutions. Working together, as equals, without the constraints of those false roles, lays the groundwork for strong collaborative efforts that ultimately produce the results we all seek.

Shared learning is a critical part of our evaluation process. What if we approached evaluation as an opportunity to learn with nonprofits, rather than measuring impact with overly simplistic metrics like spending ratios and program fees? What if the evaluation becomes a shared pursuit in understanding the challenges, opportunities, and evolution of a program or organization? When we approach evaluation in this way, it becomes an avenue to further understand the context in which successes and failures occurred, to notice inequities, and to collaboratively reflect on progress. This approach, far more than a grade on a nonprofit’s return on investment, would benefit any organization — and ultimately the community it serves.

How we measure grantee success internally is a reflection of our goals for society as a whole. Approaching grantee relationships from a place of trust, humility, and transparency is key. Within our foundations, we are building the kinds of assessment and planning processes that we want to see in the larger world. This means listening, especially to grantee partners, so that we develop a shared understanding about the issues, challenges, and solutions ahead.

Those of us occupying leadership positions at foundations must be self-reflective about our practices and share accountability for the impact of the work. That is what solidarity and collaborative stewardship look like. It is a deliberate, shared experience toward a common cause.

This is why the Charity Navigator impact score is so problematic. It renders all other factors void. It gives us an excuse to put up blinders rather than open a window into the complexities and larger context behind a grantee’s potential success. Too often in philanthropy we try to boil things down. And, in the process of all that boiling, we lose the opportunity to have a lasting impact on the people and the communities we desperately want to help.

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Finance and RevenueFoundation GivingData & ResearchDiversity, Equity, and Inclusion
Liz Dozier
Liz Dozier is the founder and CEO of Chicago Beyond and the former principal of Fenger Academy High School.
Lisa Pilar Cowan
Lisa Pilar Cowan is vice president of the Robert Sterling Clark Foundation.

Op-Ed Submission Guidelines

The Chronicle’s Opinion section is designed to spark robust debate about all aspects of the nonprofit world. We welcome submissions that provide new insights and promote innovative thinking about leadership, fundraising, grant-making policy, and more.
See details about how to submit an opinion piece or letter to the editor.

ADVERTISEMENT
ADVERTISEMENT
  • Explore
    • Latest Articles
    • Get Newsletters
    • Advice
    • Webinars
    • Data & Research
    • Magazine
    • Chronicle Store
    • Find a Job
    Explore
    • Latest Articles
    • Get Newsletters
    • Advice
    • Webinars
    • Data & Research
    • Magazine
    • Chronicle Store
    • Find a Job
  • The Chronicle
    • About Us
    • Work at the Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Gift-Acceptance Policy
    • Site Map
    • DEI Commitment Statement
    The Chronicle
    • About Us
    • Work at the Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Gift-Acceptance Policy
    • Site Map
    • DEI Commitment Statement
  • Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Reprints & Permissions
    • Do Not Sell My Personal Information
    Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Reprints & Permissions
    • Do Not Sell My Personal Information
  • Subscribe
    • Individual Subscriptions
    • Organizational Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
    Subscribe
    • Individual Subscriptions
    • Organizational Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
1255 23rd Street, N.W. Washington, D.C. 20037
© 2023 The Chronicle of Philanthropy
  • twitter
  • youtube
  • pinterest
  • facebook
  • linkedin