> Skip to content
FEATURED:
  • An Update for Readers on Our New Nonprofit Status
Sign In
  • Latest
  • Advice
  • Opinion
  • Webinars
  • Data
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
Sign In
  • Latest
  • Advice
  • Opinion
  • Webinars
  • Data
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
  • Latest
  • Advice
  • Opinion
  • Webinars
  • Data
  • Grants
  • Magazine
  • Store
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
    • Featured Products
    • Data
    • Reports
    • Collections
    • Back Issues
    • Webinars
  • Jobs
    • Find a Job
    • Post a Job
    • Find a Job
    • Post a Job
Sign In
ADVERTISEMENT
News
  • Twitter
  • LinkedIn
  • Show more sharing options
Share
  • Twitter
  • LinkedIn
  • Email
  • Facebook
  • Copy Link URLCopied!
  • Print

Yale Scholar Releases First Four ‘Impact Audits’ in New Bid to Identify What Works

By  Marc Gunther
December 11, 2015
Dr. Lokraj, a doctor from Possible, with a young patient in Nepal.
Possible
Dr. Lokraj, a doctor from Possible, with a young patient in Nepal.

A Yale economics professor who helped change the way governments and nonprofits evaluate antipoverty programs today started a new venture to conduct “impact audits” of charities.

The scholar, Dean Karlan, says his new group, ImpactMatters, will conduct thorough audits of charities, analyzing their transparency, cost-effectiveness, willingness to share insights, and blueprints for achieving change. Those that pass will have to demonstrate that their programs make a difference.

“There’s a real struggle for donors who want to do good with their money to know how to give,” Mr. Karlan says. “We are trying to disrupt the philanthropy market and make it more evidence based, make it so that organizations that achieve their mission raise more money, do better and grow more.”

We’re sorry. Something went wrong.

We are unable to fully display the content of this page.

The most likely cause of this is a content blocker on your computer or network. Please make sure your computer, VPN, or network allows javascript and allows content to be delivered from v144.philanthropy.com and chronicle.blueconic.net.

Once javascript and access to those URLs are allowed, please refresh this page. You may then be asked to log in, create an account if you don't already have one, or subscribe.

If you continue to experience issues, contact us at 202-466-1032 or help@chronicle.com

A Yale economics professor who helped change the way governments and nonprofits evaluate antipoverty programs today started a new venture to conduct “impact audits” of charities.

The scholar, Dean Karlan, says his new group, ImpactMatters, will conduct thorough audits of charities, analyzing their transparency, cost-effectiveness, willingness to share insights, and blueprints for achieving change. Those that pass will have to demonstrate that their programs make a difference.

“There’s a real struggle for donors who want to do good with their money to know how to give,” Mr. Karlan says. “We are trying to disrupt the philanthropy market and make it more evidence based, make it so that organizations that achieve their mission raise more money, do better and grow more.”

As part of today’s launch, ImpactMatters published audits of four charities, all of which passed. They are:

  • The Boma Project, which helps extremely poor women in drought-prone areas of Africa.
  • Possible, which provides health care to the poor in Nepal.
  • Success for All Foundation, which works to improve schools in the United States.
  • Trickle Up, which helps extremely poor people move to greater economic self-sufficiency.

Each audit consists of a one-page summary and 15 to 25 pages of supplementary material. The nonprofits will not be rated or ranked.

ADVERTISEMENT

If his new venture succeeds, Mr. Karlan says nonprofits will learn to generate better results for those they serve and donors will reward high-performing nonprofits.

“The real measure of success will be seeing that dollars get moved,” he says.

Seeking More Evidence

A 45-year-old development and behavioral economist, Mr. Karlan has an impressive track record.

He started Innovations for Poverty Action in 2002 to investigate whether the billions of dollars that were being poured into programs to reduce global poverty were having an impact.

Since then, by collaborating with academics from around the world, Innovations for Poverty Action has conducted more than 500 evaluations, most of them randomized, controlled trials, in such areas as microfinance, education, water, sanitation, and cash transfers. The group brought in $42.6 million last year and, with a sister organization, the Abdul Latif Jameel Poverty Action Lab, it has helped to change thinking about global poverty and steer more money to programs that work.

ADVERTISEMENT

Mr. Karlan has similarly big ambitions for Impact Matters, while stressing that he is starting small.

“We are very much in the beta phase,” he says. “We want to be a learning organization.” A nonprofit, Impact Matters has a single full-time employee and several part-time staff members. Yale students may be asked to lend a hand: Mr. Karlan teaches a class called Econ 472b. Effective Philanthropy: Evaluating Charitable Organizations.

Along the spectrum of watchdog organizations, ImpactMatters falls between GiveWell, which deeply researches relatively few nonprofits, and Charity Navigator, which rates about 8,000 nonprofits but does not provide information on their effectiveness.

“We’ll be much closer to GiveWell than to Charity Navigator,” Mr. Karlan says.

Toward Better Practices

Current plans call for ImpactMatters to work only with charities that have agreed to be audited. An audit may be requested by a charity itself or at the request of a current or potential donor. To encourage nonprofits to participate, ImpactMatters will sign agreements promising not to publish results for charities that fail; it will share its findings with those charities, in the hope that they will improve their practices. Mr. Karlan says it’s too soon to say what each audit will cost.

ADVERTISEMENT

Mr. Karlan says he is talking to major donors about supporting the expansion of ImpactMatters. He expects individual audits to be paid for by donors or groups of donors who want to know more about certain nonprofits or causes. A donor or group of donors interested in climate change, for example, could commission audits of groups working on the issue.

Mr. Karlan says audits will be offered to a variety of domestic and international nonprofits, beginning with smaller nonprofits that focus on a single cause or two. Those audited could include organizations working on poverty, education, the environment, health, and human rights, but not universities, hospitals, religious organizations, or museums.

Charities that pass will be able to share results with donors, on their websites, and on nonprofit-information sites like Guidestar.

Evan Paul, Guidestar’s vice president of products, says the impact audits should be of value to “the more sophisticated users of our data — nonprofit managers, foundation program officers, major donors, consultants, and others who want to get in the weeds.”

William Abrams, president of Trickle Up, says its audit is “probably not what someone who is writing a $100 or $200 check in December is going to read, but it could have a lot of impact with sophisticated donors, who want to see evidence, who want to see third-party verification.”

ADVERTISEMENT

The audit of his group provided useful insights, Mr. Abrams says: “There’s an analogy between this and our financial audit. There’s value to having a third party that has deep expertise look at what you’re doing and ... give you feedback on how you can improve.”

To conduct the audit, ImpactMatters asked Trickle Up for a variety of documents and spent a full day on site interviewing staff members, including a two-hour interview with Mr. Abrams.

Limited Effect

Finding reliable information about which charities make a difference isn’t easy.

Charity Navigator collects and shares mostly financial and governance data. Its budget for fiscal 2014 was about $2.8 million.

Michael Thatcher, its chief executive, said his organization would like to provide information on results and impact of charities but has yet to devise an effective and comparative way of doing so.

ADVERTISEMENT

“We all agree that overhead is not the best way to measure an organization,” he says.

Meanwhile, GiveWell, a San Francisco group, will spend about $1.4 million this year on research, according to Sean Conley, a research analyst. The venture seeks out charities that run their programs based on evidence of results and are transparent and highly cost effective. In effect, its favored nonprofits all serve poor people in the developing world. To come up with four “top charities” and four “standout charities,” GiveWell looks at fewer than 20 nonprofits a year.

“Thoroughly investigating even a small number of charities is a great deal of work,” GiveWell says on its website.

Mr. Karlan says he’s an admirer of GiveWell but wants to be able to provide donors with guidance about a broader range of causes and charities.

“We believe most people choose their cause with the heart,” he says. “We want to help them then choose their charity with their head.”

ADVERTISEMENT

We welcome your thoughts and questions about this article. Please email the editors or submit a letter for publication.
Results and Reporting
Marc Gunther
Marc Gunther is a veteran journalist, speaker, and writer who reported on business and sustainability for many years. Since 2015, he has been writing about foundations, nonprofits and global development on his blog, Nonprofit Chronicles.
ADVERTISEMENT
ADVERTISEMENT

Related Content

  • Wringing the Most Good Out of a Facebook Fortune
  • Charity Navigator Confronts Its Critics as It Seeks to Expand
  • Nonprofits Have Adapted Meticulous Scientific Methods to Collect the Best Data
  • Explore
    • Latest Articles
    • Get Newsletters
    • Advice
    • Webinars
    • Data & Research
    • Magazine
    • Chronicle Store
    • Find a Job
    Explore
    • Latest Articles
    • Get Newsletters
    • Advice
    • Webinars
    • Data & Research
    • Magazine
    • Chronicle Store
    • Find a Job
  • The Chronicle
    • About Us
    • Work at the Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Gift-Acceptance Policy
    • Site Map
    • DEI Commitment Statement
    The Chronicle
    • About Us
    • Work at the Chronicle
    • User Agreement
    • Privacy Policy
    • California Privacy Policy
    • Gift-Acceptance Policy
    • Site Map
    • DEI Commitment Statement
  • Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Reprints & Permissions
    • Do Not Sell My Personal Information
    Customer Assistance
    • Contact Us
    • Advertise With Us
    • Post a Job
    • Reprints & Permissions
    • Do Not Sell My Personal Information
  • Subscribe
    • Individual Subscriptions
    • Organizational Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
    Subscribe
    • Individual Subscriptions
    • Organizational Subscriptions
    • Subscription & Account FAQ
    • Manage Newsletters
    • Manage Your Account
1255 23rd Street, N.W. Washington, D.C. 20037
© 2023 The Chronicle of Philanthropy
  • twitter
  • youtube
  • pinterest
  • facebook
  • linkedin