The First Tranche

Welcome to the First Tranche, the AidData blog--a forum for analysis and discussion of information about development finance, and how it can be used to improve development practice and research. The First Tranche publishes independent views and analysis from a variety of bloggers who are interested in aid transparency, aid effectiveness, and better/more accessible aid information.
[Read more...]

RSS Feed

Google Reader or Homepage



Blog Roll


The First Tranche | a blog by the staff of AidData

Thursday, December 8, 2011


Assessing Donor Transparency Practices Outside of the DAC


As other First Tranche contributors have noted, Publish What You Fund’s 2011 pilot Aid Transparency Index represents a major step forward in the benchmarking of donor transparency practices. But what is it exactly that PWYF has accomplished with this latest index?

I would argue that one of most important contributions PWYF has made is to move the policy discussion beyond the simple question of “What information is available?” and towards the more fundamental question: “Is the information that should be available actually available?” PWYF sheds light on the latter issue with detailed data for 58 organizations from 45 countries/IGOs. Their assessment examines three dimensions of each donor organization: organizational, country and activity level. At each level, PWYF has determined whether the organization collects and/or publishes commonly available information items, such as policy documents, country strategies, and details on project planning, implementation and evaluation. The complete methodology is available here.

PWYF's pilot Index also draws our attention to an area where there is tremendous scope for improvement: benchmarking the transparency practices of development finance agencies outside of the OECD-DAC. PWYF and their CSO/university collaborators gathered data largely from DAC agencies, but their methodological approach lends itself to inclusion of non-DAC agencies. In fact, some of the initial groundwork has already been laid by Michael Hubbard and Pranay Sinha at University of Birmingham. In their “Non DAC Donor’s Data Availability Index,” Hubbard and Sinha investigate the depth and quality of non-DAC data already available from the AidData.org web portal. They also provide information about the sources of the records published by AidData.

Hubbard and Sinha, “Non DAC Donor’s Data Availability Index”
Given that primary sources of information have been identified and a strong methodology for measurement is in place, the table is set for an industrious graduate student, junior faculty member, or CSO to begin collecting non-DAC data that are comparable with the (mostly) DAC data included in the PWYF assessment.

My colleagues and I believe that including non-DAC development finance agencies in future benchmarking exercises would be a great service to the aid transparency policy discussion, as many of these countries (e.g. IndiaMexico, and Russia) are currently establishing new agencies and working out how information will be gathered and published for years to come. Including these organizations in benchmarking assessments like PWYF’s 2011 Index would enable non-DAC agency leaders to track their own progress. It might also foster a bit of healthy competition.


Robert Mosolgo is an AidData Project Manager at the College of William and Mary. He oversees AidData's work with non-DAC development finance agencies. 

Monday, December 5, 2011


Mapping World Bank Project Success Patterns in Afghanistan: Does the Spatial Distribution of Violence Matter?


 “With networked research, all can help collect and share the data that is sorely lacking... We need more hands and minds to confront theory with evidence on major policy issues. This is the direction that I want the World Bank to take. This is democratizing development economics.”

- Robert Zoellick, President of the World Bank Group, 

B.K. Bangash / AP
The World Bank’s Open Data initiative has demonstrated—in spades—that universally accessible data can provoke new research questions and turn conventional wisdom on its head. However, for a variety of reasons, donors seldom release comparable project evaluation data. The scarcity of reliable project-level evaluation data has created an important gap in the aid effectiveness literature. While economists and political scientists have undertaken hundreds and hundreds of econometric studies to assess the impact of aggregate aid flows on various development outcomes, the research community still knows relatively little about the project-level determinants of successful donor-sponsored projects.

In a huge step forward for aid transparency, the World Bank's Independent Evaluation Group recently published its entire store of approximately 10,000 WB project evaluations from the 1960s to present. And importantly, the Bank’s unique project identification system allows users to track individual database records back to project documents.

Shortly after the Bank released these records, we geo-coded all of the World Bank’s publicly available project evaluation data in Afghanistan since the fall of the Taliban in 2001. By “mashing-up” these geo-coded data and other statistical sources, we may begin exploring the spatial determinants of aid effectiveness in Afghanistan.

To conduct an initial "plausibility probe" of the popular hypothesis that security is a key determinant of successful projects, we overlaid all geo-coded and IEG-evaluated World Bank projects from 2002-2007 with sub-national violence data from the Long War Journal.


The resulting map reveals a puzzling pattern. The spatial distribution of violence and project performance do not correspond as closely as one might expect. Conventional wisdom holds that aid projects are generally less successful in conflict-affected areas. But this map suggests that many failed World Bank projects actually cluster in the relatively less violent provinces north of Kabul. Additionally, this map calls attention to the fact that a fair number of World Bank projects succeed in the country's most violent southern provinces, e.g. Kandahar and Helmand.

Several explanations may account for this unusual pattern. Projects in the most dangerous provinces may receive a higher level of donor supervision (since they are located in areas where "the stakes are highest"), which previous research identifies as an important predictor of project success. It could also be the case that donor supervision is lower in these areas, which makes it easier for local officials to avoid micro-management from Western capitals and tailor projects to local needs and conditions.

The key point is that aid effectiveness scholars cannot answer a puzzling question like this one until they know it exists. This is why we have expressed great enthusiasm for the World Bank's ambitious effort to "liberate" development data and promote "networked research".  Finally, we should acknowledge that more comprehensive, time-series data from all donors in Afghanistan would provide a much stronger empirical basis for systematic hypothesis testing. A recent pilot project in Malawi strongly suggests that geocoding the universe of aid is feasible when donors agree to disclose detailed project documentation.  However, mobilizing the necessary political will and capacity necessary to ensure that project evaluation documents are placed in the public domain will likely prove far more challenging. The latest Publish What You Fund benchmarking exercise demonstrates that only a handful of donors receive high scores on evaluation disclosure practices.


Brian O'Donnell is an AidData Post-Baccalaureate Fellow at the College of William and Mary. Brad Parks is Co-Executive Director of AidData and Research Faculty at the College of William and Mary.