in 1966—there was little to evaluate until operations got under way. A system was established in 1972 for measuring results against intentions. While the main focus of such evaluation was historical, the object was to improve the planning, appraisal, and implementation of ADB’s operations. The Economics Office, with the assistance of consultants, provided the internal evaluation capability, while academic institutions and nonprofit organizations were contracted to perform external evaluations. The role of ADB’s operations departments was to make background information available.
By 1977, a total of 17 evaluation studies had identified factors contributing to success or failure of projects. The main product was the project performance audit report. Importantly, 1977 also saw a review of evaluation policies and procedures to increase the impact of evaluations on ADB’s operations. The result was the creation in 1978 of a separate unit, the Postevaluation Office, reporting directly to the President. Evaluation activities were reviewed by the Audit Committee of the Board of Directors. The office was staffed with four professionals, plus the Chief. In 1979, it began to codify its work by developing standards and procedures for producing project performance audit reports, and it released its first summary of findings and recommendations from evaluation.1
Broader evaluations were introduced in 1982. By 1986, performance evaluation had become important enough to merit a theme chapter in ADB’s Annual Report. In 1993, the establishment of the Task Force on Improving Project Quality signaled ADB’s determination to improve its standards of performance and to enhance the effectiveness of its operations. The Task Force identified the major themes underlying project quality to be (i) ADB responsiveness to its developing member countries (DMCs), (ii) DMC ownership and capacity, and (iii) accountability for project quality in ADB. In 1994, the Board of Directors endorsed the Report of the Task Force.2 The action plan contained in the report drew on findings and recommendations from evaluation. In 2000, the scope of project performance audit reports was broadened to include achievement of benefits, measured against a logical framework. A brief account of independent evaluation at ADB since 1978 is appended.
The Changing Context
ADB has assisted the Asia and Pacific region over the past four decades. The region is now recognized as the most economically dynamic in the world, and the incidence of poverty has fallen sharply. When ADB started operations, however, the region was one of the poorest, and most countries had limited foreign exchange reserves. In the 1970s and 1980s, ADB was predominantly a project lender, supporting DMCs’ investment needs in agriculture, industry, and infrastructure. However, issues of sustainable, inclusive development and quality of life became increasingly important. Over the past three decades, to address these issues and meet the new needs they entail, ADB has shifted its operations from supporting mainly economic growth and physical infrastructure to a greater emphasis on poverty reduction, social development, gender equality, environmental sustainability, policy reform, and regional cooperation. ADB has, thus, changed from being essentially a provider of project finance to a more broad-based institution with greater emphasis on policy and institutional support and on knowledge products and services to complement resource transfers.
The first two decades of ADB’s experience showed that a sound policy and institutional framework is critical for ensuring the intended development impacts of projects. This lesson was equally pertinent as ADB ventured into the cross-cutting areas of poverty reduction, human development, gender issues, environmental management, and good governance. Policy dialogue on sector issues assumed ever greater importance. Besides seeking improvements on a project-by-project basis, ADB began, in the mid-1980s, to support wider sector policy and institutional reform. To facilitate this process, ADB complemented project lending with new modalities: program lending (instituted in the mid-1980s) and sector development programs (in the mid-1990s). In 2005, ADB introduced the multitranche financing facility and other financing instruments and modalities, on a pilot basis, to improve its business processes, align its programs more closely with client priorities, reduce bottlenecks in processing development assistance, and expand its product offerings.
Because of its Asian character and experience, DMCs regard ADB as a trusted partner that understands Asia’s diverse cultural norms and the wide range of development issues in the region. ADB is knowledgeable about the importance, sensitivity, and complexity of governance issues in the region. The trust of its DMCs enabled ADB in 1995 to become the first multilateral development bank with a Board-approved governance policy. It has learned from the varied governance experience in the region, including that derived from its “graduates”—regional members that no longer receive direct ADB assistance. This was demonstrated by ADB’s rapid response to countries hit by the 1997 financial and economic crisis.
The importance of the private sector, both domestic and foreign, in the development process is recognized. ADB conducts both public and private sector operations within a single institutional setup. It thus has the potential to be a broker between the public and private sectors. DMCs must be able to rely on ADB for assistance and advice on expanding the role of the private sector with appropriate safeguards in place for regulatory, financial, social, and environmental priorities. The private sector, meanwhile, should be able to rely on support from ADB in mitigating risks and strengthening domestic financial and capital markets. ADB can also catalyze resource transfers through cofinancing.
All shareholders recognize ADB’s efforts to promote regional and subregional cooperation. The successful Greater Mekong Subregion program, begun in a postconflict situation, is an example of the dividend that can be realized when peace prevails. ADB also supports subregional initiatives relevant to development in the Pacific DMCs, the Central Asian republics, and the Brunei Darussalam-Indonesia-Malaysia-Philippines East ASEAN (Association of Southeast Asian Nations) Growth Area. Regional cooperation and integration initiatives offer increasing possibilities for development in the Asia and Pacific region.
ADB has been responsive to environmental concerns since its creation. Its involvement in environmental management has increased substantially since the mid-1980s. The environmental aspects of all its projects and programs are reviewed, and ADB has assisted DMCs in building institutions dealing with environmental concerns and policies. ADB has succeeded in placing environmental issues at the forefront of development planning, and has raised region-wide awareness. ADB must build on its record to help realize the environmental targets of the Millennium Development Goals.
ADB’s operations have faced some major challenges. Assistance for capacity building has not been fully effective, as it was often related to the needs of projects rather than those of institutions. Even then, targeting of beneficiaries and interactions with them in the context of project preparation and implementation have not always been sufficient. ADB could also have provided clearer policy advice based on more rigorous analytical work.
ADB has taken initiatives to enhance its focus and improve development effectiveness. Two major changes in thinking and approach include the poverty reduction strategy3 and the private sector development strategy, 4 approved in 1999 and 2000, respectively. At the same time, the resident mission policy, 5 adopted early in 2000, was expected to lead to improved country focus in operations and a much closer relationship with DMCs. The long-term strategic framework, 2001–2015, 6 spells out ADB’s vision of a region free of poverty and provides an agenda for ADB’s poverty-reduction and growth-financing activities over 15 years, with an accent on sustainable economic growth, inclusive social development, and good governance for effective policies and institutions.
Box 1: The Changing Operations Evaluation Landscape
The context of development is changing, and there is a sense that its rate and extent are now greater than ever. The drivers of change are global and regional as much as national. OED needs to think and work in new ways, learn from the past, but also look to where operations evaluation is heading.
• New emphasis on aid effectiveness.
