ICT4D Monitoring and Evaluation Tools and Reports
This page contains resources that assess the impact of ICTs in development efforts, as well as guidelines and handbooks on how to monitor and evaluate ICT4D projects.
This study was developed to assist development practitioners in assessment and selection of information and communication technology (ICT) applications for monitoring and evaluation in rural projects, specifically in agriculture and forestry, with an emphasis on mobile technology for data collection. Particularly in highly decentralized projects, data collection can be challenging, and the large number of options and specific project needs makes selecting technology a challenge. This report was developed in response to an identified need for development practitioners to be able to stay current with changing technology and identify appropriate avenues for assessing and selecting technology to support monitoring and evaluation (M&E) as well as project outcomes. The report proposes guidance in selecting and applying technology for data collection and monitoring and evaluation through the lens of agriculture and forestry projects. It is designed to be a deep-dive, operational piece that tackles how governments and development practitioners can use ICT to enhance their data collection and M&E efforts in rural development projects and programs.
The rapid uptake of the Academy programme across Asia and the Pacific region called for a comprehensive and streamlined approach to monitoring and evaluating the progress and achievements of the Academy programme, so as to better manage outputs and outcomes and improve future programme implementation. In response to this need, APCICT developed a Monitoring and Evaluation (M&E) framework in 2010, and subsequently, the Academy M&E Toolkit in 2013. The Toolkit aims to provide national and sub-regional partners with practical, step-by-step guidelines for monitoring and evaluating the Academy programme by helping the partners map out, customize and strengthen M&E plans and systems in their organizations.
Information and communication technology for development (ICT4D) projects can only be considered successful if they lead to some kind of individual, social, or economic development. The benefits of introducing ICT4D projects in developing countries are yet to be realized, particularly those introduced in mountainous and remote areas. This study addresses this knowledge gap by analyzing the Nepal Wireless Networking Project from the mountain areas in Nepal using the assets pentagon model (APM). The main contributions of this work are threefold: First, it illustrates and discusses the use and usefulness of introducing APM, addressing the call for more clarity as to how ICT4D projects add to development. Second, it expands the research knowledge of the relationships among various capital assets. Finally, it reports on an ICT4D project from the mountain areas of Nepal, representing a country and an area that have been scarcely reported in our research community.
On 15-18 April, 2014, UN-APCICT organized its Regional Training of Trainers Workshop on Primer Series 2 on “Project Management and Information and Communication Technology for Development (ICTD)” and Monitoring & Evaluation (M&E) of the Primer Programme in Incheon, Republic of Korea.
UN APCICT has developed Module 10 on ICT, Climate Change & Green Growth as part of the Academy of ICT Essentials for Government Leaders (Academy), and the Monitoring & Evaluation Toolkit for the Academy.
Regional experts from government, academia, civil society and the private sector, and the United Nations hub for information and communication technology for development (ICTD) gather to enhance monitoring and evaluation tools for ICTD capacity building programmes.
Steering e-Government Projects from Failure to Success: Using Design-Reality Gap Analysis as a Mid-Implementation Assessment Tool
There are many e-government failures in developing countries. Most studies look at these after the event, while this working paper examins mid-implementation in order to provide recommendations for improvement.
There is increasing interest in the use of information and communication technologies (ICTs) in education institutions in low-income countries. This paper examines the disproportionate costs associated with developing ICT infrastructure in education institutions in developing countries due to a lack of in-country ICT infrastructure planning and implementation skills, and the lack of concrete guidance regarding the stages of development needed to make efficient use of resources and maximize the chances of sustainable investments.
This study looks into the relationship in Brazil between ICT use in voting mechanisms and citizen trust in government. The electronic voting system of Brazil is widely trusted by the citizens of the country and international observers as an efficient and reliable mechanism of producing elections results that accurately represent the choices of the electorate.
The latest edition of Measuring the Information Society features the new ITU ICT Development Index. The Index captures the level of advancement of ICTs in more than 150 countries worldwide and compares progress made between 2002 and 2007. It also measures the global digital divide and examines how it has developed in recent years. The report also features a new ICT Price Basket, which combines fixed, mobile and broadband tariffs for 2008 into one measure and compares it across countries. The analytical report is complemented by a series of statistical tables providing country-level data for all indicators included in the Index.
The manual serves as a reference for national statistical offices and other producers of official statistics on business use of information and communications technology (ICT). The Manual provides a guide to data collection and analysis, international standards, and definitions. It also offers model questions for surveys on ICT use, and it reviews important institutional issues related to compiling ICT statistics. The Manual focuses on statistical issues particular to developing countries and countries with economies in transition, and provides useful advice on how to tackle statistical challenges.
The biennial Digital Review of Asia Pacific is a comprehensive guide to the state-of-practice and trends in information and communication technologies for development (ICT4D) in Asia Pacific. This third edition (2007–2008) covers 31 countries and economies. Each country chapter presents key ICT policies, applications,and initiatives for national development. In addition, five thematic chapters provide a synthesis of some of the key issues in ICT4D in the region, including mobile and wireless technologies, risk communication, intellectual property regimes,and localization.
One outcome of the World Summit on the Information Society was a Plan of Action enunciating ten targets to be achieved by 2015 of which the first is: “...to connect villages with ICTs and establish community access points...” This report describes research to measure the target. It is based on questionnaires sent to developing country telecommunication administrations as well as review of relevant reports issued by government statistical and ICT-related agencies and other sources.
The aim of this publication is twofold. The first is to present a coherent picture of the state of the information society in the world. To achieve this, the publication presents available statistical data based on a core set of internationally agreed information and communication technology (ICT) indicators. The second aim is to show recent developments in ICT measurement and, importantly, highlight the considerable gaps that remain. The publication has been produced by the Partnership on Measuring ICT for Development.
This publication, the first in a series of reports covering the state of the information society on an annual basis, focuses on the theme of participation. The report has three interrelated goals: surveying the state of the field of ICT policy at the local and global levels; encouraging critical debate; and strengthening networking and advocacy for a just, inclusive information society. It discusses the WSIS process and a range of international institutions, regulatory agencies and monitoring instruments from the perspective of civil society and stakeholders in the global South. The publication also presents a series of country reports which examine issues of access and participation within a variety of national contexts.
In an effort to measure and bridge the digital divide, several different types of indicators have been developed to measure the readiness of a country to adopt information and communication technology (ICT). Many of these indicators measure the extent to which the technology has been adopted within the target population. While some indicators recognize the importance of computer skills and e-literacy, there has been minimal effort to develop a multi-factor set of indicators to measure ICT human resource capacity. In this paper, the authors draw upon prior work on ICT indicators to develop eight sets of ICT human resource capacity indicators, including human capacity of ICT specialists, advanced users, basic users, ICT enabling managers, ICT equipped educators, thought leaders, policy makers, and infrastructure builders.
The report tracks progress in digital opportunity for 181 economies over the past few years since the start of the WSIS process and is accompanied by a series of tables providing the latest statistics on the development of Information and Communication Technologies (ICTs) worldwide.
The World Information Society Report 2006 is the first edition in a series of reports that will monitor the development of the Information Society worldwide. In particular, this new series will chart progress towards the implementation of the outcomes of the World Summit on the Information Society (WSIS) and WSIS targets. This Report is intended to provide guidelines for policymakers, in particular in developing countries, in the context of mobilizing resources and developing their own strategies for building the Information Society. In this regard, the Report covers the main elements of the Information Society and provides a new tool for measuring progress towards building it, through the Digital Opportunity Index (DOI).
Gender Evaluation Methodology (GEM) for Internet and ICTs: A learning tool for change and empowerment
GEM for ICTs and internet initiatives is an online guide for conducting gender evaluations of initiatives that use ICT for social change. The guide provides users with an overview of the evaluation process (including links to general evaluation resources) and outlines suggested strategies and methodologies for incorporating a gender analysis throughout the evaluation process. GEM is not simply an evaluation tool. It can also be used to ensure that gender concerns are integrated into a project planning process.
The 2005/2006 edition of the Digital Review offers comprehensive reports and useful analyses of how 29 economies/countries are using information and communication technologies (ICTs) in business, government and civil society. In addition, there are three sub-regional chapters on APEC, ASEAN and the Pacific Island Countries, and four thematic chapters. A CD-ROM of the Digital Review of Asia Pacific 2003/2004 is included in the hardcopy of the publication.
This short handbook provides guidance for policy makers struggling with two key issues: (1) What is the impact on student achievement of introducing ICTs in educational settings in developing countries? (2) How should this impact be measured, and what are the related issues, especially as they relate to Education For All and other Millennium Development Goals?
Regional Human Development Report – Promoting ICT for Human Development in Asia: Realising the Millennium Development Goals
The report’s unique approach lies in its use of the Millennium Development Goals (MDGs) to measure and monitor the impact of information and communication technologies (ICTs) on human development. The report examines country-specific experiences in China, India, Indonesia, Malaysia, Mongolia, Pakistan, Sri Lanka, Thailand and Viet Nam, and provides cross-country comparisons on the use of ICTs to achieve the MDGs.
National Human Development Report – Promoting ICT for Human Development in Asia: Realising the Millennium Development Goals - India
This country report reviews and assesses progress made in India in drafting and implementing its national e-policies and e-strategies towards meeting its national development goals and the Millennium Development Goals.
National Human Development Report – Promoting ICT for Human Development in Asia: Realising the Millennium Development Goals - Sri Lanka
This country report analyzes the past accomplishments, current trends and future potential of information and communications technology (ICT) in pursuit of the Millennium Development Goals in Sri Lanka. It is based on a survey of Sri Lanka’s ICT initiatives and consultations with key stakeholders active in the development of ICT policies.
This study examines the interdependency between information and communication technologies (ICTs) and human development, and identifies ICT indicators for achieving the Millennium Development Goals.
Regional Human Development Report – Promoting ICT for Human Development in Asia 2004: Realising the Millennium Development Goals - Summary
This summary document, with a foreword by Sir Arthur C. Clarke, presents the essence of a pioneering attempt to assess the role of information and communication technologies (ICTs) in human development in Asia. It captures the rich variety of ICT initiatives in nine Asian countries (China, India, Indonesia, Malaysia, Mongolia, Pakistan, Sri Lanka, Thailand and Viet Nam) and draws lessons for identifying policy directions.
The 2003/2004 edition of the Digital Review provides an authoritative overview of how information and communication technologies (ICTs) are being deployed across the Asia-Pacific region to facilitate socio-economic development. It covers 27 economies and a special chapter on the Pacific Islands Countries.
The purpose of this toolkit is to identify opportunities, highlight innovative projects and activities, and suggest how development agencies can help realize the potential for gender equality. The toolkit can help these agencies assist developing countries in improving the efficiency and equity of their ICT policies and programmes by ensuring that they respond to the needs of both women and men. The toolkit is divided into 10 sections and it contains checklists, evaluation tools, examples of good practices, and resources that can be used to incorporate gender into ICT projects and project components. The toolkit has been designed for general distribution to researchers, educators, and development practitioners.
Strengthening Policy and Institutional Infrastructure in Information Technology: Study on Information Technology Needs Assessment and Readiness in the Greater Mekong Subregion
This study on information technology needs assessment and readiness assesses the needs of the Sub-region to recommend steps for development and use of IT-based services for overall economic growth in the Sub-region.