Glossary

 

 

Activities What a program does with its inputs. Examples are construction of a kindergarten, computer training for youth, counseling of women, raising public awareness regarding childhood diseases, etc. Program activities result in outputs.

 

Background The contextual information that describes the reasons for the project, including its goals, objectives, and stakeholders’ information needs.

 

Baseline data A baseline study is the analysis describing the situation prior to the implementation of the project, which is used to determine the results and accomplishments of an activity, and which serves as an important reference for the summative evaluation. 

 

Case study An intensive, detailed description and analysis of a single project, program, or instructional material in the context of its environment. Study based on a small number of “typical” examples. Results provide in-depth review of the case but are not statistically reliable.

 

Conclusion (of an evaluation) A reasoned judgment based on a synthesis of empirical findings or factual statements corresponding to a specific circumstance.

 

Context (of an evaluation) The combination of factors accompanying the study that may have influenced its results, including geographic location, timing, political and social climate, economic conditions, and other relevant professional activities in progress at the same time.

 

Data Information. The term "data" often describes information stored in numerical form. Hard data is precise numerical information. Soft data is less precise verbal information. Raw data is the name given to survey information before it has been processed and analyzed.

 

Data collection method The way facts about a program and its outcomes are gathered. Data collection methods often used in program evaluations include literature search, file review, natural observations, surveys, expert opinion, case studies, etc.

 

Development objective The ultimate and long-term objective of the development impact, which is expected to be attained after the project purpose is achieved.

 

Direct beneficiaries Usually institutions and/or individuals who are the direct recipients of technical cooperation aimed at strengthening their capacity to undertake development tasks that are directed at specific target groups. In micro-level interventions, the direct beneficiaries and the target groups are the same.

 

Effectiveness A measure of the extent to which a project or program is successful in achieving its objectives.

 

Efficiency A measure of the "productivity" of the implementation process – how economically inputs are converted into outputs, or the optimal transformation of inputs into outputs.

 

Evaluation An examination as systematic and objective as possible of an on going or completed project or program, its design, implementation and results, with the aim of determining its efficiency, effectiveness, impact, sustainability and the relevance of the objectives. The purpose of an evaluation is to guide decision-makers.

 

Evaluation design The logical model or conceptual framework and the methods used to collect information, analyze data and arrive at conclusions.

 

External evaluation Evaluation conducted by an evaluator from outside the organization within which the object of the study is housed.

 

Finding           Factual statement about the program or project based on empirical evidence gathered through monitoring and evaluation activities.

 

Focus group A small group selected for its relevance to an evaluation that is engaged by a trained facilitator in a series of discussions designed for sharing insights, ideas, and observations on a topic of concern to the evaluation.

 

Impact The positive and negative changes produced by a program or a component, directly or indirectly, intended or unintended.

 

In depth interview A guided conversation between a skilled interviewer and an interviewee that seeks to maximize opportunities for the expression of a respondent’s feelings and ideas through the use of open-ended questions and a loosely structured interview guide.

 

Indicators Quantitative or qualitative statements, which can be used to describe situations that exist and to measure changes or trends over a period of time. Indicators are used to measure the degree of fulfillment of stated objectives, outputs, activities and inputs.

 

Inputs The funds, personnel, materials, etc., necessary to produce the intended outputs of development activities.

 

Lesson learned Learning from experience that is applicable to a generic situation rather than to a specific circumstance.

 

Key informant Person carefully chosen for interview because of his/her special knowledge of some aspect of the target population.

 

Logical framework approach A tool for development planning and monitoring applied by some donor agencies.

 

Monitoring A continuing function that aims primarily to provide program or project management and the main stakeholders of an ongoing program or project with early indications of progress or lack thereof in the achievement of program or project objectives.

 

Objective Purpose or goal representing the desired result that a program or project seeks to achieve. A development objective is a long-term goal that a program or project aims to achieve in synergy with other development interventions. An immediate objective is a short-term purpose of a program or project.

 

Outcome indicators The specific items of information that track a program's success on outcomes. They describe observable, measurable characteristics or changes that represent achievement of an outcome.

 

Outcomes Results of a program or project relative to its immediate objectives that are generated by the program or project outputs. Examples: increased rice yield, increased income for the farmers.

 

Outputs The planned results that can be guaranteed with high probability as a consequence of development activities/inputs. They are the direct results of program activities.

 

Program A group of related projects or services directed toward the attainment of specific (usually similar or related) objectives.

 

A time-bound intervention that differs from a project in that it usually cuts across sectors, themes and/or geographic areas, involves more institutions than a project, and may be supported by different funding sources.

 

Project A planned undertaking designed to achieve certain specific objectives within a given budget and within a specified period of time.

 

A time-bound intervention that consists of a set of planned, interrelated activities aimed at achieving defined objectives.

 

Project document A document that explains in detail the context, objectives, expected results, inputs, risks and budget of a project.

 

Qualitative evaluation The approach to evaluation that is primarily descriptive and interpretative. Observations that are categorical rather than numerical and often involve attitudes, perceptions and intentions.

 

Quantitative evaluation The approach to evaluation involving the use of numerical measurement and data analysis based on statistical methods.

 

Recommendations Suggestions for specific actions derived from analytic approaches to the program components.

 

Relevance The degree to which the rationale and objectives of an activity are, or remain, valid, significant and worthwhile, in relation to the identified priority needs and concerns.

 

Reliability A measurement is reliable to the extent that, when repeatedly applied to a given situation, it consistently produces the same results if the situation does not change between the applications. Reliability can refer to the stability of the measurement over time or the consistency of the measurement from place to place.

 

Results A broad term used to refer to the effects of a program or project. The terms "outputs", "outcomes" and "impact" describe more precisely the different types of results.

 

Stakeholders Groups that have a role and interest in the objectives and implementation of a program or project. They include target groups, direct beneficiaries, those responsible for ensuring that the results are produced as planned, and those that are accountable for the resources that they provide to that program or project.

 

A person, group, organization or other body who has a “stake” in the area or field where interventions and assistance are directed. Target groups are always stakeholders, whereas other stakeholders are not necessarily target groups.

 

Structured interview An interview in which the interviewer asks questions from a detailed guide that contains the questions to be asked and the specific areas for probing.

 

Subjective data Observations that involve personal feelings, attitudes and perceptions. Subjective data can be quantitatively or qualitatively measured.

Sustainability Durability of positive program or project results after the termination of the technical cooperation channeled through that program or project. Static sustainability is the continuous flow of the same benefits, set in motion by the completed program or project, to the same target groups. Dynamic sustainability is the use or adaptation of program or project results to a different context or changing environment by the original target groups and/or other groups.

 

Sustainability factors Six areas of particular importance to ensure that aid interventions are sustainable, i.e. institutional, financial and economic, technological, environmental, socio-cultural, and political.

 

Target groups The main stakeholders of a program or project that are expected to gain from the results of that program or project. Sectors of the population that a program or project aims to reach in order to address their needs based on gender considerations and their socio-economic characteristics.

 

Terms of Reference (ToR) Action plan describing objectives, results, activities and organization of a specific endeavor. Most often used to describe technical assistance, study assignments, or evaluations.

 

Triangulation In an evaluation, triangulation is an attempt to get a fix on a phenomenon or measurement by approaching it via several (three or more) independent routes. This effort provides redundant measurement.

 

 

 

 

Selected Internet Resources

 

 

 

 

 

http://www.clearinghouse.net/

(Links to guides on Fundraising, Grants, Non-Profit Organizations, Public Services; click sub-category Business & Employment).

 

http://www.fundsnetservices.com/main.htm

(Resources on Funding, Grant Writing, Non-Profit, Research and Educational Resources).

 

http://www.not-for-profit.org/

(Nonprofit Resource Center with a comprehensive directory of links and information on issues such as Fundraising & Philanthropy; Volunteers & Human Resources; Advocacy & Public Relations; Board & Organizational Support; Management Consultants; Publications; and Research & Policy Studies).

 

http://comnet.org/net/

(Gateway to sites for the nonprofit community, organized by resource topics such as Education, Government, Grants & Funding, Health Care Services, Human Services, and Political Activism).

 

http://www.boardsource.org/main.htm

(Dedicated to building stronger NGO boards and NGOs; focus on NGO Governance).

 

http://www.escape.ca/~rbacal/articles.htm

(Online articles on Nonprofit Management Problems, Solutions & Issues; Training, Development, Learning & Human Resources; Defusing Hostility & Cooperative Communication; Change Management: Teams & Team Development, etc.).

 

http://www.mapnp.org/

(The Nonprofit Managers' Library: information, materials and links on topics such as Administrative Skills; Boards; Chief Executive; Communication Skills; Ethics for Managers; Finances; Fundraising/Grant Writing; Marketing/Public Relations; Management & Leadership; Training & Development; Personnel & Policies; Program Evaluation; Strategic Planning; Quality Management; and Volunteer Management).

 

http://shortguides.com/nonprofit

(Information and resources about Nonprofit Organizations, including Funding, Management, Technology, Philanthropy, Volunteer Activity, Programs and Activities).

 

http://www.fundraising.co.uk/

(Everything on Fundraising: information, links, strategies, agencies).

 

http://www.idealist.org/

(Huge database on NGOs worldwide, including publications, materials, programs and links. See http://www.idealist.org/tools/tools.htm for a list of useful resources for starting and managing a nonprofit organization. Categories include Financial Management, Foundations, Fundraising, Government Relations, Lobbying, Management, Personnel Management, and Public Relations).

 

http://www.tmcenter.org/library/links.html

(Extensive list of links and resources for Nonprofit Organizations).

 

http://fdncenter.org/

(Includes an online library – see http://fdncenter.org/onlib/onlib.html - with links to nonprofit resources, including: Material on Grant Seeking; a Guide to Funding Research and Resources; a Proposal Writing Course; Literature on the Nonprofit Sector; and Common Grant Application Forms).

 

http://www.jsi.com/idr/

(Links, information and reports from the Institute of Development Research, an independent nonprofit research and education center).

 

http://www.worldlearning.org/

(Educational services NGO working in International Development, Training and Capacity Building, NGO Management, and Democratic Participation).

 

http://www.innonet.org/

(Free resources for Nonprofit and Public Agencies).

 

 

 

 

http://www.nwlink.com/~donclark/hrd.html

(Website for Human Development Resources, including articles, online Training Guides, links to Training, Human Resource Development, and Learning Information).

 

http://www.tcm.com/trdev/

(Training & Development Resource Center for Human Resources).

 

http://www.astd.org/

(Website of the American Society for Training and Development with information, tools, articles and links to training, performance, evaluation, etc.).

 

 

 

 

 

http://ctb.lsi.ukans.edu/tools/EN/part_1010.htm

(Community tool box for evaluating programs and initiatives).

 

http://ericae.net/

(Clearing house for assessment, evaluation and research methodology).

 

http://www.casanet.org/program-management/evaluation/index.htm

(Reports and manuals on evaluation).

 

http://www.mapnp.org/library/evaluatn/evaluatn.htm

(Everything on evaluation activities in organizations, types of evaluations, online guides, etc.).

 

http://www.ncrel.org/tandl/eval2.htm

(Evaluation design and tools for the why, what and how of evaluation).

 

http://www.hc-sc.gc.ca/hppb/familyviolence/html/1project.htm

(Guide to Project Evaluation).

 

http://www.ehr.nsf.gov/EHR/REC/pubs/NSF97-153/start.htm

(User-Friendly Online Handbook for Mixed Method Evaluations).

 

http://oerl.sri.com/

(Online Evaluation Resource Library).

 

http://www.horizon-research.com/publications/stock.pdf

(Comprehensive guide to evaluating programs).

 

http://www.idrc.ca/evaluation/documents/rebk1512.pdf

(Resource book on monitoring and evaluation of program performance).

 

http://www.usaid.gov/pubs/usaid_eval/   and http://www.dec.org/usaid_eval/

(USAID evaluation publications).

 

http://www.ehr.nsf.gov/RED/EVAL/handbook/handbook.htm

(User-Friendly Handbook for Project Evaluation).

 

http://www.interaction.org/evaluation/tips.html

(Evaluation resources, tips and best practices).

 

http://www.unfpa.org/ooe/toolkit.htm

(The UNFPA Program Manager’s Monitoring and Evaluation Toolkit).

 

http://www.mande.co.uk/news.htm

(News service focusing on developments in monitoring and evaluation methods relevant to development projects and programs with social development objectives).

 

 

http://www.unicef.org/reseval/

(Evaluation and monitoring methods and tools and many related resources).

 

http://www.eval.org/

(American Evaluation Association's homepage devoted to improve Evaluation Practices and Methods; has a lot of good material and links).