11. Evaluation: How to include a disability perspective
The evaluation phase of the project cycle answers the question: "Were planned benefits achieved, will they be sustained, and what lessons have been learned?"
This section briefly presents:
- What the programming phase is about
- The purpose of including a disability perspective at this phase
- The expected results of including a disability perspective
- The difficulties often encountered and the keys to success
- The possible cost implications of including a disability perspective
- What is this phase about? This section refers to the EC's PCM Guidelines for Aid Delivery Methods (2004), available at http://ec.europa.eu/europeaid/reports/pcm_guidelines_2004_en.pdf.
- Checklists for planning short-visits, conducting interviews and managing regular review meetings (see Section 7)
- Guidance on promoting participation and using facilitation skills (See Section 8) Part 2 - Logframe matrix
- ECOFIN Analysis
- Relevance
- Efficiency
- Effectiveness
- Impact
- Sustainability
- What is the purpose of including a disability perspective during the evaluation phase?
- To evaluate the results of projects which included a disability perspective
- To evaluate the spending of budget allocated to disability inclusion
- To measure the effects of not including a disability perspective in projects where disability should have been included
- To generate ideas for future disability-inclusive of disability specific projects
- Expected results of including a disability perspective at this phase
- You will know if including a disability perspective was relevant to the project and have a measurement of how much and how well the perspectives of persons with disabilities have been included
- You will know whether persons with disabilities have been excluded from the project processes and outputs
- You will know what future actions or projects should be undertaken to promote the inclusion of person with disabilities within EC support programmes
- Difficulties often encountered and key to success
Here is a list of difficulties you may face at this stage, and suggestions on how to overcome these difficulties.
- To convince authorities, stakeholders and EC managers that it is worthwhile to include a disability perspective in the project evaluation
Often development professionals are unaware of the need to include a disability perspective in poverty alleviation strategies and projects.
- Explore whether the country has signed the UNCRPD. This will reinforce their responsibility to include disability; for an up to date list of signatories see http://www.un.org/disabilities/countries.asp?navid=12&pid=166
- Share the information contained in part one of this manual with them. The information is simple and gives evidence of the importance of including a disability perspective.
- Explain what a including a disability perspective would contribute to the evaluation, in terms of relevance; effectiveness, impact and sustainability (see above).
- Explain that enlargement of the scope of evaluation could also bring some recommendations for the future.
- To convince authorities, stakeholders and EC managers that it is worthwhile to include a disability perspective in the project evaluation
Often development professionals are unaware of the need to include a disability perspective in poverty alleviation strategies and projects.
- What is the cost implication for including a disability perspective at this phase?
During the evaluation phase you may need to only slightly adapt the usual data collection tools and methods, with minimal extra cost. Costs include:
- To call stakeholders from the disability sector for a meeting and ensure their participation in the evaluation process on an equal basis with others (see 'Accessible meetings or events' : Word (171 Ko) - PDF (91 Ko)):
- Participation costs of participants- the same as for other civil society actors
- Organisation of the meeting in a physically accessible environment which only impacts on the choice of venue and should not involve extra cost (see tool 'Accessibility guidelines and checklists on-line' : Word (172 Ko) - PDF (81 Ko))
- Consult with invitees with disabilities about adaptations which may need to be made for them to attend and fully participate in the meeting.
- To conduct a disability analysis, if an overall review of disability in the given country is needed.(See 'Framework for a disability analysis at the country level' : Word (164 Ko) - PDF (80 Ko))
The purpose of the evaluation is 'to make an assessment, as systematic and objective as possible of an ongoing or completed project, programme or policy, its design, implementation and results.'
| Expected output | PCM guidelines ref. (edited in 2004) | EC supporting documents | Information requirements |
|---|---|---|---|
| Terms of references for Evaluation mission | Part. 1
Section 4.6. Evaluation
Activity/work programme schedules and resource/budget schedules (See Section 5
Risk management matrix (see Section 7.2.2) | Chap. 9, Prepare ToR; p. 129-130
The log frame
Financing Agreement and associated
Technical & Administrative Provisions
Monitoring reports (internal and external),
produced during implementation including
updated Annual Plans (See Section 7); | |
| Evaluation mission report | PCM p. 48 Terms of reference | The Evaluation Report format |
This manual is part of the project "Disability mainstreaming in Development Cooperation", supported by DG Employment and Social Affairs of the European Commission. The contents of this manual are the sole responsibility of CBM.
