Minority Rights Group International (MRG) Deputy Director, Claire Thomas, writes this opinion piece for the Thomson Reuters News Foundation.+ LEARN MORE
Evaluator: Securing Recognition of Minorities and Indigenous Peoples and their Rights in Botswana
Final Evaluation – Terms of Reference
1. Background on the project
This project sought to increase and deepen the engagement of CSOs in human rights in Botswana, particularly minority rights, with the overall objective of reducing discrimination against and lack of recognition of members of minority tribes in Botswana.
The programme has worked with two in-country partners – RETENG (The Multicultural Coalition of Botswana) and DITSHWANELO (the Botswana Centre for Human Rights).
2. Aim of the project
This programme – funded primarily by the European Instrument for Democracy and Human Rights – sought to strengthen the capacity of members of minority tribes and their representatives to advocate effectively for the full recognition of their rights, particularly to non-discrimination in respect of land issues. The programme operated in the following communities of Botswana: Wayeyi (Okavanago, Ngamiland & Boteti Districts); Basubiya (Chobe, Boteti & Ngamiland Districts), Babirwa (Central District); Batswapong (Central District); Bakgalahari (Southern Kgalagadi, Kweneng & Gantsi Districts).
3. Anticipated results
The full logical framework is in Annex 1. The 4 main anticipated results were:
Result 1: Increased capacity and knowledge amongst members of minority tribes as to their basic rights and increased ability to impart that knowledge to others in their community.
Result 2: Legal empowerment of members of minority tribes so that they are able to identify and monitor violations of their members’ rights and bring such violations to the attention of the relevant authorities.
Result 3. Documented progress towards improved recognition of minority tribes under the Bogosi Act.
Result 4: Documented progress made to obtaining amendments made to the Tribal Territories Act so that it is no longer discriminatory on the basis of major tribes
4. Evaluation Objectives
This final evaluation should systematically examine the extent to which anticipated results of the programme were achieved. Both implementing partners should be spoken to in the course of the research and as far as possible, stakeholders in all districts of implementation contacted, particularly beneficiaries and advocacy targets. Evidence should be gathered by visits to at least 3 of the 6 districts covered by the programme.
The evaluator will review programme documentation and will have separate discussions with each of the participating NGOs (MRG, RETENG and DITSHWANELO) to assess their views of the programme. The evaluation will be undertaken by reference to objectives, results, indicators and means of verification in the logical framework and will assess the impact of the activities. It will also look for unintended positive and negative consequences. The evaluator will be expected to take into account gender and other cross cutting issues. The conclusions of the evaluation will be reported to MRG’s and partners’ staff and management, to MRG’s International Council, donors. They will be used to plan for future initiatives.
5. Key evaluation questions
a. Referring to the project proposal and logframe, have all the activities been completed as planned? Where yes, has this been to a reasonably high quality? What problems have been encountered during implementation, and how has this affected the achievement of results? Were there any changes on the ground in Botswana or internationally which affected programme plans, and was MRG’s/ partners’ reaction and adaptation appropriate and timely? How have any problems affected the activities and to what extent have they been overcome? How well has gender been mainstreamed in the implementation, and have women benefited on par with men?
b. Where activities were completed as planned, have they contributed to the planned results or do they show potential to do so? Have there been any unplanned results (positive or negative)? If yes, what were they and how did they come about? Have partners participating in the project shown improvement in their capacity to advocate for the rights of minorities and indigenous people? How have they used their enhanced capacity to support communities to claim their rights or address leaders on minority rights issues? Although it may still be too early to be able to see clear impacts of the work at this time, do partners or beneficiaries report any changes/improvements because of the project?
6. Additional evaluation questions:
It would be interesting to understand whether some activities worked particularly well and are likely to have continuing impact, and if so, why. It would also be interesting to understand whether any activities are perceived, with hindsight, to have poor cost-benefit, and why.
7. Evaluation Methodology
The evaluation methodology can be further developed by the evaluator, but should follow these minimum benchmarks:
a. The methodology should be participatory.
b. The evaluator or evaluation team will seek the views of project partners, beneficiaries, community chiefs, politicians, media targets, advocacy targets, legal personnel and independent experts. Their views should inform the evaluator’s assessment of the project, activities, outcomes and future potential. (MRG will supply a contact list of possible key informants who have to date participated in or who have been reached by the project, but will expect the evaluator to also contact others not suggested by MRG and our partners.)
c. The report must be in English with the executive summary only translated into Setswana.
d. The report must contain an assessment of the effectiveness of the programme to date, and have recommendations for changes in methods or targets that MRG and partners can consider applying in similar programmes.
e. The report should include an executive summary of around 2 pages.
f. The evaluator should be available to be interviewed and recorded for publication on our website about the evaluation process and outcomes and the result will be uploaded to make the evaluation findings more accessible to a wider audience.
8. Key deliverables
a. Evaluation workplan/inception report
b. Preliminary findings (max. 5 pages) at mid-term of the evaluation period
c. Final evaluation report (min 20 pages, max 35 pages excluding annexes – including 2-3 page executive summary)
The evaluation should be carried out between August 2018 and December 2018. The milestones are as follows:
a. August/ September 2018: Inception report submitted to MRG by evaluator (this should be done at least 2 weeks prior to the start of field work).
b. 6 September 2018: List of possible key informants submitted to evaluator by MRG
c. October 2018: Field work by evaluator
d. 1 November 2018: 5-page statement of preliminary findings submitted to MRG by evaluator
e. 15 November 2018: Draft report submitted to MRG by evaluator for review by MRG staff and stakeholders
f. 30 November 2018: Comments returned to evaluator by MRG
g. 14 December 2018: Final report submitted to MRG by evaluator
h. End-December 2018: Setswana translation of final executive summary of the evaluation report, submitted to MRG by evaluator
MRG will share the final report with donors, partners, MRG staff, Trustees, and the general public.
The evaluator/members of the evaluation team will also be required to participate in a recorded interview discussion about the evaluation to create an audio record or podcast which will be available on MRG’s website to make the evaluation findings available in more accessible ways.
The budget for this piece of work including the evaluators’ fee(s), all travel, communication, insurance and other costs is €4,500.
11. Experience and expertise required
The evaluator or evaluation team should:
a. Have sound legal knowledge of human rights and the rights of minorities and indigenous people, even if not necessarily a legal qualification. If they are not legally qualified, they should have experience in the field of legal or paralegal empowerment.
b. Have extensive knowledge and experience of minority rights.
c. Experience of carrying out or evaluating training, capacity building, and work with smaller NGOs in unsupportive contexts would also be helpful
d. Be fluent in English and Setswana
e. Be knowledgeable about the legal, social, political, and human rights context in Botswana.
f. Understanding of gender issues
g. Experience of advocacy strategies and experience of influencing decision makers.
h. A strong track record of evaluations carried out on comparable projects
i. Be able to travel – including to areas with poor road networks.
j. Have experience of participatory evaluation methodology and know how to gain the trust of key informants.
k. Work with full respect for confidentiality.
The evaluator will need to be independent of MRG and project partners, its donors, the project targets and participants and will need to demonstrate that no perceived or actual conflict of interests would arise during the evaluation. The evaluator will need to work within the time frames outlined below. The evaluation will need to satisfy all the requirement of the donors (primarily the EU), and respect evaluation guidelines issued by them.
12. How to apply
If you are interested in being considered for this opportunity, please send the following to email@example.com by 20 August 2018.
a. Brief (max 4 page) CVs of all evaluation team members.
b. Cover letter – indicating relevant experience and knowledge and how you meet the candidate requirements.
c. At least one, and if possible two, similar completed evaluation reports.
d. Workplan including methodology, timetable, budget for the evaluation including plans for visits to the project community locations (this does not need to exceed 2-3 pages).
e. The names of 2 references who can comment usefully on the evaluation team members’ experience and suitability.