Accountability in Monitoring and Evaluation (M&E): Challenges and Best Practices A Critical Perspective for University Students … Why Accountability Matters in M&E? šCrucial principle that is aimed at: šImproved project performance šEnhanced resource allocation šTrust-building Cartoon hand holding a book Description automatically generated What is Accountability (in M&E)? šNo single definition, but according to OECD – 3 dimensions: šAn obligation to demonstrate that work complies with agreed rules and standards. šA requirement to report fairly and accurately on performance results according to specified roles, responsibilities and plans. šAn obligation to show that any work carried out under contract is legally consistent with that contract. Self Upwards Accountability šCompliance with donor regulations, contract and/or other legal requirements, ethical or other standards. šFinancial accountability šHow money was spent šCost-benefit analysis šAccountability for short-term outcomes šAccountability for longer-term outcomes/impact Warning with solid fill Core Humanitarian Standards Why is accountability for results (outcomes and impact) challenging and may require careful management? -NGOs may carry out innovative or experimental work & outcomes cannot be easily guaranteed -NGOs may make only a small contribution to impact, especially if the subject of their attention is influenced by socio-economic and political environment, other actors, etc. -Work in volatile or uncertain environments = outcomes may be contested, hard or too costly to measure (especially impact) or beyond NGO’s control -Outcomes and especially impact may not be seen until long after a project What may happen if accountability requirement is not managed properly? What may NGOs’ negative coping strategies be? Possible answers: NGOs may be tempted to avoid risk; only carry out work that can easily be measured; set targets that can easily be reached; continue reporting against objectives or indicators that are obsolete; hide failures; ignore unexpected or negative change; and/or focus more on activity and short-term change than on longer-term, sustainable changes, etc. Downwards Accountability šA.K.A.: Accountability to Affected People (AAP) = the process of taking account of, and being held accountable by, different stakeholders, and primarily those who are affected by the exercise of such power. šMore challenging than other forms of accountability šPower disbalance šLack of or less penalties for non-compliance šStakeholder are too many and too diverse for systematic reporting Dayna Brown & Antonio Donini, ALNAP, 2014 Degrees of empowerment Why do you think this form of accountability is more challenging? How? Horizontal & Self Accountability Scales of justice outline Accountability Learning š šConsideration of context šThreshold of evidence šFocus on results and/or process šApproaches, methodologies & tools šCost šAbuse of M&E “You cannot be accountable if you do not learn. And you need to know how well you live up to performance expectations in order to learn. The tug of war between learning and accountability is nonsensical. They need each other.” (Irene Guijt, 2010) Other Common Challenges šLack of clear roles and responsibilities šLimited resources and capacity šPolitical and Institutional barriers šData quality and integrity issues šWeak feedback mechanisms Cartoon of a child holding a balloon and pointing at a balloon Description automatically generated Best practices for promoting accountability in M&E (1) šClear definition of roles and responsibilities šEnsure all stakeholders understand their roles and the importance of their contributions šAssign accountability at every level of M&E process šStrengthening data collection and verification šUse reliable and consistent methods for data collection šRegular audits and independent evaluations to verify data accuracy šParticipatory M&E and stakeholder engagement šInvolve beneficiaries and local communities in M&E processes šEnsure beneficiaries/local communities’ feedback is integrated into project assessments RACI - Sketchplanations | Desarrollo organizacional, Desarrollo ... Best practices for promoting accountability in M&E (2) šDevelop robust feedback (response) mechanisms šCreate channels for stakeholders to voice concerns and provide input on project progress šImplement regular reviews and mid-course corrections based on feedback šBuilding capacity šProvide adequate training and resources to staff involved in M&E šFoster a culture of learning and accountability across the project cycle šEnsure transparency in reporting šShare findings and outcomes openly with all stakeholders, including donors, communities and government bodies šUse accessible formats to present results and allow for easy scrutiny A diagram of a communication cycle Description automatically generated Ethical Considerations in M&E Accountability šInformed consent: Ensure that all participants in M&E activities are fully aware of the purpose and use of the data collected šConfidentiality and data protection: Safeguard sensitive information, particularly for vulnerable populations šAvoiding conflict of interest: Ensure that evaluators and data collectors are independent and aware of biases. Thank you! šSerhiy Ponomaryov šMEAL Manager šPolish Humanitarian Action šserhiy.ponomaryov@pah.org.pl šserhiyponomaryov@gmail.com