Hello, I am Barbara Klugman (PhD), based in South Africa, once an anti-apartheid and women’s rights activist, now providing freelance strategy and evaluation supports for social justice funders, networks and NGOs.
I work with groups engaged in organising and advocating for social or environmental justice. In this process, I have come to realise that sometimes just the term ‘evaluation’ is enough to undermine the possibility of them initiating or further institutionalizing their information gathering, reflection, learning and adaptation processes. Their experience of ‘M&E’ is the requirement created by their funders that they name, in advance, what they will do and what they will influence. This might work alright for a group running an already-established service, but it is entirely guesswork and inappropriate for groups whose effectiveness requires them to shift both protest and advocacy strategies as the broader public and political discourse shifts, and as windows of opportunity for influence open and then close. Whatever they plan, they may need to shift.
The term ‘M&E’ is associated with funders’ power and non-negotiable upward accountability, as is routine data-gathering. Yet many of these groups are profoundly reflective, undertaking research or consultations to understand their terrain and shape strategies; and engaging in the before- and after-action-reviews that support emergent learning. Indeed when running workshops on evaluation, I often argue that effective activists are built-in evaluators within complex systems. They read the terrain – the stakeholders, the diverse perspectives, the prevailing environment, and shape their strategies accordingly. After any action they ask what worked? What did not and why? What should we do differently next time? They nimbly shift strategies.
The challenge many have is that they do so in the rhythm of their activism, but once they are more than a small group, they have to be able to document their influence and to build a shared analysis within their institutions and across their networks. Having insights inside their heads and hearts or small groups is not enough. They also need the specifics of their outcomes and their contributions towards influencing them clearly documented, for cross-institutional and network learning as well as to support communications and fundraising.
Lessons Learned
To strengthen their ability to capture their stories of change and to institutionalise their reflection and learning processes, I’ve stopped using the language of M&E or MEL. I ask about their approach to strategic reflection. While the term ‘learning’ is hip among evaluators at the moment, to many of my clients it is associated with school and education; ‘strategy’ is their lingo and resonates for them.
Related to this, I’ve learnt that when hiring a staff member to support social justice groups in data-gathering, documenting and making sense of their efforts, they need to be wary of applicants whose only experience in ‘M&E’ is checklist monitoring of compliance to contracts for funder-supported service provision, where data is not used for evaluation. They should rather seek someone who has experience in activism and advocacy with training in social or political theory, who will bring to bear the principle of collective action, and an evaluative lens.
Rad Resources
- On fostering emergent learning, see: Darling et al 2016 Emergent Learning: A framework for whole-system strategy, learning and adaptation.
- On shifting funders’ approaches to accountability, see Taylor, A., & Liadsky, B. (2018) Achieving Greater Impact by Starting with Learning , Taylor Newberry Consulting; and Honig, D. (2020). Actually Navigating by Judgment: Towards a new paradigm of donor accountability where the current system doesn’t work. Policy Paper 169, Centre for Global Development.
Originally posted at: https://aea365.org/blog/ol-ecb-tig-week-must-we-call-it-evaluation-how-me-language-can-be-a-barrier-to-institutionalising- learning-by-barbara-klugman/
