Performance assessment; Monitoring, evaluation and learning (MEL)
Design of innovative but practical MEL tools to assess performance
MEL in conflict and fragile states has always been at the heart of Almizan’s core business. We do not see MEL as an ‘add on’ but as an intrinsic component of sound programme design and delivery. We have designed a suite of MEL approaches that measure progress towards attitudinal and behavioural change across individuals and institutions, and help clients assess how political access and influence objectives are being met. We help operationalise evidence collection and analysis throughout implementation, taking into consideration the realities of the operating context, human/financial resource constraints and the sensitivity of the intervention. We provide MEL plans which clearly lay out data collection roles and responsibilities and train delivery teams on the use of best practice methodologies.
Delivery of strategy testing workshops and mid/end term reviews
Working closely with delivery teams, we run internal workshops and learning sessions to assess progress towards desired objectives and ‘stress-test’ intervention strategies. We hold deep expertise in securing buy-in from, and working collaboratively with, counterparts who may be less familiar with MEL or initially reluctant to engage: for example in CT/SOC programmes where partners may initially assume that that evidence gathering will expose confidential, operational-level information. Our key indicator of success on MEL is ensuring delivery teams and partners see the benefits of MEL for themselves and are willing and able to continue integrating good practice into delivery after our support ends.
Integration of lessons learned and distillation of impact
We conduct in-depth, semi-independent, or independent reviews and evaluations of portfolios, programmes, and projects. Almizan holds specialist expertise in conducting evaluations of sensitive interventions working with security, military and intelligence partners and interventions seeking to elicit complex behavioural or attitudinal change.
We design reviews and evaluations to be non-judgmental and support the uptake of learning, by tailoring conclusions and recommendations to reflect a deep understanding of i) relevant strategies and monitoring frameworks, ii) high-level policy priorities that need to be operationalised on the ground, iii) multi-agency / cross-departmental working practices and iv) the needs of individual users and teams.
Our reviews help our clients to define their ‘value add’ and build the case for renewed funding.
Mentoring and capacity building to support implementation
Short- and long- term deployment of experts
We hold a carefully selected core network of like-minded, impact- oriented international experts with deep mentoring and capacity building experience working for or on behalf of multiple governments, associated security, intelligence and military institutions, the United Nations, and other multilateral organisations, think tanks, academia and private companies. Almizan personnel have deep expertise in sought-after technical areas, but also the ‘soft’ skills to navigate sensitive political, operational and other contextual dynamics. Our experts know how to build the local relationships required for success (and /or are sourced from those local contexts) and are able to tackle problems from multiple angles.
Programme strategy and design
Setting and maintaining strategic intent
We ensure alignment—within and across project/programme delivery teams and policy counterparts—on the key problems an intervention seeks to address. We lead the development of theories of change and results frameworks, which balance ambition with realism, identify assumptions that may affect delivery, and are ‘ground-truthed’ to align with the complexity/sensitivity of the intervention. We enable delivery and policy teams to ultimately own performance management and measurement tools themselves and view these as an intrinsic component to good programme management.
Provision of methodology, risk management and mitigation advice
Based on our own longstanding experience of frontline delivery of complex programming, we provide ongoing support in across a wide range of thematic areas to ensure underlying delivery methodologies and risk management processes are robust and draw on evidence of what is more likely to generate sustainable effect. Almizan is experienced at introducing and leading conflict sensitivity (CS) implementation plans and intersectional (i.e. gender equality and social inclusion sensitive) CS reviews, both within our own projects and as independent, external, third-party reviewers. We integrate key performance indicators into monitoring, evaluation and learning (MEL) frameworks, to evaluate CS processes and assess projects for contributions to conflict transformation.
Research and analysis
Delivery of conflict research and analysis to inform implementation
We draw on our in-country networks to generate tailored analyses, including in-depth assessments of micro-contexts and hard-to-reach populations. Our networks range from government and security/defence officials to civil society and donor representatives, local academics and researchers, and our in-country experts—who have relationships needed to access and engage with sensitive stakeholders. We offer a range of capabilities, including ‘light-touch’, but rigorous, qualitative and quantitative methods, at cost proportionate to budgets. This allows us to: 1) ensure analysis is refreshed at regular intervals, and 2) leverage research methods to rapidly ‘stress test’ proposed project adaptations, as needs arise, to support delivery at pace, in highly fluid contexts.
Generation of evidence to support early action on emerging risks
We use our findings to help clients identify entry points that support coherence between strategy/policy decisions, programming aims and on-the-ground conflict dynamics. We focus on risk and help our clients and counterparts do the same—so that they can think more strategically and take preventative action early. We are skilled at developing counterparts’ early warning capability and understanding of when and how to take pre-emptive action, while reducing the risk of counterproductive effects later (e.g. damaging community-police relationships or compromising investigations and prosecutions). We have expertise in how to monitor and measure changes in risk, as well as the impact of preventative work.