Step 6.2 Defining your MEL framework

Key message

Select a mix of indicators or criteria – using both quantitative and qualitative methods – to help you evaluate adaptation outputs and outcomes effectively.

After defining your MEL scope and objectives (Step 6.1), outline how the measures in your adaptation plan will be monitored and evaluated – to assess their effectiveness in achieving climate resilience. It’s important to choose a combination of indicators or criteria, using both qualitative and quantitative methods. This will allow you to assess the concrete results of adaptation measures (outputs) and progress towards resilience (outcomes). Keep in mind that determining adaptation outcomes may take several years in some cases.

Table 1 Example of outputs and outcomes indicators

Climate change impact	Adaptation measure	Output	Outcome
Water shortage due to droughts	Wetland rehabilitation	Hectares of wetlands rehabilitated	Reduction in the impacts of drought on water quantity

Figure 4 Donatti, et al., 2020

Your MEL framework and selection of indicators or criteria should be realistic and comprehensive – proportionate to the available data and your organisation’s internal capacities and resources (see Example 6.2). The focus may initially be on the adaptation process and adaptation measures’ outputs, gradually expanding over time to incorporate additional indicators for measuring the long-term outcomes.

To measure outcomes effectively, you should approach MEL as an iterative and continuous process, performing Step 6 consistently. Long-term monitoring requires a consistent approach over time.

Your selected framework should have indicators or criteria that are relevant and clear. Your risk assessment and adaptation objectives (Step 2) and the adaptation measures selected (Step 5) should provide a sound basis for identifying these indicators.

Some examples of MEL indicators or criteria are offered below

Progress towards reducing climate impacts (Step 2.2)

Percentage of economic damage caused by extreme weather events (change over time)
Number of fatalities associated with wildfires (change over time)
Number of fatalities associated with flooding (change over time)
Number of fatalities associated with heat (change over time)

Progress towards reducing risks and vulnerabilities and increasing adaptive capacity

Percentage of population living in flood-prone areas (change over time)
Percentage of building restrictions adopted in hazard-prone areas
Number of hospital beds

Progress towards meeting adaptation objectives (Step 2.4)

Percentage of urban biodiversity
Percentage of impervious surfaces
Percentage of urban green areas (land cover, %)

Progress towards addressing barriers to adaptation

Number of authorities, organisations or networks actively participating in coordination mechanisms
Number of local or regional strategies for climate change adaptation developed (or adopted, implemented, etc.)
Number of sectoral policies, strategies and plans that incorporate climate change adaptation actions

Progress towards just resilience

Percentage of households with internet access
Percentage of population vulnerable to extreme heat
Percentage of population vulnerable to floods (or living in flood risk areas)
Percentage of tree cover in neighbourhoods with high unemployment rates

Gain inspiration from examples of adaptation indicators or criteria

Measurable indicators appeal to policymakers, as they provide quantifiable and tangible evidence of a region’s progress and performance. Validating quantitative data with stakeholder views allows for a more comprehensive understanding, delving into the ‘how’ and ‘why’ questions.

One illustration of a possible framework is the CDP-ICLEI Track reporting framework, applicable to local and regional authorities.

Example 6.2 MEL systems in European urban and metropolitan areas

· There are initiatives to help cities set up effective MEL systems, for example, France's ADEME methodology, or from European research projects, such as RESIN.

· Barcelona's Climate Plan for 2018-2030 outlines more than 240 measures to address climate change in the city, each with specific indicators to track progress. These measures are grouped into five priority areas, covering aspects like public well-being, energy efficiency in buildings and creating inclusive public spaces. Each priority area has several lines of action, with short-, medium- and long-term goals. To monitor progress effectively, the plan uses a comprehensive set of indicators based on key characteristics like relevance, data availability and ease of interpretation. These indicators cover aspects including impacts, actions, resources, the environment, perception and performance. For example, for actions on preventing excessive heat or developing green spaces, the indicators include metrics like activation of heatwave protocols, increase in tree cover, and availability of green surface area.

Stakeholders are engaged through workshops and presentations, allowing for participatory evaluation of the plan's effectiveness. The Citizen's Assembly for Climate provides a platform for sharing progress and inviting objective assessment, ensuring a collaborative approach to addressing climate change in Barcelona.

· The City of Antwerp (Belgium) has a detailed climate adaptation plan, with a large set of adaptation actions. An overview table is filled in for each action. It details the roles and responsibilities, objectives, methodologies, implementation period, expected results, estimated financing needed, and more. This approach makes it easy to evaluate progress regularly and adjust efforts if needed.

Indicators have also been developed for the Helsinki metropolitan area’s climate change adaptation strategy, to understand the need for adaptation and measures' effectiveness. The indicators are categorised under hazard/weather, exposure, adaptive capacity and composite vulnerability (following European Environment Agency indicator classes). They are further developed and supplemented according to monitoring needs.

Source: EEA Urban Adaptation Report 2024

Resources

CDP-ICLEI Track reporting framework (CDP-ICLEI)(2023)

Climate Adaptation: Measuring performance, defining targets, and ensuring sustainability (European Committee of the Regions)(2023)
Gives practical recommendations on assessing adaptation efforts, measuring progress and defining targets.

Adapting to climate change in European cities: Towards smarter, swifter and more systemic action (EU Covenant of Mayors for Climate and Energy)(2021)
Aimed at decision-makers and technical staff working on climate change adaptation and resilience. Section 4.1 looks at monitoring and evaluating actions.

Guidelines on Member States’ adaptation strategies and plans (European Commission)(2023)
Step 5 has guidance on the monitoring and evaluation process – defining the purpose, stakeholder engagement, developing indicators and communicating results.

Principles for Indicator Development (Climate-eval)(2015)
Documents the principles for developing, selecting and implementing indicators used in the monitoring and evaluation phase of adaptation.

Just Resilience for Europe: Towards measuring justice in climate change adaptation (EEA)(2023)
It offers insights on selecting the appropriate quantitative or qualitative indicators to measure progress towards achieving just resilience.

OECD-led report on Monitoring, evaluation and learning for climate risk management (2021)
It offers a framework to use when developing MEL frameworks for climate risk management interventions. Section 5 is particularly relevant.

Report - Indicators for Resilience Cities (OECD)(2018)
Aims to strengthen strategies for urban resilience through the use of indicators. Section 2 has guidance on how authorities can tailor them to policy priorities.

Review of indicator frameworks supporting urban planning for resilience and health (WHO Regional Office for Europe)(2022)
Chapter 5 reviews international indicators that support resilience planning.