Scottish climate change adaptation programme 2019-2024: consultation draft

Annex B: Climate Change Adaptation Programme - Monitoring and Evaluation Framework

Monitoring and Evaluation is integral to the outcomes based approach and encourages M&E to be considered at all stages of adaptation policy development.

The following principles will guide the development of the framework:

Principle 1: Indicators to measure progress will be considered at the same time that planned outcomes are identified. This will encourage the development of measurable objectives to enable:

• external evaluation of progress
• internal evaluation of delivery and progress
• timely changes to the programme in response

Principle 2: The adaptation process will be monitored to assess whether the programme actions are taking place and that policies and interventions are on track. Process indicators support accountability in the short term, but also monitor the implementation of actions which are aimed at achieving long-term outcomes out-with the usual programme timeframes.

Principle 3: The framework will link the adaptation process to adaptation outcomes and discourage the listing of policies and actions without considering their potential effectiveness.

Principle 4: The identification of outcome and process milestones will be encouraged to assess interim progress. Routinely identifying milestones and targets, specifying a timetable and considering potential effectiveness, will aid the reporting process and enable the delivery of flexible adaptation strategies.

Principle 5: Existing indicators and monitoring frameworks will be utilised where appropriate. This will facilitate integration of adaptation across other policy areas, help to align M&E mechanisms and minimise reporting effort.

Principle 6: Improvement and learning underpins the framework- by identifying what we need to measure not just what we know we can, the framework can be used as a tool to highlight monitoring gaps which could be filled by future adaptation measures.

Indicators to monitor progress towards high-level outcomes: These indicators will capture key elements at the heart of each of the Programme's outcomes. Indicators at this high level will have a clear relationship to Scotland's National Performance Framework.

Monitoring allows us to evaluate the ability of the adaptation programme to increase adaptive capacity and reduce Scotland's vulnerability to climate change, and evaluate the adaptation programme in the context of contribution to wider government goals and performance framework.

Indicators to monitor progress towards sub-outcomes: These indicators will focus on the critical components that are required to progress towards the outcome. Initial focus will consider what evidence is needed to properly assess progress (identifying what we need to measure not just what we know we can measure). The emphasis should not be on 'what we are doing?' but on 'is it working?'

This monitoring allows us to evaluate outcome progress and the contribution of adaptation measures to that progress.

Indicators to monitor the adaptation process: These indicators will monitor 'what is being done?' to address the critical outcome components. They will capture the qualitative and quantitative evidence needed to ascertain if the adaptation measures are being adequately implemented.

This monitoring allows us to evaluate the potential for measures to effectively and efficiently deliver the adaptation outcomes. In the absence of outcome indicators or where changes to outcomes will only be detectable over a long timeframe, these may act as proxy indicators for adaptation progress (with the assumption that successful implementation will contribute to programme outcomes in the long-run).

Overview of the planned monitoring and evaluation framework for the second SCCAP

Where appropriate, the indicators will draw upon the monitoring frameworks in all relevant policy areas which are already in place or being developed. In some sectors, there is currently limited data available but as more data and associated monitoring arrangements are being developed, these will be incorporated into the monitoring framework where appropriate. We will continue to develop the approach as we learn from the implementation process.

Governance of the Monitoring Framework

As with the commitment in the Climate Change Plan, we will set up a Governance Body to oversee the monitoring and implementation of the Adaptation Programme.

The Governance Body will have an important role in ensuring that we remain on track towards delivering our outcomes and continue to improve policy design and implementation. The key functions will be:

• Reviewing monitoring information and other relevant data to assess progress against outcomes in the Programme.
• Providing advice to Scottish Ministers on the monitoring information.
• Producing an annual monitoring report for inclusion in the annual progress report published by the Scottish Government.

This Body will be made up of senior Scottish Government officials representing the key sectors in the Programme, and a non-Scottish Government representative to provide an independent overview and external scrutiny of the monitoring process.

The Body will report to the Scottish Ministers and may engage with and seek input or advice as appropriate from any external body including the Committee on Climate Change Adaptation Sub-Committee, who will continue to provide independent advice to the Scottish Government.

The suite of monitoring indicators in this Programme and our overall monitoring approach will be subject to ongoing review and we will continue working with the Committee on Climate Change Adaptation Sub-Committee and the Scottish Parliament to ensure robust and effective monitoring of the Plan's implementation.