Long term survey strategy: summary report and framework to support decision-making

Introduction

This document summarises the key findings from research conducted by Ipsos with Professor Peter Lynn exploring mixed mode survey designs in the context of the Scottish Government's large-scale general population surveys. The research was commissioned by the Scottish Government to inform its thinking ahead of its next Long Term Survey Strategy (LTSS).

This summary document first briefly sets out the context, scope and methods of the research and introduces the key concepts and issues it covers. The main findings on the implications of changing or mixing modes for survey quality are then summarised. Practical issues and challenges relating to resources and the scope to use administrative data are discussed, and recommendations around good practice in arriving at robust decisions on future survey modes are presented.

It is worth acknowledging that, given the wide scope and relatively technical nature of the topic, this summary is necessarily longer than a typical social research report summary. Tables which set out the key issues, potential mitigations, and remaining issues and trade-offs to consider with respect to the Scottish Government's flagship general population surveys (including issues specific to each of the three individual surveys, where relevant) are used to present the main messages in a more digestible manner. Taken together, these summaries are intended to provide a framework to help inform consideration of future survey options. For those looking for more detail on the issues discussed, the accompanying full report provides far more detail. It also includes 21 detailed case studies on relevant large scale surveys from the rest of the UK and outwith the UK and references for those who wish to follow specific topics up further.