Attainment Scotland Fund evaluation: interim report (year 3)

1. Introduction and Methodology 

Introduction

1.1. The Attainment Scotland Fund evaluation began in 2015 and follows the duration of the Scottish Attainment Challenge. An evaluation of the first two years of the ASF was published in March 2018. This evaluation report of the Attainment Scotland Fund (ASF) focuses on Year 3 of the ASF (i.e. 2017/18). 

1.2. This chapter provides detail on the aims of the evaluation, the overall approach and the structure of the Year 3 evaluation report.  

Methodology

1.3. The evaluation aims to provide learning about the overall implementation of the ASF and the extent to which the aims of the ASF have been met. 

1.4. Evidence in relation to these aims has been gathered from a range of sources and evaluated against a set of agreed research questions (detailed below). 

1.5. The sources used to inform progress in Year 3 of the ASF are set out below. 

• Administrative data: Information gathered as part of the routine organisation of the ASF provides data primarily on the funding local authorities and schools received.   
• Challenge Authority progress reports: Analysis of mid- and end- year progress reports submitted by Challenge Authorities in March and September 2018.  
• Local authority mini survey: In April/May 2018, all 32 local authorities were invited to take part in a short online survey. A total of 22 authorities responded, including all 9 Challenge Authorities. Questions covered their experience of the ASF and findings were published in September 2018.  
• Headteacher survey: In Autumn 2018, an online survey was distributed to headteachers of schools receiving Challenge Authority, Schools Programme and Pupil Equity Funding (PEF). This was the third year of the survey and included a sample of schools in receipt of PEF only for the first time. A total of 553 schools responded to the survey, representing a 40% response rate. The full report from the survey has been published online.  
• School Case studies: A total of 12 schools who volunteered to be involved in case study research were selected to capture a mix of schools on the basis of ASF support received, urban/rural classification and primary/secondary school. Each case study involved an interview with the headteacher and focus groups with staff in the school. The full report on the case studies has been published online. 
• Quantitative data on attainment and wellbeing: Report draws on measures published in the National Improvement Framework Evidence Dashboard 2018. Analysis focuses on patterns of attainment within and across Challenge Authorities and, where possible, differences between Challenge and non-Challenge Authorities at an overall level. 

N.B. Qualitative Research undertaken in 2017 has helped to inform ongoing analysis of recent evidence but has not formed a key data source for the time period covered in the current report. 

This report

1.6. This report focuses on how the ASF has evolved in Year 3 (i.e. 2017/18) of the Scottish Attainment Challenge. As such, findings highlighted in the report are mainly those that show any change in Year 3 from Years 1 & 2. 

1.7. Year 3 saw the continuation of Challenge Authority and Schools Programme funding. It was also the first year that schools had access to Pupil Equity Funding (PEF). The report therefore includes evidence on the evaluation of PEF for the first time, and considers any emerging differences across the three funding streams. 

1.8. The report is structured around the inputs, activities, short to medium term outcomes and long term impact of the Attainment Scotland Fund.